SpaceX Missions Data Pipeline

This is the code behind my free email data engineering course.

Want to learn more?

Run

This is an opinionated setup. You might not need to do it the way I do. We use a single virtual environment to keep track of all the dependencies.

The only requirement to run this project is uv. To install uv, run:

brew install uv
uv sync

To run Python scripts, run:

uv run -- src/<script>.py

Edit the config.json file to include your snowflake credentials. Then run:

uv run -- python src/tap_spacex.py | uv run -- target-snowflake

Run:

cd dbt
uv run -- dbt run