•
Apache Airflow·
dbt·
PostgreSQL·
Snowflake·
Python
This project takes raw Instacart grocery data, loads it into a database, transforms it using dbt into a star schema, deploys it to Snowflake in the cloud, orchestrates daily runs with Airflow, tests e...
About this project
This project takes raw Instacart grocery data, loads it into a database, transforms it using dbt into a star schema, deploys it to Snowflake in the cloud, orchestrates daily runs with Airflow, tests everything with 86 automated tests, automates deployment with GitHub Actions, and visualizes the results in a live Streamlit dashboard.
Stack:
Apache Airflowdbt