This project demonstrates a complete End-to-End Data Engineering Pipeline built using modern data engineering tools and best practices. The pipeline automatically extracts the latest COVID-19 daily re...

This project demonstrates a complete End-to-End Data Engineering Pipeline built using modern data engineering tools and best practices. The pipeline automatically extracts the latest COVID-19 daily reports from the Johns Hopkins University GitHub repository, loads the raw data into PostgreSQL, transforms it through a layered dbt ELT architecture, orchestrates the entire workflow using Apache Airflow, and delivers analytics-ready data for visualization in Power BI. The project implements a star schema consisting of dimension and fact tables, applies data quality testing with dbt, standardizes country names using dbt Seeds, and generates automatic documentation and lineage. Finally, the curated reporting models are consumed by an interactive Power BI dashboard, showcasing a complete production-like data engineering workflow from data ingestion to business reporting.
No maintenance status has been set yet.
You must be logged in to comment
Sign in to commentNo comments yet
Be the first to share your thoughts!