GitHub - KumarVaibhav27/DATABRICKS-x-DBT-End-To-End-Data-Engineering-Project: This project implements a modern data engineering pipeline using Databricks, PySpark, DBT, and Delta Live Tables. It follows the Medallion Architecture, supports realtime data ingestion with Autoloader, and models data with fact and dimension tables, including Slowly Changing Dimensions (SCD Type 2), all orchestrated in a scalable cloud environment

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
Databricks		Databricks

About

This project implements a modern data engineering pipeline using Databricks, PySpark, DBT, and Delta Live Tables. It follows the Medallion Architecture, supports realtime data ingestion with Autoloader, and models data with fact and dimension tables, including Slowly Changing Dimensions (SCD Type 2), all orchestrated in a scalable cloud environment

pyspark databricks data-build-tool delta-lake streaming-pipeline delta-live-tables databricks-unity-catalog dimensional-data-modeling databricks-autoloder