microsoft-fabric-data-pipelines

Microsoft Fabric Data Engineering Portfolio — DP-700 certification preparation. PySpark · Delta Lake · KQL · Azure Data Studio

This project ingests live Formula 1 telemetry, processes it through a highly scalable Medallion Lakehouse architecture (Bronze, Silver, Gold) using PySpark, and deploys an XGBoost Classification engine. The pipeline automatically evaluates Friday Race Pace and Saturday Qualifying track position to predict Sunday race outcomes, emailing the results

End-to-end data engineering pipeline on Microsoft Fabric — ingests smart meter readings and weather data, cleans and validates through a medallion architecture (Bronze → Silver → Gold), and serves a star-schema Power BI report. Includes incremental loading, daily orchestration, and Dev → Prod deployment.

End-to-End Microsoft Fabric Analytics Platform implementing Medallion Architecture, Lakehouse, Warehouse, Semantic Modeling, and Executive KPI Reporting using Power BI.

End-to-end Microsoft Fabric data engineering project using NYC Citi Bike public trip data. Covers Dataflow Gen2 ingestion, a Warehouse-based Gold star schema (stored procedures, MERGE, functions), a Direct Lake semantic model with advanced DAX, a Power BI dashboard, and full Dev→Prod CI/CD via Git integration and Deployment Pipelines.

End-to-end COVID-19 analytics pipeline on Microsoft Fabric — medallion architecture (bronze/silver/gold), star schema, Direct Lake semantic model with DAX, calculation groups, and field parameters, built on Google's COVID-19 Open Data.

Shows how to operationalize fabric-cicd to work with Microsoft Fabric and YAML Pipelines in Azure DevOps and perform automated tests