Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create Fabric notebook for Parking sensor data standardization step #835

Open
sreedhar-guda opened this issue Nov 13, 2024 · 2 comments · Fixed by #959
Open

Create Fabric notebook for Parking sensor data standardization step #835

sreedhar-guda opened this issue Nov 13, 2024 · 2 comments · Fixed by #959
Assignees
Labels
e2e: fabric Related with E2E Fabric Sample

Comments

@sreedhar-guda
Copy link
Contributor

sreedhar-guda commented Nov 13, 2024

The steps for data ingestion currently use Databricks (20_standardize.py). This logic needs to be converted for Microsoft Fabric notebook.

DoD:

  • A Fabric notebook is created with existing data ingestion logic.
  • Unit testcases are created.
  • README.md is updated.
  • Open telemetry added.
  • Sample data that will be used is created as per existing schema (should be same as existing Databricks sample).

NOTES:

  • Template file (nb-020-standardize.ipynb) is created as part of Create initial version of notebooks #862
    • If the Lakehouse tables ddls needs to be modified- then these can be done in lakehouse_ddls.yaml followed by execution of nb-010-setup.ipynb
@sreedhar-guda sreedhar-guda self-assigned this Nov 14, 2024
@sreedhar-guda sreedhar-guda added the e2e: fabric Related with E2E Fabric Sample label Nov 14, 2024
@sreedhar-guda sreedhar-guda removed their assignment Nov 22, 2024
@sreedhar-guda sreedhar-guda changed the title Create Fabric notebook for Parking sensor data ingestion step Create Fabric notebook for Parking sensor data standardization step Nov 22, 2024
@devlace
Copy link
Contributor

devlace commented Dec 12, 2024

Waiting on #931

@maye-msft
Copy link
Contributor

@camaderal
Please merge the spike backlog item #926 with this item.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
e2e: fabric Related with E2E Fabric Sample
Projects
None yet
4 participants