-
Environment
- Install dependencies with
uv pip install -e .[dev]. - Use Python 3.11+ for parity with the training pipeline.
- Install dependencies with
-
Data Safety
- Never modify files under
data/raw/legacy/. - Regenerate processed assets via
scripts/migrate_legacy_data.pyinstead of editing Parquet manually.
- Never modify files under
-
Code Style
- Run
ruffandblackbefore committing. - Add type hints and minimal docstrings for non-obvious logic.
- Run
-
Testing
- Execute
pytestfor unit tests. - Use the validation script to ensure dataset integrity after major changes.
- Execute
-
Pull Requests
- Summarize data impacts, including counts of added/removed records.
- Attach updated validation reports when touching ingestion pipelines.