Skip to content

Conversation

@alkaline-0
Copy link
Contributor

Description

Persist previous dev_mode in local state and reset pipeline state on dev_mode toggle from True→False. Guarantees that non-dev runs always use a non-suffixed dataset name (explicit dataset_name if provided; otherwise default), independent of prior dev runs.

Details:

  1. Persist _local["last_dev_mode"] on state writes.
  2. In _get_state, if previous run had last_dev_mode=True and current dev_mode=False, return default_pipeline_state() (full reset) before props are applied.

Files touched:

  1. dlt/pipeline/pipeline.py: add toggle detection and reset to empty state.
  2. tests/pipeline/test_pipeline.py: add tests covering dev→non-dev transitions

Related Issues:

Fixes #3276

@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Nov 19, 2025

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Preview URL Updated (UTC)
✅ Deployment successful!
View logs
docs 7f5b0ab Commit Preview URL

Branch Preview URL
Nov 19 2025, 12:47 PM

@alkaline-0 alkaline-0 force-pushed the fix/3276-toggling-dev-mode-not-resetting-dataset-name branch 7 times, most recently from 89f300d to ce926f7 Compare November 19, 2025 12:39
…ate.

- Implemented logic to reset the dataset name when switching from dev_mode to non-dev_mode.
-  tests to cover scenarios involving transitions between dev_mode and non-dev_mode with explicit dataset names.
@alkaline-0 alkaline-0 force-pushed the fix/3276-toggling-dev-mode-not-resetting-dataset-name branch from ce926f7 to 7f5b0ab Compare November 19, 2025 12:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bug: toggling dev_mode doesn't reset dataset_name

2 participants