Skip to content

Ignore problematic batch 8590#39

Merged
ravwojdyla merged 1 commit intomainfrom
rav-skip-prob-batch
Jul 16, 2025
Merged

Ignore problematic batch 8590#39
ravwojdyla merged 1 commit intomainfrom
rav-skip-prob-batch

Conversation

@ravwojdyla
Copy link
Copy Markdown
Contributor

@ravwojdyla ravwojdyla requested a review from yonromai July 16, 2025 01:07
def __init__(
self,
zarr_path: str,
skip_batches: list[int] | None = None,
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

((minor/nit: Should be a set))

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point!

# Initialize datasets
train_dataset = DistillationDataset(zarr_path_train)
# NOTE: skip due to https://github.com/Open-Athena/caduceus-distill/issues/38
train_dataset = DistillationDataset(zarr_path_train, skip_batches=[8590])
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔥

@ravwojdyla ravwojdyla force-pushed the rav-skip-prob-batch branch from 4158d42 to 3848616 Compare July 16, 2025 01:21
@ravwojdyla ravwojdyla merged commit ec3c1b4 into main Jul 16, 2025
2 checks passed
@ravwojdyla ravwojdyla deleted the rav-skip-prob-batch branch July 16, 2025 01:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants