Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shuffle over epochs: Cleanup definition #59

Open
voegtlel opened this issue Feb 7, 2025 · 0 comments
Open

Shuffle over epochs: Cleanup definition #59

voegtlel opened this issue Feb 7, 2025 · 0 comments

Comments

@voegtlel
Copy link
Collaborator

voegtlel commented Feb 7, 2025

Right now, this is not most intuitive to combine shuffle_over_epochs(_multiplier) with epochized_blend:

  • Shuffle over epochs will also repeat the dataset that many times (todo: implement to stop after singular dataset length, even if then not all samples may have been seen, but that is intended)
  • Clean up the definition of what shuffle_over_epochs(_multiplier) = -1|None means, by introducing literals instead: Union[Literal["sample_without_replacement", "disable_shuffle"], int] where int>=1
  • Don't allow combining disable_shuffle with a defined shuffle >1 (maybe set the default to unset?)
  • Also allow floats, as for repetitions
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant