Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some vmap and HPO related features and bug fixes #226

Merged
merged 6 commits into from
Mar 24, 2025
Merged

Conversation

sses7757
Copy link
Collaborator

Description

  1. Fix a bug in BraxProblem that causes vmapped BraxProblem produces wrong graph in compilation.
  2. Add num_repeats support in HPO to effectively use vmap to repeat the evaluation process for each instance.
  3. Add max_vmap_level support in register_vmap_op to automatically register more levels of vmapped operator.
  4. Set the maximum vmap support level of non_dominate_rank to 2 to support the num_repeats in HPO.
  5. Add test cases for HPO num_repeats and Brax with HPO.

To Discuss

  • Please check whether a final_step method should be added to the algorithm and workflow since some of the evolutionary algorithms have special treatment at their last steps.

Checklist

  • I have formatted my Python code with ruff.
  • I have good commit messages.
  • If adding new algorithms, problems, operators:
    • Added related test cases.
    • Added docstring to explain important parameters.
    • Added entries in the docs.

Add num_repeats to HPOProblemWrapper, support multiple levels of vmap in register_vmap_op, and fix a bug in BraxProblem
@sses7757 sses7757 requested a review from BillHuang2001 March 22, 2025 06:02
@BillHuang2001 BillHuang2001 marked this pull request as ready for review March 24, 2025 09:49
@BillHuang2001 BillHuang2001 merged commit 55ff483 into main Mar 24, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants