Open
Conversation
…nd NeoBERTLLMHead with code from model_language.py, need to be careful with output changes and configs
…ING pile preprocessed dataset
…t the batch level
…+ logs final correlation and word tables. Not sure the final correlation computation is super necessary as the ones during trainning are accurate enough
… my implementation of moe. It currently runs about 2x faster with similar accuracy
…eed to be converted to sweeps in the future
…ens, corrected double step counting, made accuracy top-2 based instead of top-p for hmoe
… some wandb CustomCharts objects introduces errors.Metrics are saved anyways by wandb locally
… received as conf the frequency at which test accuracy is measured and number of test samples on which it is performed
…our MoP NeoBERT and trackes routing cast
moved agent to main
Added metadata for the cleanup agent including name and description.
This file defines the specifications for the readability agent, outlining its mission, targets, rules, and policies for improving code readability and maintainability.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.