Add TabPFN3-ESMC600M supervised DMS baseline - #108
Open
someguysomewhereoverthere wants to merge 4 commits into
Open
Add TabPFN3-ESMC600M supervised DMS baseline#108someguysomewhereoverthere wants to merge 4 commits into
someguysomewhereoverthere wants to merge 4 commits into
Conversation
Author
|
Updated this submission from the preliminary TabPFN3 entry to TabPFN3-ESMC600M. The new score archive is complete for 217 supervised substitution assays across fold_random_5, fold_modulo_5, and fold_contiguous_5, with 651/651 score files and zero validation issues. The display name and score location are now TabPFN3-ESMC600M / tabpfn3_esmc600m. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds the
TabPFN3-ESMC600Msupervised DMS substitution baseline.The baseline uses TabPFN3 as the supervised tabular regressor with precomputed ESMC600M-derived protein features. It adds:
proteingym/baselines/tabpfn3_esmc600m/scripts/scoring_DMS_supervised/scoring_TabPFN3_ESMC600M_substitutions.shconfig.jsonproteingym/constants.jsonAssociated
new modelissue:The PR does not include raw ProteinGym data, derived feature matrices, model checkpoints, or generated score archives. Feature matrices are hosted on Zenodo, and TabPFN3 weights are obtained through the official Prior Labs / TabPFN license-acceptance flow.
Reference
Reproduction
One-assay scoring:
Full reproduction instructions and validation metadata are provided in the linked new-model issue.
External Artifacts
Feature artifact:
Complete model scores for all submitted mutants:
Score archive layout:
Each score CSV contains:
Validation
The submitted
TabPFN3-ESMC600Mscore package was validated as: