Add XSignal zero-shot baseline - #112
Open
Billwanttobetop wants to merge 1 commit into
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds XSignal, a zero-shot evidence-integration baseline for ProteinGym substitution assays. XSignal derives 14 mutation-scoring channels from ProteinGym MSAs, MSA weights, precomputed AlphaFold2 structures, and fixed amino-acid physicochemical descriptors. Each channel is transformed to assay-wise percentile ranks and the final score is an equal-weight average.
The final scorer reads only variant-key columns from DMS assay CSVs (
mutant,mutated_sequence). It does not read DMS labels, binary labels, supervised folds, public baseline score packages, or official merged-score files during final scoring. XSignal uses no pretrained protein language model weights; it does use precomputed AlphaFold2 structures and ten self-generated intermediate evidence score directories.Score Package
Audited release: https://github.com/Billwanttobetop/ProteinGym/releases/tag/xsignal-proteingym-scores-20260723-audited
Score asset:
XSignal_scores_substitutions_20260723.zipmutant,mutated_sequence,XSignal_score0e3c9fa348d83b60e23ee3f57a7c1d517ea1109cc277556bdc8598762538b367Evaluation
Official ProteinGym wrapper metrics on the full substitution benchmark:
A full final-fusion reproduction regenerated 217 assay score files / 2,465,767 variants from the archived upstream XSignal sensor outputs plus ProteinGym MSA weights and AF2 structures, matching the frozen internal candidate
PureGraphGEContactPair_v1withmax_abs_diff = 0.0. The release also includes a compact audit/provenance bundle.Scope Boundary
This submission is for the frozen XSignal substitution score package only. Public RefSeq MSA expansion experiments and private/non-public datasets are not included.