|
1 | 1 | # Model Card: MOOZY |
2 | 2 |
|
| 3 | +**Paper:** [arXiv:2603.27048](https://arxiv.org/abs/2603.27048) |
| 4 | + |
3 | 5 | ## Model Description |
4 | 6 |
|
5 | 7 | MOOZY is a patient-first foundation model for computational pathology. It produces 768-dimensional embeddings at the slide and case (patient) level from whole-slide image feature grids. |
@@ -31,24 +33,7 @@ Anatomical sites: adrenal gland, bladder, brain, breast, cervix, colon/rectum, e |
31 | 33 | ## Training Procedure |
32 | 34 |
|
33 | 35 | - **Stage 1**: 200 epochs (14,400 steps, ~436 GPU-hours on 8 GPUs). Effective batch size 1,024. AdamW with cosine LR schedule. EMA teacher with cosine momentum (0.996 to 1.0). Multi-crop: 2 global (20x20) + 4 local (12x12) with block masking (ratio 0.1-0.5). |
34 | | -- **Stage 2**: 12 epochs (600 steps, ~307 GPU-hours on 8 GPUs). Effective batch size 1,024. AdamW with base LR 5e-5, cosine schedule, gradient clipping at 0.3. Classification: cross-entropy with label smoothing (0.03) and inverse-frequency weighting. Survival: discrete-time hazard NLL with adaptive binning. |
35 | | - |
36 | | -## Evaluation |
37 | | - |
38 | | -Evaluated on 8 held-out tasks with 5-fold frozen-feature MLP probe, patient-level fold grouping. All evaluation tasks were excluded from training. |
39 | | - |
40 | | -| Task | Dataset | Weighted F1 | Weighted ROC-AUC | Balanced Accuracy | |
41 | | -|------|---------|-------------|------------------|-------------------| |
42 | | -| Residual Cancer Burden | BC Therapy | 0.56 | 0.74 | 0.51 | |
43 | | -| TP53 Mutation | CPTAC-BRCA | 0.87 | 0.86 | 0.86 | |
44 | | -| BAP1 Mutation | CPTAC-CCRCC | 0.89 | 0.79 | 0.78 | |
45 | | -| ACVR2A Mutation | CPTAC-COAD | 0.91 | 0.91 | 0.90 | |
46 | | -| Histologic Grade | CPTAC-LSCC | 0.78 | 0.75 | 0.77 | |
47 | | -| KRAS Mutation | CPTAC-LUAD | 0.85 | 0.80 | 0.79 | |
48 | | -| IDH Status | EBRAINS | 0.97 | 0.99 | 0.97 | |
49 | | -| Treatment Response | MBC | 0.58 | 0.68 | 0.48 | |
50 | | - |
51 | | -Macro-average improvements over TITAN: +7.37% F1, +5.50% AUC, +7.83% balanced accuracy. Over PRISM: +8.83% F1, +10.70% AUC, +9.78% balanced accuracy. |
| 36 | +- **Stage 2**: 20 epochs (1,000 steps, ~512 GPU-hours on 8 GPUs). Effective batch size 1,024 cases (micro batch 1, 128 accumulation steps). AdamW with base LR 5e-5, cosine schedule, gradient clipping at 0.3. Classification: cross-entropy with label smoothing (0.03) and inverse-frequency weighting. Survival: discrete-time hazard NLL with adaptive binning. |
52 | 37 |
|
53 | 38 | ## Intended Use |
54 | 39 |
|
|
0 commit comments