google/medgemma-27b-it
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| MMLU | knowledge | 67.2 | MMLU Med | medium | | MMLU Med | 67.2 | 70.0 | 83.3 | 87.0 | 86.2 | |
| MedQA | domain | 50.7 | MedQA (4-op) | medium | | MedQA (4-op) | 50.7 | 64.4 | 74.9 | 89.8 (best-of-5) 87.7 (0-shot) | 87.0 (best-of-5) 85.3 (0-shot) | |
none scraped.