HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Phi-3.5-MoE-instruct

microsoft/Phi-3.5-MoE-instruct

kind
original
quant
bf16 (16-bit)
family
phi
modality
text-generation
root model
microsoft/Phi-3.5-MoE-instruct
provider
microsoft
license
mit
language
multilingual
context
,
library
transformers
vRAM (GB)
—
size on disk
—
downloads
158,987
likes
574
created
—
last modified
2025-12-10T20:23:23+00:00 (2025)
huggingface
https://huggingface.co/microsoft/Phi-3.5-MoE-instruct
tags
transformerssafetensorsphimoetext-generationnlpcodeconversationalcustom_codemultilingualarxiv:2404.14219arxiv:2407.13833arxiv:2403.06412license:mitregion:us

Benchmark scores (5)

benchmarkcategoryscorecontextconfevidence
MATHmath88.7Mathmedium| Math | GSM8K (8-shot, CoT) | 88.7 | 84.2 | 82.4 | 84.9 | 82.4 | 91.3 |
MMLUknowledge69.9Multilingual MMLUmedium| Multilingual MMLU | 69.9 | 58.9 | 56.2 | 63.8 | 77.2 | 72.9 |
TydiQAknowledge67.1MEGA TyDi QAmedium| MEGA TyDi QA | 67.1 | 63.7 | 54.5 | 65.6 | 63.6 | 81.8 |
MGSMmath58.7MGSMmedium| MGSM | 58.7 | 63.3 | 56.7 | 75.1 | 75.8 | 81.7 |
MMLU-Proknowledge45.3Multilingual MMLU-Promedium| Multilingual MMLU-Pro | 45.3 | 34.0 | 21.4 | 43.0 | 57.9 | 53.2 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.