HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

MobileLLM-Pro

facebook/MobileLLM-Pro

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
facebook/MobileLLM-Pro-base
provider
facebook
license
fair-noncommercial-research-license
language
en
context
128k
library
transformers
vRAM (GB)
—
size on disk
—
downloads
132
likes
164
created
—
last modified
2025-11-11T17:15:23+00:00 (2025)
huggingface
https://huggingface.co/facebook/MobileLLM-Pro
tags
transformerssafetensorsllama4_texttext-generationfacebookmetapytorchconversationalcustom_codeenarxiv:2511.06719base_model:facebook/MobileLLM-Pro-basebase_model:finetune:facebook/MobileLLM-Pro-baselicense:fair-noncommercial-research-licenseregion:us

Benchmark scores (10)

benchmarkcategoryscorecontextconfevidence
PIQAknowledge76.55PIQAmedium| PIQA | **76.55%** | **76.66%** | **75.52%** | 73.80% | 75.14% |
BoolQknowledge76.24BoolQmedium| BoolQ | **76.24%** | **77.49%** | **76.36%** | 63.20% | 62.51% |
HellaSwagknowledge67.11HellaSwagmedium| HellaSwag | **67.11%** | 64.89% | 65.10% | 62.30% | 65.69% |
WinoGrandeknowledge62.83WinoGrandemedium| WinoGrande | **62.83%** | **62.43%** | **61.96%** | 58.20% | 61.09% |
IFEvalinstruction-following62.0IFEvalmedium| IFEval | 62.0% | **80.2%** | 59.5% |
HumanEvalcoding59.8HumanEvalmedium| HumanEval | **59.8%** | 41.5% | 37.8% |
MBPPcoding46.8MBPPmedium| MBPP | **46.8%** | 35.2% | 39.6% |
MMLUknowledge44.8MMLUmedium| MMLU | 44.8% | 29.9% | **49.3%** |
TriviaQAknowledge39.85TriviaQAmedium| TriviaQA | **39.85%** | 37.26% | 36.42% | 39.80% | 23.81% |
BFCL (function calling)agentic29.4BFCL v2medium| BFCL v2 | **29.4%** | | 25.7% |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.