HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks
Home/Orgs/microsoft/microsoft/bitnet-b1.58-2B-4T-bf16

microsoft/bitnet-b1.58-2B-4T-bf16

family misc · 2 variants · unknown

provider
microsoft
released
—
huggingface
https://huggingface.co/microsoft/bitnet-b1.58-2B-4T-bf16
best scores
ARC-Challenge: 37.8OpenBookQA: 34.8BoolQ: 64.65HellaSwag: 60.8PIQA: 74.21WinoGrande: 59.51CommonsenseQA: 58.48TruthfulQA: 43.8TriviaQA: 37.6MMLU: 45.58HumanEval: 31.1GSM8K: 38.21MATH-500: 23.0IFEval: 62.71MT-Bench: 5.43

Best scores per benchmark

benchmarkcategorybest score
PIQAknowledge74.21
BoolQknowledge64.65
IFEvalinstruction-following62.71
HellaSwagknowledge60.8
WinoGrandeknowledge59.51
CommonsenseQAknowledge58.48
MMLUknowledge45.58
TruthfulQAsafety43.8
GSM8Kmath38.21
ARC-Challengeknowledge37.8
TriviaQAknowledge37.6
OpenBookQAknowledge34.8
HumanEvalcoding31.1
MATH-500math23.0
MT-Benchchat5.43

Variants (2)

variantkindquantbitsvRAMdlorgyear
bitnet-b1.58-2B-4T-ggufggufgguf26,220microsoft2025
bitnet-b1.58-2B-4T-bf16originalbf1616.07,963microsoft2025
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.