HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Ling-lite

inclusionAI/Ling-lite

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
inclusionAI/Ling-lite
provider
inclusionAI
license
mit
language
—
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
1,085
likes
81
created
—
last modified
2025-05-08T12:31:01+00:00 (2025)
huggingface
https://huggingface.co/inclusionAI/Ling-lite
tags
transformerssafetensorsbailing_moetext-generationconversationalcustom_codearxiv:2503.05139license:mitregion:us

Benchmark scores (9)

benchmarkcategoryscorecontextconfevidence
HumanEvalcoding89.02HumanEval(Pass@1)medium| HumanEval(Pass@1) | 0 | 89.02 | 83.54 | 87.20 | 70.73 |
IFEvalinstruction-following81.09IFEval(Prompt Strict)medium| IFEval(Prompt Strict) | 0 | 81.09 | 77.99 | 71.16 | 53.45 |
MATHmath79.12Math(EM)medium| Math(EM) | 0 | 79.12 | 72.80 | 73.66 | 52.42 |
MMLUknowledge74.87MMLU(EM)medium| MMLU(EM) | 5 | 74.87 | 71.27 | 74.26 | 68.67 |
BBHreasoning74.58BBH(EM)medium| BBH(EM) | 0 | 74.58 | 66.38 | 66.07 | 68.05 |
GPQAreasoning40.91GPQA(Pass@1)medium| GPQA(Pass@1) | 0 | 40.91 | 28.66 | 34.47 | 32.80 |
Math Olympiadmath37.33OlympiadBench(pass@1)medium| OlympiadBench(pass@1) | 0 | 37.33 | 34.42 | 37.19 | 16.3 |
LiveCodeBenchcoding24.11LiveCodeBench 2408-2411 (Pass@1)medium| LiveCodeBench 2408-2411 (Pass@1) | 0 | 24.11 | 15.18 | 16.96 | 11.61 |
AIME 2024math13.33AIME2024(pass@1)medium| AIME2024(pass@1) | 0 | 13.33 | 6.67 | 16.67 | 0.00 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.