HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

internlm2-base-7b

internlm/internlm2-base-7b

kind
original
quant
bf16 (16-bit)
family
internlm
modality
text-generation
root model
internlm/internlm2-base-7b
provider
internlm
license
other
language
—
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
20,113
likes
10
created
—
last modified
2024-08-20T06:51:12+00:00 (2024)
huggingface
https://huggingface.co/internlm/internlm2-base-7b
tags
transformerspytorchinternlm2text-generationcustom_codearxiv:2403.17297license:otherregion:us

Benchmark scores (7)

benchmarkcategoryscorecontextconfevidence
GSM8Kmath70.8GSM8Kmedium| GSM8K | 70.8 | 70.7 | 76.1 | 79.6 | 78.2 | 91.4 |
MMLUknowledge65.8MMLUmedium| MMLU | 65.8 | 63.7 | 67.7 | 66.5 | 69.1 | 83.0 |
BBHreasoning65.0BBHmedium| BBH | 65.0 | 61.2 | 72.1 | 68.3 | 70.1 | 86.7 |
MBPPcoding51.8MBPP(Sanitized)medium| MBPP(Sanitized) | 51.8 | 51.4 | 63.0 | 65.8 | 78.9 | 79.0 |
AGIEvalreasoning49.9AGIEvalmedium| AGIEval | 49.9 | 47.2 | 53.0 | 50.3 | 39.9 | 55.1 |
HumanEvalcoding43.3HumanEvalmedium| HumanEval | 43.3 | 59.8 | 48.8 | 67.1 | 73.2 | 74.4 |
MATHmath20.2MATHmedium| MATH | 20.2 | 23.0 | 25.5 | 31.9 | 28.0 | 45.8 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.