HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

internlm-7b

internlm/internlm-7b

kind
original
quant
bf16 (16-bit)
family
internlm
modality
text-generation
root model
internlm/internlm-7b
provider
internlm
license
—
language
—
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
536
likes
96
created
—
last modified
2024-07-03T06:26:23+00:00 (2024)
huggingface
https://huggingface.co/internlm/internlm-7b
tags
transformerspytorchinternlmfeature-extractiontext-generationcustom_coderegion:us

Benchmark scores (7)

benchmarkcategoryscorecontextconfevidence
CommonsenseQAknowledge75.2CommonSenseQAmedium| CommonSenseQA | 75.2 | 59.5 | 65.0 | 58.8 | 60.0 | 68.7 | 66.7 |
C-Evalknowledge53.2C-Eval(Val)medium| C-Eval(Val) | 53.2 | 53.4 | 24.2 | 42.7 | 50.9 | 28.9 | 31.2 |
MMLUknowledge50.8MMLUmedium| MMLU | 50.8 | 51.0 | 35.2* | 41.5 | 46.0 | 39.7 | 47.3 |
AGIEvalreasoning42.5AGIEvalmedium| AGIEval | 42.5 | 37.6 | 20.8 | 24.6 | 39.0 | 24.1 | 26.4 |
GSM8Kmath34.5GSM8Kmedium| GSM8K | 34.5 | 31.2 | 10.1 | 9.7 | 29.2 | 6.0 | 15.3 |
HumanEvalcoding14.0HumanEvalmedium| HumanEval | 14.0 | 10.4 | 14.0 | 9.2 | 9.2 | 9.2 | 11.0 |
MATHmath6.4MATHmedium| MATH | 6.4 | 7.1 | 2.8 | 3.0 | 6.6 | 2.2 | 2.8 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.