HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

internlm2-chat-1_8b

internlm/internlm2-chat-1_8b

kind
original
quant
bf16 (16-bit)
family
internlm
modality
text-generation
root model
internlm/internlm2-chat-1_8b
provider
internlm
license
other
language
—
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
5,792
likes
36
created
—
last modified
2025-03-13T07:04:51+00:00 (2025)
huggingface
https://huggingface.co/internlm/internlm2-chat-1_8b
tags
transformerssafetensorsinternlm2text-generationconversationalcustom_codearxiv:2403.17297license:otherregion:us

Benchmark scores (7)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge46.9MMLUmedium| MMLU | 46.9 | 47.1 | 65.8 | 63.7 |
BBHreasoning37.5BBHmedium| BBH | 37.5 | 35.2 | 65.0 | 61.2 |
AGIEvalreasoning33.4AGIEvalmedium| AGIEval | 33.4 | 38.8 | 49.9 | 47.2 |
GSM8Kmath31.2GSM8Kmedium| GSM8K | 31.2 | 39.7 | 70.8 | 70.7 |
HumanEvalcoding25.0HumanEvalmedium| HumanEval | 25.0 | 32.9 | 43.3 | 59.8 |
MBPPcoding22.2MBPP(Sanitized)medium| MBPP(Sanitized) | 22.2 | 23.2 | 51.8 | 51.4 |
MATHmath5.6MATHmedium| MATH | 5.6 | 11.8 | 20.2 | 23.0 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.