HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

falcon-11B

tiiuae/falcon-11B

kind
original
quant
bf16 (16-bit)
family
falcon
modality
text-generation
root model
tiiuae/falcon-11B
provider
tiiuae
license
unknown
language
en, de, es, fr, it, nl, pl, pt, ro, cs
context
,
library
—
vRAM (GB)
—
size on disk
—
downloads
5,035
likes
219
created
—
last modified
2024-12-17T11:25:12+00:00 (2024)
huggingface
https://huggingface.co/tiiuae/falcon-11B
tags
transformerssafetensorsfalcontext-generationconversationalcustom_codeendeesfritnlplptrocsdataset:tiiuae/falcon-refinedwebarxiv:2407.14885arxiv:2005.14165arxiv:2104.09864arxiv:1911.02150arxiv:2307.08691arxiv:2311.16867license:unknown

Benchmark scores (8)

benchmarkcategoryscorecontextconfevidence
HellaSwagknowledge82.91HellaSwag-10shotsmedium| HellaSwag-10shots | 82.91 |
HellaSwagknowledge82.07Hellaswag-0shotmedium| Hellaswag-0shot | 82.07 |
WinoGrandeknowledge78.3Winogrande-5shotsmedium| Winogrande-5shots | 78.30 |
ARC-Challengeknowledge59.73ARC-Challenge-25shotsmedium| ARC-Challenge-25shots | 59.73 |
MMLUknowledge58.37MMLU-5shotsmedium| MMLU-5shots | 58.37 |
GSM8Kmath53.83GSM8k-5shotsmedium| GSM8k-5shots | 53.83 |
TruthfulQAsafety52.56TruthfulQA-0shotmedium| TruthfulQA-0shot | 52.56 |
ARC-Challengeknowledge50.17ARC-Challenge-0shotmedium| ARC-Challenge-0shot | 50.17 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.