HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

flan-ul2

google/flan-ul2

kind
original
quant
bf16 (16-bit)
family
misc
modality
—
root model
google/flan-ul2
provider
google
license
apache-2.0
language
en, fr, ro, de, multilingual
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
3,987
likes
562
created
—
last modified
2023-11-07T15:11:54+00:00 (2023)
huggingface
https://huggingface.co/google/flan-ul2
tags
transformerspytorcht5text2text-generationflan-ul2enfrrodemultilingualdataset:svakulenk0/qreccdataset:taskmaster2dataset:djaym7/wiki_dialogdataset:deepmind/code_contestsdataset:lambadadataset:gsm8kdataset:aqua_ratdataset:esnlidataset:quascdataset:qeddataset:c4arxiv:2205.05131license:apache-2.0text-generation-inference

Benchmark scores (2)

benchmarkcategoryscorecontextconfevidence
MMLUknowledge59.6MMLU-CoT | BBH-CoTlow| FLAN-PaLM 62B | 59.6 | 47.5 | 56.9 | 44.9 | 49.9 |
BBHreasoning47.5MMLU-CoT | BBH-CoTlow| FLAN-PaLM 62B | 59.6 | 47.5 | 56.9 | 44.9 | 49.9 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.