HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

OpenMath2-Llama3.1-70B

nvidia/OpenMath2-Llama3.1-70B

kind
original
quant
bf16 (16-bit)
family
llama
modality
text-generation
root model
meta-llama/Llama-3.1-70B
provider
nvidia
license
llama3.1
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
86
likes
22
created
—
last modified
2024-11-25T20:12:03+00:00 (2024)
huggingface
https://huggingface.co/nvidia/OpenMath2-Llama3.1-70B
tags
transformerssafetensorsllamatext-generationnvidiamathconversationalendataset:nvidia/OpenMathInstruct-2arxiv:2410.01560base_model:meta-llama/Llama-3.1-70Bbase_model:finetune:meta-llama/Llama-3.1-70Blicense:llama3.1text-generation-inferenceendpoints_compatibledeploy:azureregion:us

Benchmark scores (2)

benchmarkcategoryscorecontextconfevidence
GSM8Kmath84.5low| Llama3.1-8B-Instruct | 84.5 | 51.9 | 9/40 | 2/30 | 12.7 |
MATHmath51.9low| Llama3.1-8B-Instruct | 84.5 | 51.9 | 9/40 | 2/30 | 12.7 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.