HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Sky-T1-32B-Flash

NovaSky-AI/Sky-T1-32B-Flash

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
Qwen/Qwen2.5-32B-Instruct
provider
NovaSky-AI
license
apache-2.0
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
24
likes
67
created
—
last modified
2025-02-02T05:26:20+00:00 (2025)
huggingface
https://huggingface.co/NovaSky-AI/Sky-T1-32B-Flash
tags
transformerssafetensorsqwen2text-generationconversationalendataset:BAAI/TACOdataset:tasksource/PRM800Kbase_model:NovaSky-AI/Sky-T1-32B-Previewbase_model:finetune:NovaSky-AI/Sky-T1-32B-Previewlicense:apache-2.0text-generation-inferenceendpoints_compatibleregion:us

Benchmark scores (4)

benchmarkcategoryscorecontextconfevidence
MATH-500math88.6Math500medium| Math500 | Acc | 88.6 | 88.6 | 76.2 | 89.2 | 90.8 |
MMLUknowledge82.4MMLUmedium| MMLU | Acc | 82.4 | 81.7 | 80.1 | 85.2 | 82.1 |
GPQA Diamondreasoning56.8GPQA Diamondmedium| GPQA Diamond | Acc | 56.8 | 56.6 | 45.5 | 52.5 | 62.6 |
AIME 2024math43.3AIME24medium| AIME24 | Acc | 43.3 | 43.3 | 16.7 | 50 | 66.7 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.