Mungert/ZR1-1.5B-GGUF
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| MATH-500 | math | 88.34 | high | | ZR1-1.5B | 33.75% | 27.29% | 72.06% | 59.17% | **37.91%** | 88.34% | 33.52% | 56.87% | | |
| MATH | math | 62.0 | Qwen2.5-Math-7B-Instruct | medium | | Qwen2.5-Math-7B-Instruct | 62% | 45.83% | 16.67% | 4% | |
| MATH | math | 60.42 | high | | ZR1-1.5B | **74%** | 60.42% | **39.74%** | **12%** | | |
| MATH | math | 56.0 | Qwen2.5-Math-72B-Instruct | medium | | Qwen2.5-Math-72B-Instruct | 56% | 59.38% | 42.31% | 42% | |
| MATH | math | 49.0 | Qwen2.5-Math-1.5B-Instruct | medium | | Qwen2.5-Math-1.5B-Instruct | 49% | 36.46% | 0% | 0% | |
| GPQA | reasoning | 37.91 | high | | ZR1-1.5B | 33.75% | 27.29% | 72.06% | 59.17% | **37.91%** | 88.34% | 33.52% | 56.87% | | |
| MATH | math | 37.01 | Qwen-2.5-Math-7B-Instruct | medium | | Qwen-2.5-Math-7B-Instruct | 37.01% | 2048 | |
| AIME 2024 | math | 33.75 | high | | ZR1-1.5B | 33.75% | 27.29% | 72.06% | 59.17% | **37.91%** | 88.34% | 33.52% | 56.87% | | |
| MATH | math | 32.25 | Qwen-2.5-Math-1.5B-Instruct | medium | | Qwen-2.5-Math-1.5B-Instruct | 32.25% | 2048 | |
| AIME 2025 | math | 27.29 | high | | ZR1-1.5B | 33.75% | 27.29% | 72.06% | 59.17% | **37.91%** | 88.34% | 33.52% | 56.87% | | |
| MATH | math | 26.67 | Qwen2.5-Math-72B-Instruct (greedy) | medium | | Qwen2.5-Math-72B-Instruct (greedy) | 26.67% | 6.67% | 59.04% | 46.67% | 43.94% | 85.40% | 42.65% | 50.37% | |
| MATH | math | 20.0 | Qwen2.5-Math-7B-Instruct (greedy) | medium | | Qwen2.5-Math-7B-Instruct (greedy) | 20% | 3.33% | 46.99% | 31.11% | 32.32% | 83% | 37.13% | 42.22% | |
| MATH | math | 10.0 | Qwen2.5-Math-1.5B-Instruct (greedy) | medium | | Qwen2.5-Math-1.5B-Instruct (greedy) | 10% | 6.67% | 42.17% | 26.67% | 28.28% | 75.20% | 28.31% | 40.74% | |
none scraped.