HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Devstral-Small-2507

mistralai/Devstral-Small-2507

kind
original
quant
bf16 (16-bit)
family
mistral
modality
—
root model
mistralai/Mistral-Small-3.1-24B-Instruct-2503
provider
mistralai
license
apache-2.0
language
en, fr, de, es, pt, it, ja, ko, ru, zh, ar, fa
context
—
library
mistral-common
vRAM (GB)
—
size on disk
—
downloads
87,172
likes
368
created
—
last modified
2025-08-18T08:14:29+00:00 (2025)
huggingface
https://huggingface.co/mistralai/Devstral-Small-2507
tags
mistral-commonsafetensorsmistralvllmenfrdeesptitjakoruzharfaidmsneplrosrsvtr

Benchmark scores (2)

benchmarkcategoryscorecontextconfevidence
SWE-bench Verifiedswe53.6low| Devstral Small 1.1 | OpenHands Scaffold | **53.6** |
DeepSWEswe42.2DeepSWEmedium| DeepSWE | R2E-Gym Scaffold | 42.2 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.