HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

Voxtral-Mini-4B-Realtime-2602

mistralai/Voxtral-Mini-4B-Realtime-2602

kind
original
quant
bf16 (16-bit)
family
mistral
modality
automatic-speech-recognition
root model
mistralai/Ministral-3-3B-Base-2512
provider
mistralai
license
apache-2.0
language
en, fr, es, de, ru, zh, ja, it, pt, nl, ar, hi
context
—
library
vllm
vRAM (GB)
—
size on disk
—
downloads
2,129,296
likes
934
created
—
last modified
2026-03-11T15:04:02+00:00 (2026)
huggingface
https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-2602
tags
vllmsafetensorsvoxtral_realtimemistral-commonautomatic-speech-recognitionenfresderuzhjaitptnlarhikoarxiv:2602.11298base_model:mistralai/Ministral-3-3B-Base-2512base_model:finetune:mistralai/Ministral-3-3B-Base-2512license:apache-2.0eval-resultsregion:us

Benchmark scores (4)

benchmarkcategoryscorecontextconfevidence
WER AMIspeech-asr14.43GigaSpeech 2k Subset | GISpeech 2k Subsetlow| Voxtral Mini Transcribe 2.0 | Offline | 10.39% | 6.81% | 14.43% | 11.54% | 10.42% | 1.74% |
WER Switchboardspeech-asr11.54GigaSpeech 2k Subset | GISpeech 2k Subsetlow| Voxtral Mini Transcribe 2.0 | Offline | 10.39% | 6.81% | 14.43% | 11.54% | 10.42% | 1.74% |
WER GigaSpeechspeech-asr6.81GigaSpeech 2k Subset | GISpeech 2k Subsetlow| Voxtral Mini Transcribe 2.0 | Offline | 10.39% | 6.81% | 14.43% | 11.54% | 10.42% | 1.74% |
WER TED-LIUMspeech-asr2.86low| Voxtral Mini Transcribe 2.0 | Offline | 4.08% | 9.81% | 11.69% | 2.86% |

Discussions (48)

titleauthorstatuscommentstype
[audio.cpp] C++/GGML based Voxtral Mini 4B Realtime impl. 16.39x (0.0610 RTF) realtime offline, 170ms TTFT streaming on RTX 5090audio-cppopen0disc
Unable to reproduce benchmarksabhinavkulkarniopen0disc
Feature request: distilled per-language "Voxtral Micro" models for edge/on-device use ContextMaxOnAMissionopen0disc
Add localvoxtral (macOS dictation app) to Community ContributionsT0mSIlveropen0disc
What is the expected ratio of GPU memory and KV cache tokens for this model?h01-10wopen0disc
Training dataset sizeojoopen0disc
Streaming output before sending all audiojxadroclosed0disc
Telephony ASRdeeksha5open0disc
model support per CrispASR — pure C++ inference with GGUF quantisationcstropen0disc
timestampSh1manopen0disc
vllm crashing on 0.19.0evilperson068open0disc
Add Open ASR Leaderboard evaluation resultsSaylorTwiftopen0disc
Questions about training techniquesfunnyiceopen0disc
Voxtral Transformers path: chat template fails ("Can't compile non template nodes") and fallback output is garbledPierrunoYTopen0disc
Fix tekken.json link in README.mdwilson92merged0disc
Upload top_20_wavs.zipaustinv5040open0disc
Recommendationsliuyt6515open0disc
سلامnoor18298open0disc
Dont forget to do "audio.resample(processor.feature_extractor.sampling_rate)" if adapt streaming example to your needstrevolopen0disc
AttributeError when using tf v5P1atinumclosed0disc
punctuation marksliuyt6515open0disc
i want to adapt this model for low resource african language for that i have collected the datateeofftechnologiesopen0disc
Update README.mdsanchit-gandhimerged0disc
Optimize GPU KV cache memory usageoleslavclosed0disc
Can you train indic (indian) set of languages?trysemopen0disc
trfms-integrationeustlbmerged0disc
How to add another language ?TheRealTancredeopen0disc
Voxtral Mini Realtime deciding to translate on its own ?TheRealTancredeclosed0disc
Update README.mdsanchit-gandhimerged0disc
Hints for languageoleslavclosed0disc
do not need config.json ?Xiakjopen0disc
[Transformers Integration] Understanding Voxtral Realtime architecture for portingSeungyounopen0disc
Code 101101ifynachclosed0disc
AssertionError: rope can only used in combination with a sliding windowandres-llmsopen0disc
Running on vLLM 0.15.x + Blackwell CUDA 13avblexopen0disc
diarization support?evewashereopen0disc
[README.md] Specify multiples of frame-ratesanchit-gandhimerged0disc
Reducing time-to-first-token below 1s for conversational use?jloganolsonopen0disc
How to make sure transcription_delay_ms is changed when serving with vLLM?goncalomcorreiaopen0disc
Error when running on AMD with Dockerwetchocopen0disc
Demo BrokenDaBrown95closed0disc
Add automatic speech recognition tagnielsrmerged0disc
fix vllm parameter's namesebag90merged0disc
Problem with super long audiomrigankropen0disc
vLLM's blog on streaming input linkjloganolsonclosed0disc
Installation Video and Testing - Step by Stepfahdmirzacopen0disc
No transcription_delay param in either tekken or paramsmrigankropen0disc
Update README.mdiliasslasrimerged0disc
Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.