inclusionAI/Ming-Lite-Omni-1.5
| benchmark | category | score | context | conf | evidence |
|---|---|---|---|---|---|
| OpenBookQA | knowledge | 65.93 | Average(Open-ended QA) | low | | Ming-lite-omni v1.5[omni] | 4.474(+0.134) | 4.648 | 4.3 | 61.16 | 45.77 | 65.934 | 55.599 | 98.076 | |
| IFEval | instruction-following | 55.6 | Average(Open-ended QA) | low | | Ming-lite-omni v1.5[omni] | 4.474(+0.134) | 4.648 | 4.3 | 61.16 | 45.77 | 65.934 | 55.599 | 98.076 | |
| WER VoxPopuli | speech-asr | 6.43 | Average on All/Open-source Benchmarks(↓) | high | | Ming-lite-omni-1.5 | 4.67(+0.15)/3.83(+0.05) | 1.3 | 2.47 | 2.46 | 5.66 | 2.87 | 6.19 | 5.24 | 1.25 | 2.61 | 4.14 | 6.95 | 3.28 | 6.43 | 2.81 | 6.96 | 12.74 | 3.7 | 3.8 | 9.95 | |
| AlpacaEval | chat | 4.65 | Average(Open-ended QA) | low | | Ming-lite-omni v1.5[omni] | 4.474(+0.134) | 4.648 | 4.3 | 61.16 | 45.77 | 65.934 | 55.599 | 98.076 | |
| WER LibriSpeech | speech-asr | 1.25 | Average on All/Open-source Benchmarks(↓) | high | | Ming-lite-omni-1.5 | 4.67(+0.15)/3.83(+0.05) | 1.3 | 2.47 | 2.46 | 5.66 | 2.87 | 6.19 | 5.24 | 1.25 | 2.61 | 4.14 | 6.95 | 3.28 | 6.43 | 2.81 | 6.96 | 12.74 | 3.7 | 3.8 | 9.95 | |
none scraped.