HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

wavecoder-ultra-6.7b

microsoft/wavecoder-ultra-6.7b

kind
original
quant
bf16 (16-bit)
family
misc
modality
text-generation
root model
microsoft/wavecoder-ultra-6.7b
provider
microsoft
license
mit
language
en
context
—
library
transformers
vRAM (GB)
—
size on disk
—
downloads
229
likes
81
created
—
last modified
2024-05-06T13:25:54+00:00 (2024)
huggingface
https://huggingface.co/microsoft/wavecoder-ultra-6.7b
tags
transformerspytorchllamatext-generationcodeconversationalendataset:humanevalarxiv:2312.14187license:mittext-generation-inferenceendpoints_compatibleregion:us

Benchmark scores (2)

benchmarkcategoryscorecontextconfevidence
HumanEvalcoding85.4low| GPT-4 | 85.4 | - | 47.8 | 52.1 |
MBPPcoding63.0low| [🌊 WaveCoder-DS-6.7B](https://huggingface.co/microsoft/wavecoder-ds-6.7b) | 65.8 | 63.0 | 49.5 | 40.8 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.