HF Model & Benchmark Matrix

24,078 variants · 14,984 scores · 120 benchmarks

cogvlm2-llama3-chat-19B-int4

zai-org/cogvlm2-llama3-chat-19B-int4

kind
bnb-4bit
quant
4bit
family
llama
modality
text-generation
root model
zai-org/cogvlm2-llama3-chat-19B
provider
zai-org
license
other
language
en
context
—
library
—
vRAM (GB)
—
size on disk
—
downloads
93
likes
31
created
—
last modified
2024-05-24T09:43:10+00:00 (2024)
huggingface
https://huggingface.co/zai-org/cogvlm2-llama3-chat-19B-int4
tags
transformerspytorchtext-generationchatcogvlm2conversationalcustom_codeenarxiv:2311.03079license:other4-bitbitsandbytesregion:us

Benchmark scores (4)

benchmarkcategoryscorecontextconfevidence
DocVQAmultimodal78.2Open Sourcelow| LLaVA-NeXT-LLaMA3 | ✅ | 8B | - | 78.2 | 69.5 | - | 41.7 | - | 72.1 |
ChartQAmultimodal68.3Open Sourcelow| CogVLM1.1 | ✅ | 7B | 69.7 | - | 68.3 | 590 | 37.3 | 52.0 | 65.8 |
MMBenchmultimodal65.8Open Sourcelow| CogVLM1.1 | ✅ | 7B | 69.7 | - | 68.3 | 590 | 37.3 | 52.0 | 65.8 |
MMMUmultimodal37.3Open Sourcelow| CogVLM1.1 | ✅ | 7B | 69.7 | - | 68.3 | 590 | 37.3 | 52.0 | 65.8 |

Discussions (0)

none scraped.

Hugging Face model & benchmark data scraped & matrix-ified. 24,078 variants · 14,984 scores · 120 benchmarks.