alpindale

quantizer · 38 variants · 5 roots

huggingface: https://huggingface.co/alpindale

Root models (5)

root	family	variants
alpindale/Mistral-7B-v0.2-hf	mistral	5
alpindale/goliath-120b	misc	3
alpindale/magnum-72b-v1	misc	1
alpindale/Qwen2.5-0.2B	qwen	1
alpindale/Mistral-7B-v0.2	mistral	1

Top variants (38)

variant	kind	quant	dl	root
Llama-Guard-3-1B	original	bf16	15,862	meta-llama/Llama-Guard-3-1B
WizardLM-2-8x22B	original	bf16	9,618	—
c4ai-command-r-plus-GPTQ	gptq	gptq	4,236	—
Qwen2.5-0.2B	original	bf16	948	alpindale/Qwen2.5-0.2B
Llama-3.2-11B-Vision-Instruct	original	bf16	542	meta-llama/Llama-3.2-11B-Vision-Instruct
Llama-3.2-1B-Instruct	original	bf16	461	meta-llama/Llama-3.2-1B-Instruct
gemma-7b	original	bf16	350	google/gemma-7b-it-quant-pytorch
goliath-120b	merge	merge	336	alpindale/goliath-120b
gemma-2b	original	bf16	277	google/gemma-2b-it-pytorch
dbrx-instruct	original	bf16	232	—
Llama-3.2-1B	original	bf16	168	meta-llama/Llama-3.2-1B-Instruct
landmark-33b	original	bf16	98	—
Llama-3.2-3B-Instruct	original	bf16	75	meta-llama/Llama-3.2-3B-Instruct
gemma-7b-it	original	bf16	68	google/gemma-7b-it-quant-pytorch
Mistral-Large-Instruct-2411-FP8	fp8	fp8	58	mistralai/Mistral-Large-Instruct-2411
Llama-3.2-3B	original	bf16	51	meta-llama/Llama-3.2-3B-Instruct
miquella-120b-gguf	gguf	gguf	39	—
GLM-4.6-FP4	original	bf16	30	zai-org/GLM-4.6
miqu-1-70b-pytorch	original	bf16	27	—
miquella-120b	merge	merge	25	—
Llama-3.2-11B-Vision	original	bf16	20	meta-llama/Llama-3.2-11B-Vision-Instruct
Llama-3.2-90B-Vision-Instruct	original	bf16	19	meta-llama/Llama-3.2-90B-Vision-Instruct
GLM-4.6-INT8	original	bf16	18	zai-org/GLM-4.6
Trinity-Nano-Preview-exl3-4.0bpw	exl3	exl3	15	arcee-ai/Trinity-Nano-Preview
Mistral-Large-Instruct-2407-FP8	fp8	fp8	13	mistralai/Mistral-Large-Instruct-2407
goliath-120b-gguf	gguf	gguf	12	alpindale/goliath-120b
pygmalion-instruct	original	bf16	7	—
Kuwutu-7B-INT8	original	bf16	6	Mawdistical/Kuwutu-7B
Plesio-70B-W8A8-INT8	original	bf16	5	—
Ling-mini-2.0-NVFP4	nvfp4	nvfp4	5	inclusionAI/Ling-mini-2.0
Plesio-70B-FP8-Dynamic	fp8	fp8	4	Delta-Vector/Plesio-70B
Plesio-70B-NVFP4	nvfp4	nvfp4	3	Delta-Vector/Plesio-70B
GLM-4.6-ScatterMoE	original	bf16	2	—
L3.3-GeneticLemonade-Opus-70B-FP8-Dynamic	fp8	fp8	1	zerofata/L3.3-GeneticLemonade-Opus-70B
pygmalion-6b-ggml	original	bf16	0	—
Llama-2-7b-ONNX	original	bf16	0	—
Llama-2-13b-ONNX	original	bf16	0	—
magnum-v2-12b-FP8-W8A8KV8	fp8	fp8	0	—