ARC-Challenge

knowledge · arc · 98 scores

rank	variant	root	org	score	conf	context
1	NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-Base-BF16	nvidia	97.35	medium	ARC-Challenge
2	NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-Base-BF16	nvidia	96.08	medium	ARC-Challenge
3	NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16	nvidia	94.45	medium	ARC-Challenge (25-shot, acc_norm)
4	Nemotron-4-340B-Base	nvidia/Nemotron-4-340B-Base	nvidia	94.28	low
5	NVIDIA-Nemotron-Nano-9B-v2-Base	nvidia/NVIDIA-Nemotron-Nano-9B-v2-Base	nvidia	93.26	medium	ARC Challenge
6	NVIDIA-Nemotron-Nano-12B-v2-Base	nvidia/NVIDIA-Nemotron-Nano-12B-v2-Base	nvidia	93.26	medium	ARC Challenge
7	Nemotron-Labs-TwoTower-30B-A3B-Base-BF16	nvidia/Nemotron-Labs-TwoTower-30B-A3B-Base-BF16	nvidia	91.72	medium	ARC-Challenge (25-shot, acc_norm)
8	Phi-3-medium-4k-instruct	microsoft/Phi-3-medium-4k-instruct	microsoft	91.6	medium	ARC Challenge<br>10-shot
9	Phi-3-medium-128k-instruct	microsoft/Phi-3-medium-128k-instruct	microsoft	91.0	medium	ARC Challenge<br>10-shot
10	Phi-3-small-128k-instruct	microsoft/Phi-3-small-128k-instruct	microsoft	90.8	medium	ARC Challenge<br>10-shot
11	Phi-3-small-8k-instruct	microsoft/Phi-3-small-8k-instruct	microsoft	90.7	medium	ARC Challenge<br>10-shot
12	Phi-4-mini-instruct	microsoft/Phi-4-mini-instruct	microsoft	83.7	medium	ARC Challenge (10-shot)
13	Phi-4-mini-instruct-GGUF	microsoft/Phi-4-mini-instruct	unsloth	83.7	medium	ARC Challenge (10-shot)
14	Phi-4-mini-instruct-unsloth-bnb-4bit	microsoft/Phi-4-mini-instruct	unsloth	83.7	medium	ARC Challenge (10-shot)
15	Phi-4-mini-instruct-bnb-4bit	microsoft/Phi-4-mini-instruct	unsloth	83.7	medium	ARC Challenge (10-shot)
16	Phi-4-mini-instruct	microsoft/Phi-4-mini-instruct	unsloth	83.7	medium	ARC Challenge (10-shot)
17	Phi-4-mini-instruct-GGUF	microsoft/Phi-4-mini-instruct	Mungert	83.7	medium	ARC Challenge (10-shot)
18	model_007-70B-GGUF	psmathur/model_007	TheBloke	71.08	medium	_challenge
19	orca_mini_v3_70B-GGUF	psmathur/orca_mini_v3_70b	TheBloke	70.98	medium	_challenge
20	orca_mini_v3_70B-GPTQ	psmathur/orca_mini_v3_70b	TheBloke	70.98	medium	_challenge
21	Synthia-70B-v1.1-GGUF	migtissera/Synthia-70B-v1.1	TheBloke	70.05	medium	_challenge
22	go-bruins-v2-GGUF	rwitz/go-bruins-v2	TheBloke	69.8	low
23	Synthia-70B-GGUF	migtissera/Synthia-70B	TheBloke	69.45	medium	_challenge
24	go-bruins-GGUF	rwitz/go-bruins	TheBloke	69.11	low
25	NexoNimbus-7B-GGUF	abideen/NexoNimbus-7B	TheBloke	68.25	medium	_challenge
26	BruinsV2-OpHermesNeu-11B-GGUF	Ba2han/BruinsV2-OpHermesNeu-11B	TheBloke	65.27	medium	_challenge
27	bagel-dpo-7B-v0.1-GGUF	jondurbin/bagel-dpo-7b-v0.1	TheBloke	64.76	low
28	juanako-7B-UNA-GGUF	fblgit/juanako-7b-UNA	TheBloke	64.76	medium	_challenge
29	Marcoro14-7B-slerp	AIDC-ai-business/Marcoroni-7B-v3	mlabonne	63.91	medium	_challenge
30	orca_mini_v3_13B-GGUF	psmathur/orca_mini_v3_13b	TheBloke	63.14	medium	_challenge
31	orca_mini_v3_13B-GPTQ	psmathur/orca_mini_v3_13b	TheBloke	63.14	medium	_challenge
32	DPOpenHermes-7B-v2-GGUF	openaccess-ai-collective/DPOpenHermes-7B-v2	TheBloke	62.71	medium	_challenge
33	Beyonder-4x7B-v2-GGUF	mlabonne/Beyonder-4x7B-v2	TheBloke	61.86	medium	_challenge
34	Beyonder-4x7B-v2	mlabonne/Marcoro14-7B-slerp	mlabonne	61.86	medium	_challenge
35	orangetin-OpenHermes-Mixtral-8x7B-GGUF	orangetin/OpenHermes-Mixtral-8x7B	TheBloke	60.75	medium	_challenge
36	Fennec-Mixtral-8x7B-GGUF	orangetin/Fennec-Mixtral-8x7B	TheBloke	60.75	medium	_challenge
37	Nous-Hermes-2-Yi-34B-GGUF	NousResearch/Nous-Hermes-2-Yi-34B	TheBloke	60.67	medium	_challenge
38	Nous-Hermes-2-Yi-34B-AWQ	NousResearch/Nous-Hermes-2-Yi-34B	TheBloke	60.67	medium	_challenge
39	Synthia-13B-GGUF	migtissera/Synthia-13B	TheBloke	59.98	medium	_challenge
40	Nous-Hermes-2-Mixtral-8x7B-DPO-GGUF	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	TheBloke	59.9	medium	_challenge
41	Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ	NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO	TheBloke	59.9	medium	_challenge
42	falcon-11B	tiiuae/falcon-11B	tiiuae	59.73	medium	ARC-Challenge-25shots
43	Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF	NousResearch/Nous-Hermes-2-Mixtral-8x7B-SFT	TheBloke	59.04	medium	_challenge
44	DPOpenHermes-7B-GGUF	openaccess-ai-collective/DPOpenHermes-7B	TheBloke	58.62	medium	_challenge
45	NeuralHermes-2.5-Mistral-7B-laser	teknium/OpenHermes-2.5-Mistral-7B	mlabonne	57.76	medium	_challenge
46	Nous-Hermes-2-SOLAR-10.7B-GGUF	NousResearch/Nous-Hermes-2-SOLAR-10.7B	TheBloke	57.68	medium	_challenge
47	Nous-Hermes-Llama2-70B-GGUF	NousResearch/Nous-Hermes-Llama2-70b	TheBloke	57.34	medium	_challenge
48	orca_mini_v3_7B-GGUF	psmathur/orca_mini_v3_7b	TheBloke	57.17	medium	_challenge
49	orca_mini_v3_7B-GPTQ	psmathur/orca_mini_v3_7b	TheBloke	57.17	medium	_challenge
50	juanako-7B-v1-GGUF	fblgit/juanako-7b-v1	TheBloke	56.91	medium	_challenge
51	OpenHermes-2.5-Mistral-7B-AWQ	teknium/OpenHermes-2.5-Mistral-7B	TheBloke	56.23	medium	_challenge
52	OpenHermes-2.5-Mistral-7B-GGUF	teknium/OpenHermes-2.5-Mistral-7B	TheBloke	56.23	medium	_challenge
53	OpenHermes-2.5-Mistral-7B-16k-GGUF	NurtureAI/OpenHermes-2.5-Mistral-7B-16k	TheBloke	56.23	medium	_challenge
54	OpenHermes-2.5-Mistral-7B-GPTQ	teknium/OpenHermes-2.5-Mistral-7B	TheBloke	56.23	medium	_challenge
55	Tulpar-7B-v0-GGUF	HyperbeeAI/Tulpar-7b-v0	TheBloke	56.14	medium	_challenge
56	Mistral-11B-OmniMix-GGUF	NeverSleep/Mistral-11B-OmniMix-bf16	TheBloke	55.8	medium	_challenge
57	Luna-AI-Llama2-Uncensored-GGUF	Tap-M/Luna-AI-Llama2-Uncensored	TheBloke	55.12	medium	_challenge
58	Luna-AI-Llama2-Uncensored-GPTQ	Tap-M/Luna-AI-Llama2-Uncensored	TheBloke	55.12	medium	_challenge
59	OpenHermes-2-Mistral-7B-GGUF	teknium/OpenHermes-2-Mistral-7B	TheBloke	54.52	medium	_challenge
60	OpenHermes-2-Mistral-7B-AWQ	teknium/OpenHermes-2-Mistral-7B	TheBloke	54.52	medium	_challenge
61	Nemotron-H-4B-Base-8K	nvidia/Nemotron-H-4B-Base-8K	nvidia	54.4	low
62	Synthia-7B-v1.2-GGUF	migtissera/Synthia-7B-v1.2	TheBloke	54.35	medium	_challenge
63	CollectiveCognition-v1-Mistral-7B-GGUF	teknium/CollectiveCognition-v1-Mistral-7B	TheBloke	54.01	medium	_challenge
64	Trurl-2-13B-GGUF	Voicelab/trurl-2-13b	TheBloke	52.9	low
65	Trurl-2-7B-GGUF	Voicelab/trurl-2-7b	TheBloke	52.9	low
66	CollectiveCognition-v1.1-Mistral-7B-GGUF	teknium/CollectiveCognition-v1.1-Mistral-7B	TheBloke	50.85	medium	_challenge
67	orca_mini_v2_7B-GPTQ	—	TheBloke	50.77	medium	_challenge
68	falcon-11B	tiiuae/falcon-11B	tiiuae	50.17	medium	ARC-Challenge-0shot
69	Redmond-Puffin-13B-GGUF	NousResearch/Redmond-Puffin-13B	TheBloke	49.83	medium	_challenge
70	Redmond-Puffin-13B-GPTQ	NousResearch/Redmond-Puffin-13B	TheBloke	49.83	medium	_challenge
71	Nous-Hermes-13B-GGUF	NousResearch/Nous-Hermes-13b	TheBloke	49.15	medium	_challenge
72	Nous-Hermes-13B-SuperHOT-8K-fp16	—	TheBloke	49.15	medium	_challenge
73	Nous-Hermes-13B-SuperHOT-8K-GPTQ	—	TheBloke	49.15	medium	_challenge
74	minotaur-13B-fixed-GGUF	openaccess-ai-collective/minotaur-13b-fixed	TheBloke	47.78	medium	_challenge
75	OLMo-1B-hf	allenai/OLMo-1B-hf	allenai	44.5	medium	_challenge
76	OLMo-7B	allenai/OLMo-7B	allenai	44.5	medium	_challenge
77	OLMo-7B-hf	allenai/OLMo-7B-hf	allenai	44.5	medium	_challenge
78	OLMo-1B	allenai/OLMo-1B	allenai	44.5	medium	_challenge
79	OLMo-7B-Twin-2T-hf	allenai/OLMo-7B-Twin-2T-hf	allenai	44.5	medium	_challenge
80	OLMo-7B-Twin-2T	allenai/OLMo-7B-Twin-2T	allenai	44.5	medium	_challenge
81	nemo-megatron-gpt-5B	nvidia/nemo-megatron-gpt-5B	nvidia	39.76	low
82	bitnet-b1.58-2B-4T-gguf	microsoft/bitnet-b1.58-2B-4T-bf16	microsoft	37.8	medium	ARC-Challenge
83	bitnet-b1.58-2B-4T	microsoft/bitnet-b1.58-2B-4T	microsoft	37.8	medium	ARC-Challenge
84	bitnet-b1.58-2B-4T-bf16	microsoft/bitnet-b1.58-2B-4T-bf16	microsoft	37.8	medium	ARC-Challenge
85	Redmond-Hermes-Coder-GPTQ	—	TheBloke	28.58	medium	_challenge
86	MobileLLM-125M	facebook/MobileLLM-125M	facebook	25.2	low
87	Nemotron-H-8B-Base-8K	nvidia/Nemotron-H-8B-Base-8K	nvidia	25.0	medium
88	Nemotron-H-56B-Base-8K	nvidia/Nemotron-H-56B-Base-8K	nvidia	25.0	medium
89	OLMo-1B-0724-hf	allenai/OLMo-1B-0724-hf	allenai	25.0	medium	_challenge
90	OLMo-7B-0424-hf	allenai/OLMo-7B-0424-hf	allenai	25.0	medium	_challenge
91	OLMo-7B-0724-hf	allenai/OLMo-7B-0724-hf	allenai	25.0	medium	_challenge
92	LUNA-SOLARkrautLM-Instruct-GGUF	fblgit/LUNA-SOLARkrautLM-Instruct	TheBloke	25.0	medium	_challenge
93	UNA-TheBeagle-7B-v1-GGUF	fblgit/UNA-TheBeagle-7b-v1	TheBloke	25.0	medium	_challenge
94	UNA-ThePitbull-21.4B-v2-GGUF	—	bartowski	25.0	medium	_challenge
95	Nemotron-H-47B-Base-8K	nvidia/Nemotron-H-56B-Base-8K	nvidia	25.0	medium
96	UNAversal-8x7B-v1beta-GGUF	fblgit/UNAversal-8x7B-v1beta	TheBloke	25.0	medium	_challenge
97	OLMo-7B-0424	allenai/OLMo-7B-0424	allenai	25.0	medium	_challenge
98	Iambe-RP-v3-20B-GGUF	athirdpath/Iambe-RP-v3-20b	TheBloke	25.0	medium	_challenge