All Models4 entries1✦Llama 3.1 70B Instruct Q4_K_M70B params · 4-bit quant9.1ScoreLocal Ready2QwenQwen2.5 32B Instruct Q4_K_M32B params · 4-bit quant8.6ScoreLocal Ready3MMixtral 8x22B Instruct Q4_K_M8x22B mixture · 4-bit quant8.3ScoreLocal Ready4◔DeepSeek R1 32B Q4_K_M32B params · 4-bit quant8.1ScoreLocal Ready