AI on The Edge

Llama 3.1 70B Instruct Q4_K_M

70B params · 4-bit quant

9.1Score
Status
Local Ready
Params
70.00B
Quantization
Q4_K_M

Notes

Best overall open model