CAT 
Llama 2 vs. Llama 3 vs. Mistral 7B, quantized with GPTQ and Bitsandbytes
Originally appeared here:
Quantize Llama 3 8B with Bitsandbytes to Preserve Its Accuracy
Go Here to Read this Fast! Quantize Llama 3 8B with Bitsandbytes to Preserve Its Accuracy
