CAT 
Finding the right trade-off between memory efficiency, accuracy, and speed
Originally appeared here:
Fine-Tuning LLMs with 32-bit, 8-bit, and Paged AdamW Optimizers
Go Here to Read this Fast! Fine-Tuning LLMs with 32-bit, 8-bit, and Paged AdamW Optimizers
