CAT 
A better and faster option than the ADAM optimizer, from Apple Research
Originally appeared here:
AdEMAMix: A Deep Dive into a New Optimizer for Your Deep Neural Network
Go Here to Read this Fast! AdEMAMix: A Deep Dive into a New Optimizer for Your Deep Neural Network
