2 ms·Reducing FLOPs for transformers1 points by danielhanchen 3y agodanielhanchen 3y agoI provide a full breakdown of our speedups, and share 59 reproducible notebooks. CodeLlama 34b does not OOM on 1 A100 now!