There’s actually a lower bound for integer ops: https://twitter.com/DavidVorick/status/1719097248699879831 https://twitter.com/DavidVorick/status/1719097248699

There’s actually a lower bound for integer ops: https://twitter.com/DavidVorick/status/1719097248699879831 https://twitter.com/DavidVorick/status/1719097248699879831 > (i) any model that was trained using a quantity of computing pow greater than 10^26 integer or floating-point operations, or using primarily biological sequence data and using a quantity of computing power greater than 10^23 integer or floating-point operations;