3 ms·
I'd still expect an MLE to know it though.
by esafak 2y ago
I'd still expect an MLE to know it though.
- janalsncm 2y agoWhy would you? Implementing optimizers isn’t something that MLEs do. Even the Deepseek team just uses AdamW. An MLE should be able to look up and understand the differences between optimizers but memorizing that information is extremely low priority compared with other information they might be asked.