2 ms·
> but I think logarithms are probably another computation that's too difficult to learn without additional hints for intermediate steps. I suppose you're proba
by mikkupikku 1y ago
> but I think logarithms are probably another computation that's too difficult to learn without additional hints for intermediate steps.
I suppose you're probably right, but LLMs probably have a lot of log tables in their training data so I'm not so sure.
- yorwba 1y agoThe paper is about the ability of transformers to learn a task based on training data for that task only, not about LLMs pretrained on much of the internet. And training on log tables doesn't necessarily allow the model to always output the correct logarithm, just as training on multiplication tables doesn't necessarily confer the ability to multiply.