2 ms·
This makes sense. There’s also a huge corpus of text (training data) available on internet for the inherently repetitive or general tasks which is helpful for t
by geraneum 4y ago
This makes sense. There’s also a huge corpus of text (training data) available on internet for the inherently repetitive or general tasks which is helpful for this systems.
But I wonder how do they go from this to mathematics using the same line of reasoning while we’ve seen that math is not LLMs’ strong suit.
- coldtea 4y agoAlso thing about the huge corpus of text not available on the internet, but available to these systems (just because e.g. Microsoft has it, so can get data, perhaps anonymized from private GitHub repos, Copilot, telemetry from WSL, VSCode, and Azure, and so on).