4 ms·
Right but that's kind of the point: there's no way forward which could benefit from "moar data". In fact it's weird we need so much data now - i.e. my son in le
by XorNot 2y ago
Right but that's kind of the point: there's no way forward which could benefit from "moar data". In fact it's weird we need so much data now - i.e. my son in learning to talk hardly needs to have read the complete works of Shakespeare.
If it's possible to produce intelligence from just ingesting text, then current tech companies have all the data they need from their initial scrapes of the internet. They don't need more. That's different to keeping models up to date on current affairs.
- throwaway4aday 2y agoThat's essentially what R1 Zero is showing: > Notably, it is the first open research to validate that reasoning capabilities of LLMs can be incentivized purely through RL, without the need for SFT.
- YetAnotherNick 2y agoO3 high compute requires 1000s of dollars to solve one medium complexity problem like ARC.
- artificialprint 2y agoLight bulbs used to be expensive too, nails as well.