3 ms·
OpenAI/ScaleAI are basically trying to brute force AI by using massive fleets of human data labelers/writers to try and provide as much varied training data as
by dinobones 3y ago
OpenAI/ScaleAI are basically trying to brute force AI by using massive fleets of human data labelers/writers to try and provide as much varied training data as possible. Will it work? Maybe, maybe not.
All I know is, they’ve shown impressive improvements year over year on cognition and generalization, and I have no reason to believe it’ll stop happening.
- justrealist 3y agoThat's a highly inaccurate summary of what OpenAI and unsupervised LLMs do. Yes there's human feedback at the end, but that's not to make it smarter or generalize facts better, it's so the AI isn't a genocidal dick. It's not about "labeling" correct facts for training.
- saltcured 3y agoAt risk of over-generalizing, the way you phrased this reminded me of the prior knowledgebase grand projects like Cyc. As a fence-sitting skeptic, I sometimes wonder if all "solve it with scale" projects are just using different syntax to reproduce an analogue of the experiment we're continuously executing as a whole civilization. Can our joint artifacts and social systems understand something more than we do? Can they exhibit any emergent rationality that exceeds the participants? Or are all these systems fundamentally a chaotic and contradictory mix? Is the understanding and rationality always an illusion, only coherent in localized extracts? Does it always need us (the homunculi) to monitor and steer it, fundamentally limited by the understanding of our best individual minds?