2 ms·
> The future is open sourced uncensored models, capitalism will demand the high performance. No. The future is ML built on more than just Wikipedia, Github cod
by mschuster91 3y ago
> The future is open sourced uncensored models, capitalism will demand the high performance.
No. The future is ML built on more than just Wikipedia, Github code and Reddit hot takes. Or, sarcasm aside, GIGO: garbage in, garbage out - when you don't take care what datasets you train any kind of model on, you're bound to get some surprises if something unexpected comes along. Be it the infamous "racist soap dispenser" or the Google (?) image classifier that made the rounds here just a day or two ago which had a safeguard because it kept confusing Black people with gorillas.
Preventing this kind of harmful content isn't censorship - it's after-the-fact compensation for bad training (and the tendency of 4chan and other trolls to use discriminatory content generation as a weapon, just remember what they did to Microsoft Tay).
That is where the money is: curated training datasets. Everyone and their dog can train a ML model from scratch, all you need is money and cloning a few more-or-less-broken Github repositories for that. But acquiring a high-quality dataset as a foundation? That costs real money to create.
- chasd00 3y agoi'm not in the AI world but i've been curious how the level of effort compares between inventing and writing the model vs finding, tagging, and curating the training. Is creating the training data analogous to inventing a complete schooling curriculum from scratch? I bet that takes a long freaking time.
- MacsHeadroom 3y agoMuch of GPT-4's training data was made by GPT-3.5. Info on the synthetic data in GPT-4's pretraining is starting to leak, including a reference to "Synthetic-Data(2)" in a recent OpenAI paper. In the near future, if not already, practically all training data for state of the art models will be synthetic. In the words of OpenAI CEO Sam Altman, they have "boostrapped" and are "past the synthetic data generation event horizon."
- fragmede 3y agoYes, so just like Apple's real value is from Foxconn's manufacturing factories which they don't own, OpenAI's real value is from Sama, the Kenyan firm that did the RLHF annotating. I'm wondering what the legal agreement is for Google Classrooms. In elementary schools across the world, kids write 3rd grade essays in history class or whatever and the teacher grades them. Those essays and grades are all in a database. Does Google have the opportunity to train Bard across that dataset?