3 ms·
> The backlash can't be worse than creating crippled products that will be surpassed by competitors Of course it can. Like 50% of efforts in safety are to stop
by michaelt 3y ago
> The backlash can't be worse than creating crippled products that will be surpassed by competitors
Of course it can. Like 50% of efforts in safety are to stop the model outputting popular lies, oft-repeated software bugs and slanderous hallucinated falsehoods.
If Mistral puts out a model it's only downloaded by enthusiasts who understand its limitations, and doesn't get a load of scrutiny from journalists in the way Apple and Google products do. If sometimes it falsely claims Richard Stallman was arrested for lassoing a police officer - Mistral won't see any blowback from that.
On the other hand, if Google released that model, and pushed it hard in search and whatnot, so search results started including such false claims - that's going to get a lot more notice.
- haolez 3y agoSo what? The user must be responsible in the model's usage, or else some law will apply. The company is not liable for misuse. And for things like "repeating bugs", maybe the model won't do that anymore if we focus on making it more capable and smart? I believe OpenAI stated that the guard rails in GPT-4 made the "sparks of AGI" phenomenon disappear. That's just bizarre reasoning for these companies, in my opinion.