4 ms·
I want to add an argument: I hate gpt style of "as an ai model I can/can't" answers, any model distilled from that corpus becomes very hard to use for tasking.
by avereveard 4y ago
I want to add an argument:
I hate gpt style of "as an ai model I can/can't" answers, any model distilled from that corpus becomes very hard to use for tasking.
Like you may just want the category of a text, but all your equals now become contains. It eats up a lot of token space. It begins as a sentence so categories now are strongly biased toward sentence case and not your original input.
I know at least one model purposefully removing these utterances, but still. Everyone else is chasing the agent feel, and I'm here pulling my hair out because prosumer were this close to be able to access a proper AI for tasking and now it's slipping away.
- rvnx 4y agoEspecially, it's not that it can't give you an opinion, it totally can, but the authors at OpenAI don't want you to hear that specific opinion because of their political biases.
- pixl97 4y agoIn converse, the authors at OpenAI don't owe you a service that caters to your own political biases.
- ChatGTP 4y agoLol yet they enjoy a monopoly on the industry so there are no alternative world views as far as LLMs are concerned
- pixl97 4y agoThey do? Google doesn't have their own LLMs? Microsoft isn't running and training their own copies? Hell, if you have enough money you could run your own. This doesn't sound like a monopoly in any definition that I use (and I cast a very wide net with my use of monopoly).
- ChatGTP 4y agoName one company which has an product as popular as ChatGPT-4?
- dragonwriter 4y agoBy what measure of popularity?
- amanaplanacanal 4y agoI don’t have an opinion on whether chatgpt-4 is a monopoly, but I’m pretty sure popularity has nothing to do with whether something is a monopoly.
- laprise 4y agoyes exactly, this "as an ai model I can/can't" you're mentioning is precisely what is learned during the RLHF alignment phase.
- laprise 4y agoBtw, this kind of language is already all over the place: https://twitter.com/d_feldman/status/1649466422018318338 https://twitter.com/d_feldman/status/1649466422018318338 Which is hilarious and sad at the same time.
- avereveard 4y agoIt is a funny tweet but I cannot replicate the results.