6 ms·
This one seems weirdly more verbose, in my brief testing. Definitely uses more tokens on average than 002 when answering. The writing style seems oddly-pretenti
by ctoth 4y ago
This one seems weirdly more verbose, in my brief testing.
Definitely uses more tokens on average than 002 when answering.
The writing style seems oddly-pretentious and yet somehow uninformed, perhaps there were too many copies of HN in the dataset?
I kid, I kid.
- obert 4y agohave you tried tweaking the behavior, e.g. asking not to guess, to be brief, providing examples, constraining output with syntactic sugar, etc? e.g. it's like talking to a person, give feedback and you might get better result.
- extr 4y agoBrilliant business move. Charge by the token, and then train the model to ramble! Pretty soon you'll have to buy it a beer before getting anything useful :)
- nullish_signal 4y agoOpen-Source (Not you, Open-AI) models for the win!
- philbo 4y agoThey should have named it dumas instead of davinci.
- thinkmcfly 4y agoJust read the hot covid poll topic if you're looking for more good training data. ;) I was really impressed by the 002 version. Looking forward to trying out 003 tonight!
- faizshah 4y agoIt can't have been trained on HN, I tried generating my comment for this thread and it would only output positive marketing speak instead of "This name seems to collide with the artist Da Vinci."
- joe_the_user 4y agoAfter the failure of FB's Galactica model, I wonder whether LLM are starting to hit diminishing return. I've read of several ways diminishing returns could happen: * Not enough training data - you've used up the Internet (even a percentage of the Internet might be as much as is usable by clever brute force). * Not enough compute time to fully train (we're not close to that) * The model covers such a large area that testing is impossible One thing I'd speculate about is perhaps the more different subjects the program is expected to combine, the more it learns to spout plausible bullshit and clever quips, since for clever humans, that how they relate to stuff they don't know. So "pretentious but uninformed" might be a sign.
- TaylorAlexander 4y agoI still need to read past the first page, but I was reminded this morning of the 2021 paper “On the dangers of stochastic parrots: can language models be too big?” which discusses the harms and diminishing returns of moving to ever larger language models. I had to rush out the door today after seeing this paper come up so I can’t speak much to its content right now. But if anyone wants to read it and reflect here I’d like to hear it. https://dl.acm.org/doi/10.1145/3442188.3445922 https://dl.acm.org/doi/10.1145/3442188.3445922
- version_five 4y agoIt's also likely we're just seeing the limits of what the tech can do. It's not actually "intelligent" it's effectively a cool trick, and at some point the gap between what the trick can do and what a "perfect" AI can do becomes obvious. It's really not that different from Eliza being cool for a few minutes before being obviously found wanting. It just takes longer for the shine to wear off as we get to a better technology. Ditto for self driving cars - a steep climb to a 90% solution, then an impossible chasm to cross to something that actually handles the edge cases.
- klodolph 4y agoIt’s also not trained the way humans are. We’re trained interactively, and from an early age, say things in order to express ourselves and try to get what we want. Machine learning models are generally trained passively.
- frencabulator 4y agoVerbosity horrifies me. If it ruins the next iterations of GitHub Copilot, I'm going to lose it. Long generations are flashy toys for marketing, but too prone to being useless in practice.
- version_five 4y agoIt's interesting, verbosity is generally a sign of having poorly formed ideas "sorry for the long letter, I didn't have time to write a short one" etc. These language models are side effects, afaik they are trained to predict the next word and at scale it becomes a good sentence generator. I wonder if there is some way to regularize by encouraging concise language
- zed1726 4y agohttps://beta.openai.com/playground/p/LoLOf250swXu7UxeLWuQBegl?model=text-davinci-003 https://beta.openai.com/playground/p/LoLOf250swXu7UxeLWuQBeg...