3 ms·
indeed. I pointed out in https://buttondown.email/ainews/archive/ainews-llama-31-the-synthetic-data-model/ https://buttondown.email/ainews/archive/ainews-llama-
by swyx 2y ago
indeed. I pointed out in https://buttondown.email/ainews/archive/ainews-llama-31-the-synthetic-data-model/ https://buttondown.email/ainews/archive/ainews-llama-31-the-... that the frontier model curve is currently going down 1 OoM every 4 months, meaning every model release has a very short half life[0]. however this progress is still worth it if we can deploy it to improve millions and eventually billions of people's lives. a commenter pointed out that the amoutn spent on Llama 3.1 was only like 60% of the cost of Ant Man and the Wasp Quantumania, in which case I'd advocate for killing all Marvel slop and dumping all that budget on LLM progress.
[0] not technically complete depreciation, since for example 4o mini is widely believed to be a distillation of 4o, so 4o's investment still carries over into 4o mini
- thierrydamiba 2y agoAgreed on everything, but calling the marvel movies slop…I think that word has gone too far.
- ThrowawayTestr 2y agoThe marvel movies are the genesis for this use of the word slop.
- simonw 2y agoCan you back that claim up with a link or similar?
- RUnconcerned 2y agoNot only are Marvel movies slop, they are very concentrated slop. The only way to increase the concentration of slop in a Marvel movie would be to ask ChatGPT to write the next one.
- mattnewton 2y agoNot all Marvel films are slop. But, as a fan who comes from a family of fans and someone who has watched almost all of them; lets be real. That particular film, really and most of them, contain copious amounts of what is absolutely slop. I don't know if the utility is worse than an LLM that is SOTA for 2 months that no one even bothers switching to however - at least the marvel slop is being used for entertainment by someone. I think the market is definitely prioritizing the LLM researcher over Disney's latest slop sequel though so whoever made that comparison can rest easy, because we'll find out.
- lawlessone 2y ago>really and most of them, contain copious amounts of what is absolutely slop. I thought that was the allure, something that's camp funny and an easy watch. I have only watched a few of them so I am not fully familiar?
- arresin 2y agoIt’s junk food. No one is disputing how tasty it is though (including the recent garbage).
- throwup238 2y agoAll that Marvel slop was created by the first real LLM: <https://marvelcinematicuniverse.fandom.com/wiki/K.E.V.I.N. https://marvelcinematicuniverse.fandom.com/wiki/K.E.V.I.N.>
- troupo 2y ago> however this progress is still worth it if we can deploy it to improve millions and eventually billions of people's lives Has there been any indication that we're improving the lives of millions of people?
- zooq_ai 2y agoYes, just like internet, power users have found use cases. It'll take education / habit for general users
- troupo 2y agoAh yes. We're in the crypto stages of "it's like the internet".
- machiaweliczny 2y agoJust me coding 30% faster is worth it
- troupo 2y agoI haven't found a single coding problem where any of these coding assistants where anything but annoying. If I need to babysit a junior developer fresh out of school and review every single line of code it spits out, I can find them elsewhere