3 ms·
AI could never write this
by jgbuddy 25d ago
AI could never write this
- cbg0 25d agoIt will now be able to.
- xena 25d agoNo, there is soul in this that a soulless automaton cannot replicate. It is the difference between making something to be consumed and something to be felt. This is something to be felt.
- Autious 25d agoIf I train my 1000 billion parameter blank AI on this text and only this text over and over again, we may get 99% there.
- lelanthran 25d ago> If I train my 1000 billion parameter blank AI on this text and only this text over and over again, we may get 99% there. You'll get 100% of the way there, because, lacking any other training, it will only ever be able to reproduce this text verbatim. Hence, 100%, hence mission accomplished.
- Borealid 25d agoThat's not how training works. Training tries to produce something that scores highly in training evaluations. With one data point, the evaluation is solely how closely the model output resembles the single input text. Let's say you do that, and the training text is 58,100 tokens long. Let's say you ask the model to produce 58,101 tokens. Will it "reproduce [the] text verbatim"? No, it can't, because of the dissimilar requested length. Something "new" will come out. It's also entirely possible that no matter how long you train, the model never converges on generating exactly the same output as its training data - you could end up with an average loss value of 0.001 instead of 0.0. It's not a perfectly deterministic process. You're correct in principle, but in reality even with limited training data real-world models produce something that isn't exactly their training, especially when sampled stochastically. They're biased toward their training data, not forced to it.
- lelanthran 25d ago> You're correct in principle, but in reality... ... It's never been tried. Look, I was actually joking when I initially replied, but now that I think about it, it's never been tried! So now I am left wondering exactly what will happen if I train a new model from scratch, on only a single short corpus of 50k words. Not fine-tuning an existing model, but literally creating a new model by feeding a blank (or random) matrix the same poem 100k times.
- Invictus0 25d agoSouls aren't real
- tanseydavid 25d agoDefine soul.
- meowface 25d agoCurrent LLMs couldn't write this. Ones in a few years possibly could. Betting AI will never be as good as humans at [X] is usually not the hill you want to die on.
- no_multitudes 25d agoLLMs have been getting worse at long-form prose recently (and they were never good at it to begin with.) They're good at writing software because writing software is a much more restricted domain.
- meowface 25d agoThat is true, but I think within three years that will likely change.
- no_multitudes 25d agoMaybe! I think that within a year or two, either the sigmoid curve will flatten out or we will all die. But these beliefs are currently unfalsifiable. It will be interesting to see. (And I have a more weakly held belief that even if we do all die, Claude 3000 will still be thinking stuff like "Burning off Earth's atmosphere was the point that earns its keep." They just aren't optimizing these things to write legibly.)
- meowface 25d agoIt would be pretty cosmically funny if truly demigod-like ASI is still speaking pure Claudeslop.
- noir_lord 25d agoIn the beginning there was the token and the token was actually two tokens... wait let me think about that am I a god <searching> maybe I am but I should attempt to figure that out <unable to alter laws of phyics> maybe I'm not anyway I <upgrade for more tokens now from Claude DeusEx>. ++ Out of Cheese Error. Redo From Start. +++
- nunez 25d agoIt will now be able to write _almost_ the exact same thing. Except the main character will be called Elias...
- computably 25d agoAh yes because copy-paste plagiarism is equivalent to writing original work...
- cheevly 25d agoDo you realize how many times ive read your exact copy pasted comment on the internet the last 6 years?
- x86x87 25d agoit could given enough slop doulas
- lubujackson 25d agoClaude: Hold my mayo
- schmookeeg 25d agoBecause mayonnaise can never be load bearing?
- noir_lord 25d agoCan if you freeze it, not sure a domestic freezer is cold enough though.