2 ms·
LLMs don't average, they learn the distribution, from which you then sample (or the UI does it for you). Because of that, they don't write in a single style tha
by TeMPOraL 2y ago
LLMs don't average, they learn the distribution, from which you then sample (or the UI does it for you). Because of that, they don't write in a single style that's a blend of many human styles - they can write in any and all of the human styles they saw in training, as well as blend them to create styles entirely "out of distribution". And it's up to your prompt (and sampling parameters) which style will be used.
- shmel 2y agoYeah, I am shocked people keep repeating this. We've seen LLMs easily writing mathematical proofs in the style of Shakespeare, come on.
- dartos 2y agoSaying they find some “average” is an easy way to explain to a layman that LLMs are statistically based and are guessing and not actually spitting out correct text as you would expect from most other computer programs. That’s why it’s repeated. It’s kind of correct if you squint and it’s easy to understand
- shmel 2y agoWhat is the correct text anyway? Everything around you is somewhat wrong. Textbooks (statistically all of them) contain errors, scientific papers sometimes contain handwavy bullshit and in rare cases even outright falsified data, human experts can be guessing as well and they are wrong every now and then, programs (again pretty much all of them) contain bugs. It is just the reality. Even very simple ones may require you to twist the definition of "correctness". I open a REPL and type "1/3.0*3.0" and get "0.9999999999". Then you have to do mental gymnastics like "actually it is a correct answer because arithmetic in computers is implemented not like you'd expect".
- dartos 2y ago> What is the correct text anyway? Exactly. The fact that language is fuzzy is why LLMs work so well. The issue is that most people expect computers to not make mistakes. When you write a formula in an excel sheet, the computer doesn’t mess up the math. The average non tech person knows that humans make mistakes, but are not used to computers making mistakes. Many people, maybe most, would see an answer generated by a computer program and assume that it’s the correct answer to their question. In pointing out that LLMs are guessing at what text to write (by saying “average”) you convey that idea in a simplified way. Trying to argue that “correct” doesn’t mean anything isn’t really useful. You can replace the word “correct” with “practically correct” and nothing about what I said changes.
- TeMPOraL 2y agoThe word you're looking for is "any", not "average". As in, it can write like any human, any way you want it to. Not just as some "average human".
- dartos 2y agoThe word “average” implies a use of statistics, which is why I think it’s good to use, even though it’s not precise.
- TeMPOraL 2y agoPeople aren't as dumb as you seem to imply here; "average" isn't accurate enough. "Random", or even "statistical", would be less confusing.
- dartos 2y agoWe can keep bikeshedding, sure. I don’t think people are dumb, just that the vast majority of people dont have knowledge of statistics and AI. “Random” isn’t good either. Obviously the text gpt and other LLMs generate isn’t random. Statistical works too, sure.
- 2y ago
- derbOac 2y agoThere's still some typicality defined by the prompt though. If you ask for a proof in the style of Shakespeare, you're going to get some "average" Shakespeare. It's kind of embedded in the task definition; you're shifting the reference distribution. If a LLM returned something really unusual for Shakespeare when you didn't ask for it, you'd say it's not performing well. Maybe that's tautological but I think it's what's usually meant by "average". I'm sure LLMs with something different is on the near horizon but I don't think we're there quite yet.
- chrsig 2y ago> you're going to get some "average" Shakespeare The point was that no, you wont (necessarily) get some "average" shakespeare. A sampler may introduce bias and look for the "above average" shakespeare in the distribution.
- deleted 2y ago[deleted]
- Lalabadie 2y agoTrue, a better choice of words than average would have been: a very likely completion to a starting state/input.
- TeMPOraL 2y agoPerhaps, but in the context of this thread, what's important is that the space of possible completions is encompassing every writing style imaginable and then some, and the starting state/input can be used to direct the model to arbitrary points in that space. Simple example template: Please write <specifics of the text you want LLM to write>, <style instruction>. Where <style instruction> = "as if you were a pirate", or "be extremely succinct", or "in the style of drunk Shakespeare", or "in Iambic pentameter", or "in style mimicking the text I'm pasting below", etc. There's no way those "AI detectors" could determine whether the text was written by AI from text itself, as it's trivial to make LLM output have any style imaginable.