4 ms·
"Another critical lesson is that humans are distinctly bad at monitoring automated processes". Humans are also distinctly bad at noticing certain kinds of bugs
by cratermoon 6mo ago
"Another critical lesson is that humans are distinctly bad at monitoring automated processes".
Humans are also distinctly bad at noticing certain kinds of bugs in software. Think off-by-one errors, deadlocks, or any sort of bug you've stared at for days and not noticed the one missing or extra semicolon. But LLMs can generate a tsunami of subtly wrong code in the time a reviewer will notice one typo and miss all the rest.
- aphyr 6mo agoYes. For more on this, see section 2: https://aphyr.com/posts/412-the-future-of-everything-is-lies-i-guess-dynamics#latent-disaster https://aphyr.com/posts/412-the-future-of-everything-is-lies...
- cratermoon 6mo agoAh I see. I had not gotten that far. Something I got from "Story of Your Life", by Ted Chiang. The sentence, "The rabbit is ready to eat"[1]. Also this old chestnut from NLP: Fruit flies like a banana. Time flies like and arrow. [1] The movie Arrival is based on this novella.
- intended 6mo ago> "Another critical lesson is that humans are distinctly bad at monitoring automated processes". I believe the technical term is vigilance degradation?