5 ms·
The discovering itself doesn’t seem like the interesting part. If the discovery wasn’t in the training data then it’s a sign AI can produce novel scientific res
by rlt 1y ago
The discovering itself doesn’t seem like the interesting part. If the discovery wasn’t in the training data then it’s a sign AI can produce novel scientific research / experiments.
- hammyhavoc 1y agoThis is monkeys and typewriters. It's like seeing things in clouds or tea leaves.
- Supermancho 1y agoIf the "monkeys with typewriters" produces a Shakespear sonnet faster than he is reincarnated, it's a useful resource. At least, that's the thinking.
- shermantanktop 1y agoThat’s the looooong game on both counts.
- tux1968 1y ago'tis the patient plot on either side, where time doth weave its cunning, deep and wide.
- shermantanktop 1y agoyou lit-nerd sniped me with this one! but i call shenanigans on your AI-generated poetry.
- coliveira 1y agoIt is 100% impossible for AIs to create a Shakespeare sonnet. They can create a pastiche of a sonnet, which is completely different.
- andsoitis 1y agoIt can’t be a Shakespeare sonnet if Shakespeare didn’t write it
- inglor_cz 1y agoYour exchange has made me wonder. Yes, whatever AI produces is not genuine stuff. But there is something we could call "Shakespeare-ness", and maybe it is quantifiable. How would a realistic Turing test for "Shakespeare-ness" look like? Big experts on Shakespeare likely remember (at least vaguely) all his sonnets, so they cannot be part of a blinded study ("Did Shakespeare write this or no?"), because they would realize that they have never seen those particular lines, and answer based on their knowledge. Maybe asking more general English Lit teachers could work.
- hammyhavoc 1y agohttps://garymarcus.substack.com/p/on-hype-and-the-unbearable-banality https://garymarcus.substack.com/p/on-hype-and-the-unbearable...
- inglor_cz 1y agoExtra Terrible Lines are indeed fun. We've had 9 months of development since then, though; maybe it would make sense to repeat those experiments twice a year. IIRC Scott Alexander is doing something similar with his "AI draws nontrivial prompts" bet, and the difference to last year's results was striking. Also, this really needs blinding, otherwise the temptation to show off one's sophistication and subtlety is big. Remember how oenologists consistently fail to distinguish between a USD 20 and a USD 2000 wine bottle when blinded.
- vrighter 1y agoYes. Just like any pair of glasses the sun decides to wear would be sunglasses.
- Supermancho 1y agoHawking Radiation isn't Hawking Radiation because he's not around to say it is? I don't think this makes sense... Unless your response is AI generated. In that case, I would tip my hat.
- coliveira 1y agoAI companies stole massive amounts of information from every book they could get. Do you really believe there's any research they don't have input into their training sets?
- wizzwizz4 1y agoIt's not that kind of AI. We know that these algorithms can produce novel solutions. See https://arxiv.org/abs/2312.04258 https://arxiv.org/abs/2312.04258, specifically "Urania".