4 ms·

>He gave "co-scientist" - a tool made by Google - a short prompt asking it about the core problem he had been investigating and it reached the same conclusion i

>He gave "co-scientist" - a tool made by Google - a short prompt asking it about the core problem he had been investigating and it reached the same conclusion in 48 hours. Could it be the case when asking the right question is the key? When you know the solution already it's actually very easy to accidentally include some hints in your phrasing of question that will make task 10x easier

killerteddybear 2y ago
This is a very common mistake with LLMs I find. Lots of people who have high domain knowledge will be very impressed by it due to situations where they phrase questions in such a way that it unintentionally leads it to a specific answer which they see as rightfully impressive, not realizing the information which they encoded in the question.
- tribler 2y ago
  If you carefully study the actual prompt used: it already mentions the tail as a factor. Answer talks more on the tail. Just confidently! No double blind methodology protocol.
  - dmix 2y ago
    The power of suggestion, ala https://en.wikipedia.org/wiki/Mentalism https://en.wikipedia.org/wiki/Mentalism
- booleandilemma 2y ago
  So like Clever Hans the horse, in a way? :) https://en.wikipedia.org/wiki/Clever_Hans https://en.wikipedia.org/wiki/Clever_Hans
  - killerteddybear 2y ago
    Very accurate comparison honestly -- pattern recognition without understanding or underlying knowledge.
deleted 2y ago
[deleted]
geophile 2y ago
So, maybe a much, much more impressive version of Clever Hans? (https://en.wikipedia.org/wiki/Clever_Hans https://en.wikipedia.org/wiki/Clever_Hans) This is not to detract from the AIs accomplishment at all. If it read the scientist's prior work, then coming up with the same discovery as the scientist did is still astounding.
- manmal 2y ago
  Or, put more negatively, like a mentalist? https://softwarecrisis.dev/letters/llmentalist/ https://softwarecrisis.dev/letters/llmentalist/

killerteddybear 2y ago

This is a very common mistake with LLMs I find. Lots of people who have high domain knowledge will be very impressed by it due to situations where they phrase questions in such a way that it unintentionally leads it to a specific answer which they see as rightfully impressive, not realizing the information which they encoded in the question.

tribler 2y ago
If you carefully study the actual prompt used: it already mentions the tail as a factor. Answer talks more on the tail. Just confidently! No double blind methodology protocol.
- dmix 2y ago
  The power of suggestion, ala https://en.wikipedia.org/wiki/Mentalism https://en.wikipedia.org/wiki/Mentalism
booleandilemma 2y ago
So like Clever Hans the horse, in a way? :) https://en.wikipedia.org/wiki/Clever_Hans https://en.wikipedia.org/wiki/Clever_Hans
- killerteddybear 2y ago
  Very accurate comparison honestly -- pattern recognition without understanding or underlying knowledge.

deleted 2y ago

[deleted]

geophile 2y ago

So, maybe a much, much more impressive version of Clever Hans? (https://en.wikipedia.org/wiki/Clever_Hans https://en.wikipedia.org/wiki/Clever_Hans) This is not to detract from the AIs accomplishment at all. If it read the scientist's prior work, then coming up with the same discovery as the scientist did is still astounding.

manmal 2y ago
Or, put more negatively, like a mentalist? https://softwarecrisis.dev/letters/llmentalist/ https://softwarecrisis.dev/letters/llmentalist/