4 ms·
And yet I can provide modern LLMs unique never before asked scenarios that require the ability to reason about real world phenomenon and they can respond in way
by d_sem 2y ago
And yet I can provide modern LLMs unique never before asked scenarios that require the ability to reason about real world phenomenon and they can respond in ways more thoughtful than the average person.
Much of human education is feeding books of information about things we will never experience in our day-to-day lives, and convincing ourselves it reflects reality. When in fact most of us have not personally experienced any evidences that what we learned is true.
That vast majority of what a person "knows" is a biological statistical pattern matching on steroids.
- Salgat 2y agoWhat you're describing is no different than a linear regression describing the predicted value between two data points. Sometimes the regression is close if enough data exists, other times you get wild hallucinations, with the model none the wiser whether it's correct. All this tells us is that there is a lot of data out there on the internet that can still have useful information extracted from it. Take someone like Ramanujan, who with a couple math books on his own, could derive brilliant and novel discoveries in mathematics, instead of needing millions of man hours worth reading material to replicate what is mostly a replacement for googling.
- fsndz 2y ago> And yet I can provide modern LLMs unique never before asked scenarios that require the ability to reason about real world phenomenon and they can respond in ways more thoughtful than the average person. Give me an example of that
- d_sem 2y agoOne example is to provide it a list of objects and ask it what would be the most plausible way to stack them without damaging the objects while also being stable. Optionally, you can ask the model to generate a rational for the solution provided. You can even invent a fictious object that has never existed, define it's properties, and ask the model to include it in the list.
- seanthemon 2y agoSure the question may be unique, but you said unique scenario - this scenario is very well trained for.
- inopinatus 2y agoDon’t be hoodwinked by a plausibility engine. The central dogma of oracle-type LLMs is that plausibility converges towards accuracy as scale increases. This hypothesis remains very far from proven.