4 ms·

I'm sorry but LLMs notoriously provide inaccurate and otherwise awful information. Case in point, I asked an LLM what the last non cellular windows mobile clas

I'm sorry but LLMs notoriously provide inaccurate and otherwise awful information. Case in point, I asked an LLM what the last non cellular windows mobile classic PDA was. (I knew the answer) And it routinely got it wrong. This is what LLMs should be useful for. If I cant audit the results or very how it came to the conclusion the answer is useless. LLMs are toys at this juncture.

simonw 2y ago
That's a great example of the kind of prompt that I intuitively know wouldn't return a useful result... but I can't explain WHY I intuitively know that. Which is deeply frustrating.
mvkel 2y ago
Here are the results for that exact search in Google: https://www.google.com/search?q=what+was+the+last+non+cellular+windows+mobile+classic+PDA&ie=UTF-8&oe=UTF-8&hl=en-us&client=safari https://www.google.com/search?q=what+was+the+last+non+cellul... vs 4o: The last non-cellular Windows Mobile Classic PDA was the HP iPAQ 110 Classic. Released in 2008, it ran on Windows Mobile 6.0 Classic and featured a 624-MHz Marvell PXA310 processor, 256MB of Flash ROM, and a 3.5-inch screen with a 240 x 320 resolution. It included Wi-Fi and Bluetooth connectivity but lacked cellular capabilities, making it one of the final models in the declining PDA market as smartphones began to dominate [oai_citation:1,List of Windows Mobile devices - Wikipedia](https://en.wikipedia.org/wiki/List_of_Windows_Mobile_devices https://en.wikipedia.org/wiki/List_of_Windows_Mobile_devices) [oai_citation:2,The End of the Classic Version of Windows Mobile (AKA the PDA)](http://www.pocketpcfaq.com/commentary/end_of_WM_Classic.htm http://www.pocketpcfaq.com/commentary/end_of_WM_Classic.htm) [oai_citation:3,HP iPAQ 110 Classic - PDA Like It's 1999 - WiFi Planet](https://wi-fiplanet.com/hp-ipaq-110-classic/ https://wi-fiplanet.com/hp-ipaq-110-classic/). I know which version I'd prefer.
- qiqitori 2y ago
  What about the HP iPAQ 112 then? Wasn't the HP iPAQ 110 Classic released in November 2007? Also why are you entering questions into the Google search prompt?
  - mvkel 2y ago
    Because the commenter implied that LLMs get it wrong, as if search engines get it right. The reality is that both take digging, but the LLM response gets you to the right answer more quickly.

simonw 2y ago

That's a great example of the kind of prompt that I intuitively know wouldn't return a useful result... but I can't explain WHY I intuitively know that. Which is deeply frustrating.

mvkel 2y ago

Here are the results for that exact search in Google: https://www.google.com/search?q=what+was+the+last+non+cellular+windows+mobile+classic+PDA&ie=UTF-8&oe=UTF-8&hl=en-us&client=safari https://www.google.com/search?q=what+was+the+last+non+cellul... vs 4o: The last non-cellular Windows Mobile Classic PDA was the HP iPAQ 110 Classic. Released in 2008, it ran on Windows Mobile 6.0 Classic and featured a 624-MHz Marvell PXA310 processor, 256MB of Flash ROM, and a 3.5-inch screen with a 240 x 320 resolution. It included Wi-Fi and Bluetooth connectivity but lacked cellular capabilities, making it one of the final models in the declining PDA market as smartphones began to dominate [oai_citation:1,List of Windows Mobile devices - Wikipedia](https://en.wikipedia.org/wiki/List_of_Windows_Mobile_devices https://en.wikipedia.org/wiki/List_of_Windows_Mobile_devices) [oai_citation:2,The End of the Classic Version of Windows Mobile (AKA the PDA)](http://www.pocketpcfaq.com/commentary/end_of_WM_Classic.htm http://www.pocketpcfaq.com/commentary/end_of_WM_Classic.htm) [oai_citation:3,HP iPAQ 110 Classic - PDA Like It's 1999 - WiFi Planet](https://wi-fiplanet.com/hp-ipaq-110-classic/ https://wi-fiplanet.com/hp-ipaq-110-classic/). I know which version I'd prefer.

qiqitori 2y ago
What about the HP iPAQ 112 then? Wasn't the HP iPAQ 110 Classic released in November 2007? Also why are you entering questions into the Google search prompt?
- mvkel 2y ago
  Because the commenter implied that LLMs get it wrong, as if search engines get it right. The reality is that both take digging, but the LLM response gets you to the right answer more quickly.