3 ms·
Interesting project but I hate how I have to manually confirm whether or not the analysis by LLM is “hallucinated” or not. For example, just looking at the fir
by xyst 2y ago
Interesting project but I hate how I have to manually confirm whether or not the analysis by LLM is “hallucinated” or not.
For example, just looking at the first result in the “Top Authors” category.
The author “asah” purportedly has a “88.10% success rate, 21 predictions”. Clicking the link just points to the comment then I (the reader) have to manually look through which ones were “successful”
Were the ones that I verified as “successful” the same ones as your analysis with LLM? I can’t exactly verify that since there are no sources provided. No history of the “conversation” preserved. Instead of trusting the information the reader is left with more questions than answers. Did it source it from a reliable first party source or maybe it got the information from a PR firm overstating certain numbers/figures.
Yet another reason why LLM/AI tech is overblown in my opinion. It’s catering to the same shit as the clickbait farms. Junk information with no backing/sources. Ask these algos to cross verify sources and probably get hallucinated trash.
- spencerflem 2y agoAgreed, if the author spent an hour our two doing it themselves this could have been a very fun article
- eamag 2y agoYou can go to the table [1] page and filter by username, then you can see what prediction LLM is evaluating and why. I can agree with you on hallucination part, but for the easy predictions it's correct most of the time (like Microsoft downfall) [1]https://hn-predictions.eamag.me/table https://hn-predictions.eamag.me/table