3 ms·
> an mcp server that lets the agent raise its hand instead of hallucinating a) It doesn't know when it's hallucinating. b) It can't provide you with any accur
by threeseed 1y ago
> an mcp server that lets the agent raise its hand instead of hallucinating
a) It doesn't know when it's hallucinating.
b) It can't provide you with any accurate confidence score for any answer.
c) Your library is still useful but any claim that you can make solutions more robust is a lie. Probably good enough to get into YC / raise VC though.
- echollama 1y agoreasoning models know when they are close to hallucinating because they are lacking context or understanding and know that they could solve this with a question. this is a streamlined implementation of a interanlly scrapped together tool that i decided to open-source for people to either us or build off of.
- geraneum 1y ago> reasoning models know when they are close to hallucinating because they are lacking context or understanding and know that they could solve this with a question. I’m interested. Where can I read more about this?
- threeseed 1y ago> reasoning models know when they are close to hallucinating because they are lacking context or understanding and know that they could solve this with a question You've just described AGI. If this were possible you could create an MCP server that has a continually updated list of FAQ of everything that the model doesn't know. Over time it would learn everything.
- xeonmc 1y agoUnless there is as yet insufficient data for meaningful answer.
- marshall300791 1y agohttps://arxiv.org/html/2407.14507v3 https://arxiv.org/html/2407.14507v3