4 ms·
> Their value prop is curation of trusted medical sources Interesting. Why wouldn't an LLM based search provide the same thing? Just ask it to "use only truste
by simianwords 9mo ago
> Their value prop is curation of trusted medical sources
Interesting. Why wouldn't an LLM based search provide the same thing? Just ask it to "use only trusted sources".
- tacoooooooo 9mo agoThey're building a moat with data. They're building their own datasets of trusted sources, using their own teams of physicians and researchers. They've got hundreds of thousands of physicians asking millions of questions everyday. None of the labs have this sort of data coming in or this sort of focus on such a valuable niche
- simianwords 9mo ago> They're building their own datasets of trusted sources, using their own teams of physicians and researchers. Oh so they are not just helping in search but also in curating data. > They've got hundreds of thousands of physicians asking millions of questions everyday. None of the labs have this sort of data coming in or this sort of focus on such a valuable niche I don't take this too seriously because lots of physicians use ChatGPT already.
- some_random 9mo agoLots of physicians use ChatGPT but so do lots of non-physicians and I suspect there's some value in knowing which are which
- palmotea 9mo ago> Why wouldn't an LLM based search provide the same thing? Just ask it to "use only trusted sources". Is that sarcasm?
- simianwords 9mo agowhy?
- Rygian 9mo agoHow does the LLM know which sources can be trusted?
- simianwords 9mo agoyeah it can avoid blogspam as sources and prioritise research from more prestigious journals or more citations. it will be smart enough to use some proxy.
- palmotea 9mo agoYou can also tell it to just not hallucinate, right? Problem solved. I think what you'll end up is a response that still relies on whatever random sources it likes, but it'll just attribute it to the "trusted sources" you asked for.
- simianwords 9mo agoyou have an outdated view on how much it hallucinates.
- palmotea 9mo agoThe point was: will telling it to not hallucinate make it stop hallucinating?
- simianwords 9mo agoNo, but did I suggest this? I only suggested you can ask ChatGPT to rely on higher quality sources. ChatGPT has a trade off to do when performing a search - it can rely on lower quality sources to answer questions at the risk of these sources being wrong. Please read what I have written clearly instead of assuming the most absurd interpretation.
- otikik 9mo agoI don't think you can use an LLM for that. For the same reason you can't just ask it to "Make the app secure and fast"
- simianwords 9mo agoThis is completely incorrect. This is exactly what LLMs can do better.
- sjsjshzhhz 9mo agoSomebody should tell the Claude code team then. They’ve had some perf issues for awhile now. More seriously, the concept of trust is extremely lossy. The LLM is gonna lean in one direction that may or may not be correct. At the extreme, it wound likely refute a new discovery that went against what we currently know. In a more realistic version, certain AIs are more pro Zionist than others.
- simianwords 9mo agoI meant that LLMs can be trusted to do searches and not hallucinate while doing it. You’ve taken that to mean it can comply with anything. The thing is, LLMs are quite good at search and probably way way more strong that whatever RAG setup this company has. What failure mode are you looking at from a search perspective? Will ChatGPT just end up providing random links?
- otikik 9mo agoNo, it is "absolutely right". The chatbots will say they can do it, but they can't. See the Openclaw debacle for a recent example.
- Esophagus4 9mo agoHave you tried it? Or are you just grasping at the latest straw you can find?
- dnw 9mo agoYes, they can. We have gotten better at grounding LLMs to specific sources and providing accurate citations. Those go some distance in establishing trust. There is trust and then there is accountability. At the end of the day, a business/practice needs to hold someone/entity accountable. Until the day we can hold an LLM accountable we need businesses like OpenEvidence and Harvey. Not to say Anthropic/OpenAI/Google cannot do this but there is more to this business than grounding LLMs and finding relevant answers.
- Rygian 9mo ago> We have gotten better at grounding LLMs to specific sources and providing accurate citations And how does the LLM know which specific sources to ground itself to?
- rune-dev 9mo ago> Just ask it to "use only trusted sources". This is pure LLM brain rot. You can’t “just ask” an LLM to be more reliable.
- AlexeyBelov 9mo agoLook at their other comments. They must be trolling at this point.