3 ms·
The AI is also indiscriminate with what "sources" it chooses. Even deep research mode in gemini. You can go through and look at the websites it checked, and it
by thewebguyd 1y ago
The AI is also indiscriminate with what "sources" it chooses. Even deep research mode in gemini.
You can go through and look at the websites it checked, and it's 80% blogspam with no other sources cited on said blog.
When I'm manually doing a Google search, I'm not just randomly picking the first few links I'm deliberately filtering for credible domains or articles, not just picking whatever random marketing blog SEO'd their way to the top.
Sorry Gemini, an Advertorial from Times of India is not a reliable source for what I'm looking for. Nor is this xyz affiliate marketing blog stuffed to the brim with ads and product placement.
Some of that is due to that's probably 90% of the internet, but weren't these things trained on huge amounts of books, and published peer-reviewed works? Where are those in the sources?
- ACCount37 1y agoIt's trained on them, yes. But is it trained to prefer them as sources when doing web search? The distinction is rather important. We have a lot of data that teaches LLMs useful knowledge, but data that teaches LLMs complex and useful behaviors? Far less represented in the natural datasets. It's why we have to do SFT, RLHF and RLVR. It's why AI contamination in real world text datasets, counterintuitively, improves downstream AI performance.