3 ms·
Oh contraire, I ask questions about recent things all the time, because the LLM will do a web search and read the web page - multiple pages - for me, and summar
by barrkel 1y ago
Oh contraire, I ask questions about recent things all the time, because the LLM will do a web search and read the web page - multiple pages - for me, and summarize it all.
4o will always do a web search for a pointedly current question, give references in the reply that can be checked, and if it didn't, you can tell it to search.
o3 meanwhile will do many searches and look at the thing from multiple angles.
- pzo 1y agoBut that's from user perspective, check Google or openai pricing if you wanted to have grounded results in their API. Google ask $45 for 1k grounded searches on top of tokens. If you have business model based on ads you unlikely gonna have $45 CPM. Same if you want to offer so free version of you product then it's getting expensive.
- zambal 1y agoBut in that case it's hard to argue that llm's are cheap in comparison to search (the premise of the article)
- gpm 1y agoIt seems like it shifts it from "using an LLM instead of a search engine is cheaper" to "using an LLM to query the search engine represents only a marginal increase in cost", no?
- harperlee 1y agoNitpick: Au contraire
- WhyIsItAlwaysHN 1y agoBut that was my point, then you need to include the entire websites in the context and it won't be 506 tokens per question. It will be thousands
- skywhopper 1y agoYeah, the point is that this behavior uses a lot more tokens than the OP says is a “typical” LLM query.