3 ms·
Ads are not the only challenge. Cost-per-query is also a challenge, as an LLM query is 10x more expensive than a search-index query.
by breadwinner 1y ago
Ads are not the only challenge. Cost-per-query is also a challenge, as an LLM query is 10x more expensive than a search-index query.
- IggleSniggle 1y agoIs that all? I hadn't thought about that aspect, but I find it a little surprising that, even just considering post-training, it isn't more expensive than that.
- croon 1y agoI would assume (at minimum) 100x, but have not done any napkin math.