3 ms·
This isn’t how deep learning works. You can’t just “adjust weights” for some random user/product. I feel like even otherwise intelligent people these days thin
by lqstuart 7mo ago
This isn’t how deep learning works. You can’t just “adjust weights” for some random user/product.
I feel like even otherwise intelligent people these days think these chatbots are Westworld-like programmable AIs and not pieces of shit that barely run or work. There is no tech monolith that’s getting advanced and gaining new capabilities. There are some very smart people who have switched from building ad recommenders or autonomous vehicles to building KV caches and reinforcement learning systems, and then in a different department there are the same people who built ads systems at whatever big tech company that will build the same shit at OAI etc.
- ndriscoll 7mo agoYou don't need to adjust the weights. Just have it query a vector database of current ad campaigns to find a PROMPT.md to inject when the context is relevant. e.g. user is talking about camping -> lookup ad campaign documents relevant to camping (e.g. with embeddings) -> inject prompt about the campaign. This is all basically obvious if you've been using SKILL.md for agents at work.
- toraway 7mo agoIsn't that literally what post-training/fine-tuning does?
- Tanjreeve 7mo agoIt means you can't crank up the knob on "burger king recommendations" for instance.