3 ms·
Author here. I’m with you on the abstractions part. I dumped a lot of my though so this into a follow up post: https://lucumr.pocoo.org/2025/11/22/llm-apis/ htt
by the_mitsuhiko 11mo ago
Author here. I’m with you on the abstractions part. I dumped a lot of my though so this into a follow up post: https://lucumr.pocoo.org/2025/11/22/llm-apis/ https://lucumr.pocoo.org/2025/11/22/llm-apis/
- thierrydamiba 11mo agoExcellent write up. I’ve been thinking a lot about caching and agents so this was right ilup my alley. Have you experimented with using semantic cache on the chain of thought(what we get back from the providers anyways) and sending that to a dumb model for similar queries to “simulate” thinking?
- msp26 11mo agoreally nice post, will share!