3 ms·
Simon thank you so much for this tool! I use it daily now since charmbraclet’s Mods[0] doesn’t support anthropics models. And now with tool calling it’ll be eve
by roxolotl 1y ago
Simon thank you so much for this tool! I use it daily now since charmbraclet’s Mods[0] doesn’t support anthropics models. And now with tool calling it’ll be even more useful. I am curious though if there’s any appetite for improving performance? It’s noticeably slow to even just print the help on all of my machines(M1 32gb/M2 21g/ryzen 7700 64gb).
0: https://github.com/charmbracelet/mods https://github.com/charmbracelet/mods
- simonw 1y agoHow many plugins do you have installed? We've seen problems in the past where plugins with expensive imports (like torch) slow everything down a lot: https://github.com/simonw/llm/issues/949 https://github.com/simonw/llm/issues/949 I'm interested in tracking down the worst offenders and encouraging them to move to lazy imports instead.
- roxolotl 1y agoI’ve only got the Anthropic and Gemini plugins installed. I’d be happy to do a bit more digging. I’m away for a bit but would be happy to file an issue with more context when I get a chance.
- simonw 1y agoTry running this and see if anything interesting comes out of it: sudo uvx py-spy record -o /tmp/profile.svg -- llm --help