3 ms·
Thanks I appreciate the info. I may try to spin up something like this and give it a whirl.
by Someone1234 6mo ago
Thanks I appreciate the info. I may try to spin up something like this and give it a whirl.
- anon373839 6mo agoI would recommend trying oMLX, which is much more performant and efficient than LM Studio. It has block-level KV context caching that makes long chats and agentic/tool calling scenarios MUCH faster.
- felikz 5mo agoand it horribly kernel panics when it is running for too long due to Apple does not give a sh over mlx, see list of issues: https://github.com/Harperbot/metal-guard#landed-here-searching-for-one-of-these-youre-in-the-right-place https://github.com/Harperbot/metal-guard#landed-here-searchi...