2 ms·
Curious if the same idea could work with gpt-oss-120b? So one could run at least slowly on a Mac
by febed 2mo ago
Curious if the same idea could work with gpt-oss-120b? So one could run at least slowly on a Mac
- gitpusher42 2mo agoYeah, gpt-oss-120b is also MoE, so the same ssd-streaming and caching ideas should work. Feel free to fork and try implementing it!