2 ms·
Depending on you use-case, I've been quite impressed with GPT-OSS 20B with high reasoning effort. The 120B model is better but too slow since I only have 16GB
by magicalhippo 1y ago
Depending on you use-case, I've been quite impressed with GPT-OSS 20B with high reasoning effort.
The 120B model is better but too slow since I only have 16GB VRAM. That model runs decent[1] on the Spark.
[1]: https://news.ycombinator.com/item?id=45576737 https://news.ycombinator.com/item?id=45576737