3 ms·
Can this handle smaller models like Qwen 1.5B, or does it need some real intelligence to get the tool calling to work?
by eternityforest 2y ago
Can this handle smaller models like Qwen 1.5B, or does it need some real intelligence to get the tool calling to work?
- bediashpreet 2y ago7B is the sweet spot
- eternityforest 2y ago7B is pretty big for CPU though