2 ms·
Not an answer to your question, but maybe this has more info? I think with these optimizations and quants, it compares negatively. But can these optimizations b
by sixothree 2mo ago
Not an answer to your question, but maybe this has more info? I think with these optimizations and quants, it compares negatively. But can these optimizations be applied to models you want? Another question.
https://news.ycombinator.com/item?id=48353348 https://news.ycombinator.com/item?id=48353348