4 ms·
But why? Like, use the 7B berkley sterling on a freaking 3060 laptop and you are still getting better results on both output and tokens. I don't understand wh
by resource_waste 3y ago
But why?
Like, use the 7B berkley sterling on a freaking 3060 laptop and you are still getting better results on both output and tokens.
I don't understand what they are getting out of these large models that perform worse.