4 ms·
I find the larger Q5 versions from theBloke to be pretty good and allow you to run a larger model than you’d be able to otherwise. But there is definitely an im
by eigenvalue 3y ago
I find the larger Q5 versions from theBloke to be pretty good and allow you to run a larger model than you’d be able to otherwise. But there is definitely an impact, although it’s hard to quantify. It’s sort of like how you get less effective at coding when you’ve only slept 5 hours.