4 ms·I hope i get it to run on my 96gb m2 in q4.by rspoerri 3y agoI hope i get it to run on my 96gb m2 in q4.rspoerri 3y agoIt actually does, in case anybody wonders. But it seems as if it's not fine tuned to chat, or i'm doing it wrong at the moment. Getting a lot of duplicates and non useful answers.cyanydeez 3y agoThey might've tweaked the prompt tokens.