3 ms·

I'm on a thinkpad with a 2016 CPU (i5-7300U) running ubuntu. I don't know anything so I left default settings. I get about 450ms/t with airoboros-7b and 350ms

by marci 3y ago

I'm on a thinkpad with a 2016 CPU (i5-7300U) running ubuntu. I don't know anything so I left default settings. I get about 450ms/t with airoboros-7b and 350ms/t with orca-mini-3b. edit: with oobabooga webui