4 ms·
A question for anyone that has tried this model: what has performance been like? I'm using an old CPU but llama2-13b performs around twice as fast as mistral-7b
by TheAceOfHearts 3y ago
A question for anyone that has tried this model: what has performance been like? I'm using an old CPU but llama2-13b performs around twice as fast as mistral-7b for some reason, and I'm not sure why.