4 ms·

Might want to check out these guys as well: https://cocktailpeanut.github.io/dalai/#/ https://cocktailpeanut.github.io/dalai/#/

• Tepix 4y ago
  That's for CPU (and they only provide 7B and 13B).