4 ms·

Well, MPT-7B is also commercially usable and openly licensed: https://www.mosaicml.com/blog/mpt-7b https://www.mosaicml.com/blog/mpt-7b

• simonw 3y ago
  Yeah it's really promising. It's partially trained on that RedPajama data.
• akrymski 3y ago
  So is https://github.com/Lightning-AI/lit-llama https://github.com/Lightning-AI/lit-llama