3 ms·
MosaicML has retrained their 7B model with an 8K context length window for their base, chat, and instruction tuned open source models. Base & instruction tuned
by brianjking 3y ago
MosaicML has retrained their 7B model with an 8K context length window for their base, chat, and instruction tuned open source models.
Base & instruction tuned versions are available for commercial use with Apache 2 license!