2 ms·
MPT-7B-8K: 8K Context Length for Document Understanding
- brianjking 3y agoMosaicML has retrained their 7B model with an 8K context length window for their base, chat, and instruction tuned open source models. Base & instruction tuned versions are available for commercial use with Apache 2 license!