4 ms·
Will there be "extended context" releases like 01.ai did for Yi? Also, is the model GQA?
by brucethemoose2 3y ago
Will there be "extended context" releases like 01.ai did for Yi?
Also, is the model GQA?
- hustwindmaple1 3y agoIt's MQA, documented in the tech report