2 ms·
mistal 7b base model is good enough for summarization. No need to go to the 8x7 one.
by ekianjo 3y ago
mistal 7b base model is good enough for summarization. No need to go to the 8x7 one.
- tkellogg 3y agoOP here. Yeah, it’s also extremely low-risk. The sensitive part of the algorithm is the embeddings. This part is just making the group human readable. The reason I didn’t do mistral the first time is because I’m lazy. I gave myself 3-4 hours to get a first pass done, and getting a local model running seemed unnecessarily difficult. It would be a great addition though.