3 ms·
Yesterday I summarised 15 years of my web comments with Mistral for RAG augmentation, took a few hours. Great little model I can run even on a 2080ti. As small
by visarga 3y ago
Yesterday I summarised 15 years of my web comments with Mistral for RAG augmentation, took a few hours. Great little model I can run even on a 2080ti. As small as it is, it understands English and executes instructions fluently.
- tarruda 3y agoFor chat, I suggest trying the OpenOrca finetune, the performance is amazing and it responds very well to system prompt: https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca It runs very well on my laptop's RTX 3070 which only has 8gb ram, felt like I'm running early versions of chatgpt locally.