4 ms·

For smaller models, I'm impressed by Mistral-7b or fine-tuned variants like Zephyr. I use it regularly in Neovim[1] for mundane tasks (grammar correction, summa

For smaller models, I'm impressed by Mistral-7b or fine-tuned variants like Zephyr. I use it regularly in Neovim[1] for mundane tasks (grammar correction, summaries, ...). I'm curious how Orca 2 performs, downloading it right now. [1]: with https://github.com/David-Kunz/gen.nvim https://github.com/David-Kunz/gen.nvim

eurekin 3y ago
I'd love to see some demo of that!
- davidkunz 3y ago
  A demo video is in the README (I used Mistral-7b in there).
  - eurekin 3y ago
    Amazing, thank you!
GaggiX 3y ago
Also OpenChat-3.5v model (It has 7B parameters, I think it is also a Mistral finetuning), demo: https://openchat.team/ https://openchat.team/
- schleck8 3y ago
  Nice, it passes the weather test. I always ask open source models what the weather is like and see wether it hallucinates my location and a forecast. A few months ago without exception all models I tried (even larger ones) would just make up a temperature. Now it replies as it should Cool! > what's the weather like today? > I'm sorry, but I can't provide real-time weather information. However, I can help you with general information about weather conditions and forecasting.
- nodja 3y ago
  oh wow this model is kinda amazing, it passes my "creative" tests that only chatgpt 3.5 did decently well with, I've recently been disillusioned that open source has been moving the wrong way due to the focus on benchmarks, but this model seems to hit the spot in usefulness in more whacky prompts ("write X in the style of Y" kinda prompts)
  - sorokod 3y ago
    Always surprised how poorly these models do on the benchmarks they claim to do well. OpenChat has a benchmark radar diagram[1] but but often fails on actual samples. [1] https://github.com/imoneoi/openchat https://github.com/imoneoi/openchat
titaniumtown 3y ago
Haven't seen this neovim plugin before! I'm setting this up right now.

eurekin 3y ago

I'd love to see some demo of that!

davidkunz 3y ago
A demo video is in the README (I used Mistral-7b in there).
- eurekin 3y ago
  Amazing, thank you!

GaggiX 3y ago

Also OpenChat-3.5v model (It has 7B parameters, I think it is also a Mistral finetuning), demo: https://openchat.team/ https://openchat.team/

schleck8 3y ago
Nice, it passes the weather test. I always ask open source models what the weather is like and see wether it hallucinates my location and a forecast. A few months ago without exception all models I tried (even larger ones) would just make up a temperature. Now it replies as it should Cool! > what's the weather like today? > I'm sorry, but I can't provide real-time weather information. However, I can help you with general information about weather conditions and forecasting.
nodja 3y ago
oh wow this model is kinda amazing, it passes my "creative" tests that only chatgpt 3.5 did decently well with, I've recently been disillusioned that open source has been moving the wrong way due to the focus on benchmarks, but this model seems to hit the spot in usefulness in more whacky prompts ("write X in the style of Y" kinda prompts)
- sorokod 3y ago
  Always surprised how poorly these models do on the benchmarks they claim to do well. OpenChat has a benchmark radar diagram[1] but but often fails on actual samples. [1] https://github.com/imoneoi/openchat https://github.com/imoneoi/openchat

titaniumtown 3y ago

Haven't seen this neovim plugin before! I'm setting this up right now.