3 ms·

Is there a single open source LLM model that plays in the same league as GPT-3.5 ? AFAIK the largest available models are for non-commercial use only. This is

by hcks 3y ago

Is there a single open source LLM model that plays in the same league as GPT-3.5 ? AFAIK the largest available models are for non-commercial use only. This is a big limitation to the ´LLMs are entering their stable diffusion moment’ narrative.

jdm2212 3y ago
Falcon 40B is allegedly the closest thing out there. It sure beats the hell out of all the other open source models I've tried, but good luck finding hardware that can run it.
- ls612 3y ago
  How much unified memory would you need to run this on an Apple silicon Mac?
  - jdm2212 3y ago
    Some discussion of trying to get it to run, if you're curious what folks have been trying: https://www.reddit.com/r/LocalLLaMA/comments/13wutj4/getting_falcon_40b_to_work/ https://www.reddit.com/r/LocalLLaMA/comments/13wutj4/getting...
cypress66 3y ago
No
Kerbonut 3y ago
WizardCoder-15B is damn close to 3.5 on a lot of tests.