5 ms·
GPT2 is ancient news. There are now local running models which, allegedly, can reach the same performance as GPT-4. Look up llama.cpp[1] and all the various com
by newswasboring 4y ago
GPT2 is ancient news. There are now local running models which, allegedly, can reach the same performance as GPT-4. Look up llama.cpp[1] and all the various community generated models.
[1] https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp
- napier 4y agoVery much allegedly. They’re good, but not great.
- holografix 4y agoDoes llama.cop not run on GPU?
- MacsHeadroom 4y agollama.cpp is CPU only but llama runs on GPU using the HuggingFace Transformers library. You can run the llama model which far outpaces GPT-3.5 on a couple of $200 Tesla P40 GPUs at faster speeds than GPT-3.5 Turbo, completely locally.
- LoganDark 4y agoIt doesn't, it's CPU-only. -Emily
- yreg 4y agoIncredibly difficult to measure it, but it seems llama is closest to GPT-3[0]. Which is pretty cool all things considered. Certainly better than most of us would have expected a short while ago, right? [0] https://arxiv.org/pdf/2302.13971.pdf https://arxiv.org/pdf/2302.13971.pdf