6 ms·
https://github.com/ggerganov/llama.cpp/issues/39 https://github.com/ggerganov/llama.cpp/issues/39 40GB for the big llama.
by recuter 4y ago
https://github.com/ggerganov/llama.cpp/issues/39 https://github.com/ggerganov/llama.cpp/issues/39
40GB for the big llama.
- FooBarWidget 4y agoBut that's not ChatGPT?
- ShamelessC 4y agoNo one said ChatGPT. It was a vague reference to the recent LLaMA developments from the community.
- arlcode 4y agoNot it isn't but what the OP is saying that with the llama models (and others) being runable on consumer hardware it's only a matter of time until we get something that's "good enough" for many use cases. Maybe not first of the class but there is a lot value to be found in the middle ground and it's good for the market as a whole.
- deleted 4y ago[deleted]
- karmasimida 4y agoEven biggest Llama is like 1/3 size of ChatGPT
- recuter 4y agoMight as well compare it to AlpacaGPT, they are trained different. Carefully prompted the output shows flashes of excellence and really whips ass and it is still early days. We have almost closed the gap in no time whereas on ChatGPT day 1 it seemed they were years ahead. Hopefully there will be more models and developments.