2 ms·
Someone should just get this working on Llama 2 instead of O̶p̶e̶n̶AI.com [0] All this is it's just talking to a AI model sitting on someone else's server. [0
by rvz 3y ago
Someone should just get this working on Llama 2 instead of O̶p̶e̶n̶AI.com [0]
All this is it's just talking to a AI model sitting on someone else's server.
[0] https://github.com/microsoft/TypeChat/blob/main/src/model.ts#L53C7-L53C7 https://github.com/microsoft/TypeChat/blob/main/src/model.ts...
- DanRosenwasser 3y agoHi there! I'm one of the people working on TypeChat and I just want to say that we definitely welcome experimentation on things like this. We've actually been experimenting with running Llama 2 ourselves. Like you said, to get a model working with TypeChat all you really need is to provide a completion function. So give it a shot!
- joelmgallant 3y agoThe most recent gpt4all (https://github.com/nomic-ai/gpt4all https://github.com/nomic-ai/gpt4all) includes a local server compatible with OpenAPI -- this could be a useful start!