4 ms·
with llama.cpp getting GPT4all inference support the same day it came out, I feel like llama.cpp might soon become a general purpose high performance inference
by crakenzak 4y ago
with llama.cpp getting GPT4all inference support the same day it came out, I feel like llama.cpp might soon become a general purpose high performance inference library/toolkit. excited!
- ggerganov 4y agoHeh, things seem to be moving in this direction, but I think it's still a very long way to go. But who knows - the amount of contributions to the project keep growing. I guess when we have a solid foundation for LLM inference we can think about supporting SD as well
- reasonabl_human 4y agoThanks for your work in this space, it’s incredible!
- dcreater 4y agoAbsolutely, its just unbelievable what this one person has enabled. ChatGPT isn't mind blowing as much as ggerganov is.