2 ms·
Yes, but can you replicate that functionality using llama.cpp? If so, what did you run with main? I haven't been able to get an answer, while for the question
by csdvrx 3y ago
Yes, but can you replicate that functionality using llama.cpp?
If so, what did you run with main?
I haven't been able to get an answer, while for the question above, I can get 'I chose the word "laptop"' with mlc-llm
- elorant 3y agoFor the tasks I need it the efficiency is similar to the online model. Only slower. I don't care for conversational functionality.