3 ms·
Can anyone explain to me, in simple terms, and at a high level, what the heck am I looking at? What is this library for? What does it mean "it is used by lama.c
by Tan-Aki 3y ago
Can anyone explain to me, in simple terms, and at a high level, what the heck am I looking at?
What is this library for?
What does it mean "it is used by lama.cpp and whisper.cpp"?
How is it revolutionary?
Thank you very much in advance!
- Tan-Aki 3y agoWith maybe a tiny bit of history as well? Pretty please? : p
- orost 3y agoggml is a library that provides operations for running machine learning models llama.cpp is a project that uses ggml to run LLaMA, a large language model (like GPT) by Meta whisper.cpp is a project that uses ggml to run Whisper, a speech recognition model by OpenAI ggml's distinguishing feature is efficient operation on CPU. Traditionally, this sort of work is done on GPU, but GPUs with large amounts of memory are specialized and extremely expensive hardware. ggml achieves acceptable speed on commodity hardware.
- Tan-Aki 3y agoThank you so much for your kindness Orost. Sharing really IS caring. I understand. May good things happen to you. Peace.
- Tan-Aki 3y agoThank you so much for your kindness Orost. Sharing really IS caring. I understand. May good things happen to you. Peace.