3 ms·

Looks like yet another wrapper for ollama…

• DiabloD3 2y ago
  "Gaia uses the open-source Lemonade SDK from ONNX TurnkeyML for LLM inference." It says it right in the article. Its all Python academic-quality code, and I don't know why AMD isn't partnering with high performance inference engines like Llama.cpp (the project Ollama borrowed their code from, and then didn't keep up with) instead.
  • 0rzech 2y ago
    * Dual Mode: GAIA comes in two flavors: * Hybrid Mode: Optimized for Ryzen AI PCs, combining AMD Neural Processing Unit (NPU) and Integrated Graphics Processing Unit (iGPU) for maximum performance * Generic Mode: Compatible with any Windows PC, using Ollama as the backend https://github.com/amd/gaia/blob/a8b8b6e10b585f58ed1aafcef0d2566bda351af7/README.md https://github.com/amd/gaia/blob/a8b8b6e10b585f58ed1aafcef0d...
• drillsteps5 2y ago
  With ollama being another wrapper of llamacpp... (Gaia seems to have 2 modes, one for running on AMD-specific hardware, and the second one being a wrapper around ollama the llamacpp wrapper).