4 ms·
"Gaia uses the open-source Lemonade SDK from ONNX TurnkeyML for LLM inference." It says it right in the article. Its all Python academic-quality code, and I d
by DiabloD3 2y ago
"Gaia uses the open-source Lemonade SDK from ONNX TurnkeyML for LLM inference."
It says it right in the article.
Its all Python academic-quality code, and I don't know why AMD isn't partnering with high performance inference engines like Llama.cpp (the project Ollama borrowed their code from, and then didn't keep up with) instead.
- 0rzech 2y ago* Dual Mode: GAIA comes in two flavors: * Hybrid Mode: Optimized for Ryzen AI PCs, combining AMD Neural Processing Unit (NPU) and Integrated Graphics Processing Unit (iGPU) for maximum performance * Generic Mode: Compatible with any Windows PC, using Ollama as the backend https://github.com/amd/gaia/blob/a8b8b6e10b585f58ed1aafcef0d2566bda351af7/README.md https://github.com/amd/gaia/blob/a8b8b6e10b585f58ed1aafcef0d...