3 ms·
Are we supposed to use AMD GPUs for this to work? Or Does it work on any GPU?
by khurdula 2y ago
Are we supposed to use AMD GPUs for this to work? Or Does it work on any GPU?
- karamanolev 2y ago> This project provides a Docker-based inference engine for running Large Language Models (LLMs) on AMD GPUs. First sentence of the README in the repo. Was it somehow unclear?