4 ms·
My kingdom for a local LLM supporting my trusty Intel MacPro and AMD RX6900 XT!
by nickdothutton 3y ago
My kingdom for a local LLM supporting my trusty Intel MacPro and AMD RX6900 XT!
- Havoc 3y agoYou should be able to run something via openCL and llama.cpp on it
- tharmas 3y agoThis video demonstrates using LM Studio to run an LLM on an RX 7600XT 16gb so you should be able to run it on an RX 6900XT: https://www.youtube.com/watch?v=VXHryjPu52k https://www.youtube.com/watch?v=VXHryjPu52k