2 ms·

Any idea what makes models hard to run on it? Just general compatibility between Nvidia and AMD for stuff that was built for Nvidia originally? Or do you mean

Any idea what makes models hard to run on it? Just general compatibility between Nvidia and AMD for stuff that was built for Nvidia originally? Or do you mean something else?

cakealert 1y ago
It's not the models, it's the tooling. Models are just weights and an architecture spec. The tooling is how to load and execute the model on hardware. Some UX-oriented tooling has sort of solved this problem and will run on AMD: LM Studio