4 ms·
It's not the models, it's the tooling. Models are just weights and an architecture spec. The tooling is how to load and execute the model on hardware. Some UX-
by cakealert 1y ago
It's not the models, it's the tooling. Models are just weights and an architecture spec. The tooling is how to load and execute the model on hardware.
Some UX-oriented tooling has sort of solved this problem and will run on AMD: LM Studio