2 ms·
There is nothing magical about GPU memory though. It’s just faster. But people have been doing CPU inference since the first llama code came out.
by adastra22 1y ago
There is nothing magical about GPU memory though. It’s just faster. But people have been doing CPU inference since the first llama code came out.