3 ms·
> Are these LLMs just absurdly memory bound so it doesn't matter? During inference? Definitely. Training is another story.
by throwaway314155 2y ago
> Are these LLMs just absurdly memory bound so it doesn't matter?
During inference? Definitely. Training is another story.