3 ms·
Can someone explain th hardware differences for training vs inference? I believe Nvidia is still the leader in training?
by gandutraveler 3y ago
Can someone explain th hardware differences for training vs inference? I believe Nvidia is still the leader in training?
- tome 3y agoYup, graphics processors are still the best for training. Groq's language processors (LPUs) are the state of the art for inference, far faster than any competitors. We have an open challenge to our competitors: can you match our inference tokens per second?