A good start for AMD. I am also enthusiastic about another non-NVidea inference option: Groq (which I sometimes use). NVidia relies on TMSC for manufacturing.

A good start for AMD. I am also enthusiastic about another non-NVidea inference option: Groq (which I sometimes use). NVidia relies on TMSC for manufacturing. Samsung is building competing manufacturing infrastructure which is also a good thing, so Taiwan is not a single point of failure.