3 ms·
Obviously the reliability problems would go away if you self-host but the "point" is most people rely on external providers because they can't locally run model
by edude03 2y ago
Obviously the reliability problems would go away if you self-host but the "point" is most people rely on external providers because they can't locally run models of similar quality. So what do you do if deepseek cuts you off? For most getting 12? H100s (for the 671b) is essentially impossible.
- creamyhorror 2y agoYou use a Deepseek model not hosted by Deepseek, but another provider (e.g. DeepInfra currently). Hopefully a robust provider market will emerge and thrive, even if open models start thinning out.