3 ms·
i don't use local llms. it's mostly the closed source subscriptions that are not private, it really is a choice. there are many cloud providers of zero data re
by lukewarm707 7mo ago
i don't use local llms. it's mostly the closed source subscriptions that are not private, it really is a choice.
there are many cloud providers of zero data retention llm APIs, and even cryptographic attestation.
they are not throttled, you can get an agreed rate limit.
- l72 7mo agoWould you mind naming some of your favorite providers?
- lukewarm707 7mo agoAPI: fireworks Fast: inception labs or cerebras Confidential: tinfoil.sh, phala TTS/STT: groq Routers: vercel (or openrouter if they don't have the model). Search: unsolved, just can't get zdr, local hosted.