3 ms·
There is a wave of users switching over to DeepSeek Flash. There are Reddit threads of users sharing billion token spend for $20. If all of global spend on Ant
by arjunchint 3mo ago
There is a wave of users switching over to DeepSeek Flash. There are Reddit threads of users sharing billion token spend for $20.
If all of global spend on Anthropic/OpenAI/Gemini APIs just switches over to DeepSeek then easily we can decrease total AI spend by 10x
- pydry 3mo agoProbably won't be too long before the government decides to block deepseek's website based on "security" concerns.
- Mashimo 3mo agoWho is "The government"? China or your local one?
- pydry 3mo agoAmerican
- sharpshadow 3mo agoIt’s in the doing with the DAAMT Act and soon foreign AI companies will be on the entity list. Circumvent this sanctions and count with assets forfeiture, civil penalty and criminal prosecution. This will eliminate access to Deepseek and so on overnight. Cherry on top most westerners will face similar problems due to secondary sanctions.
- LUmBULtERA 3mo agoDeepseek's models are open-weight and hosted all over the world, how would blocking deepseek's web sight do anything to stop its model's use?
- sharpshadow 3mo agoDeepseek will be sanctioned and therefore no provider will offer it anymore. Only way to use it then will be private but even that will be forbidden if it gets classified as threat to national security.
- kamaal 3mo ago>>Deepseek will be sanctioned and therefore no provider will offer it anymore. That is possible inside the US. How do you do it all over the world? You have to convince every country in the world not use frontier models? Even worse how do you convince all the countries to not build their own models?
- sharpshadow 3mo agoYou are correct that it’s inside the US and it doesn’t apply to the whole world. But it will apply to the western world and much further which trades in dollar because else secondary sanctions apply. The shocking number is roughly 175-180 countries of 193 follow along US sanctions, that’s 90%. Unlike in the US the citizens of those countries will not be prosecuted for circumventing the sanctions but assets like bank accounts and wallets may be seized and Visa issues may arise. With the already ongoing legislation against foreign AI players and the recent national security threat assessment it strongly looks like just a matter of time until they implement the mechanics to sanction any disfavored AI. This will flush most users back to US companies. With the limited self hosting options and insanely strong export limits for datacenters it’s already established that countries can’t build their own models with the same power.
- IsTom 3mo agoAnd then USA will have a disadvantage compared to rest of the world with cheaper LLMs and american AI companies will have tougher time surviving on domestic spend alone.
- juleiie 3mo agoI am not sure if that is wise. It’s a hostile superpower after all
- ReptileMan 3mo agoWell... Open weights on premise is politically neutral.
- akie 3mo agoTry doing it at scale for a whole office. Not trivial.
- ReptileMan 3mo agoYou could probably do with couple of instances. People rarely use ai 24/7, so right now you can oversubscribe and still have acceptable latency and high utilization rate.
- arjunchint 3mo agoThere are plenty of US based hosters racing to optimize and drive efficiencies Literal race on twitter posting to increase token throughput and drive down costs on these Chinese open source models
- Sankozi 3mo agoThe training might be political. Search for "deepseek tibet backdoor"
- juleiie 3mo ago[flagged]
- KumaBear 3mo agoHostile? Us or them? I beg to differ who the hostile ones might be.
- Aldipower 3mo agoDS is restricting the "expert" model usage already, because they do not have enough compute.
- szszrk 3mo agov4 flash was really, really good in practice for me. While on openrouter it's around 1/100th of what the "SOTA" models cost. But billions? A bit exaggerated.
- arjunchint 3mo agoPlenty of screenshots in this thread showing usage. Its the ridiculous cached input token price of $0.00028/1 M https://www.reddit.com/r/DeepSeek/comments/1twesxe/comment/oppa6ic/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button https://www.reddit.com/r/DeepSeek/comments/1twesxe/comment/o...
- szszrk 3mo agoSo basically forcing particular deepseek provider should make cache introduce another huge savings bump? Count me in, I'll be testing that. Thank you!