1. In the scenario i'm mentioning, there's no LLMs being deployed at all for end users. Social networks, netflix-style video and email fits in a single rack for

1. In the scenario i'm mentioning, there's no LLMs being deployed at all for end users. Social networks, netflix-style video and email fits in a single rack for thousands of people (tens of thousands?). 2. Yes. That's already the case. Today a single smartphone has enough CPU/RAM to host email services for many thousands of users. A single Netflix OCA 2U serves 400Gbit/s of video: https://news.ycombinator.com/item?id=28584738 https://news.ycombinator.com/item?id=28584738 The only reason we had huge DCs before LLMs was so Google/Facebook could spread their surveillance/adtech empire. Nothing of that scale is needed to provide useful services to end users. Framasoft, the biggest non-profit host (a french FLOSS/education NGO) serves millions of users with dozens of services on 68 servers and 800TB storage: https://framapiaf.org/@Framasoft/115767718097945194 https://framapiaf.org/@Framasoft/115767718097945194