Well yes tons of people are running them but they're all pretty well off. I don't have 10-20k$ to spend on this stuff. Which is about the minimum to run a 480B

Well yes tons of people are running them but they're all pretty well off. I don't have 10-20k$ to spend on this stuff. Which is about the minimum to run a 480B model, with huge quantisation. And pretty slow because for that price all you get is an old Xeon with a lot of memory or some old nvidia datacenter cards. If you want a good setup it will cost a lot more. So small models it is. Sure, the bigger models are better but because the improvements come so fast it means I'm only 6 months to a year behind the big ones at any time. Is that worth 20k? For me no.