3 ms·
That would make the regulations fairly pointless unless you think only mega-corps will ever be able to afford the compute for these things. Compute continues t
by api 3y ago
That would make the regulations fairly pointless unless you think only mega-corps will ever be able to afford the compute for these things.
Compute continues to get cheaper and cheaper. We have not hit the physics wall yet on that.
That and if someone cracks efficient distributed training in a swarm type configuration then you could train models Seti@Home style. Lots of people would be happy to leave a gaming PC on to help create open source LLMs. The data requirements might be big but I just got gigabit fiber installed in my house so that barrier is vanishing too.
- nullsense 3y agoThe other day someone offered up their 200x GPU crypto mining cluster to train uncensored models after the incident on HuggingFace where someone threatened to get the uploader of the uncensored models fired citing safety issues.
- chasd00 3y agoThat’s bizarre, what is unsafe about an uncensored LLM? Or I guess the same question in a different way, how does censoring an LLM make it safe? I could see an uncensored LLM being bad PR for a company but unsafe? How?
- nullsense 3y agoThat individual in particular was pushing some left-wing talking points. Though the other day Yuval Noah Harari gave a great talk on the potential threat to democracy - https://youtu.be/LWiM-LuRe6w https://youtu.be/LWiM-LuRe6w
- zamnos 3y agoShit, vast.ai will pay you right now for access to your gaming PC's GPU