3 ms·
But you cannot train an open weight model by yourself, and maybe there could some distributed training net ran by thousand of volunteers around the world in the
by darkwater 12d ago
But you cannot train an open weight model by yourself, and maybe there could some distributed training net ran by thousand of volunteers around the world in the future, but until we get there we will still be tied to BigCo (American, Chinese or wherever in the world) decisions.
- rusk 12d agoYou would need institutions to do this? What do we have besides global megacorps with the resources for this? Universities perhaps training models for their local catchment?
- nradov 11d agoWe'll probably see a few middle-tier countries like France or Japan training their own national LLMs that they can control. Even if it's expensive, this will eventually be just as critical to national sovereignty as having nuclear weapons. They don't want to be completely dependant on the USA or China.
- rusk 11d agoI can see a pan European project like CERN or Airbus where sovereign nations with aligned values pool their resources, as being useful here