4 ms·
Hey HN, I'm sick and tired of the big labs controlling most of the generative AI landscape. We are launching Llama Fund as a means of democratizing large scale
by mountainriver 1y ago
Hey HN,
I'm sick and tired of the big labs controlling most of the generative AI landscape. We are launching Llama Fund as a means of democratizing large scale AI model training through crowd funding.
Our platform will allow researchers to propose a training pipeline, from data curation to the number of GPUs required. Ideally they will already have a toy model working. From there users can crowdfund the effort based on milestones. Researchers can offer incentives, such as providing commercial licenses to contributors.
We hope this will open up a whole new avenue for large scale model work, powering the open source future of AI.
Would love to hear thoughts from the community!
- echelon 1y agoDon't use the name "Llama". Llama is not open source.
- CuriouslyC 1y agoI think this is cool, it's not too hard to get a 500m model doing some sort of interesting stuff as a home researcher but scaling it into the low billions to see if it remains competitive out of my own pocket is a non starter.
- mountainriver 1y agoExactly! Even if we could get to training 8b models that would be amazing
- pama 1y agoWho is “we” (in the “We are launching”) and what is the mechanism you can convince people/investors that you or the proposer of the project know how to train large scale models and can make accurate practical estimates?
- mountainriver 1y agoI have post-trained LLMs a lot, but ultimately it's not me proving it, it's the researchers who would pitch their work. They can pitch it however it makes sense for their work, giving milestones similar to any other crowd funding platform.
- doctorpangloss 1y agoWhat happened to Open Model Initiative?