4 ms·
Hello, I think this is a great project! If an individual is looking to contribute to the field with different training data ideas - would they need to first es
by thewataccount 3y ago
Hello, I think this is a great project!
If an individual is looking to contribute to the field with different training data ideas - would they need to first establish themselves and get your attention, or would there be a way to submit a proposal?
For myself compute is rather expensive, I could likely afford a few test runs for proofs of concept but beyond that it would be difficult. I've got a single 4090 so I can't run llama70b faster then 1it/s.
- rajko_rad 3y agoThank you so much for your work and enthusiasm here!! Unfortunately, that’s roughly the best way to approach it and how most of these have worked so far, demonstrations on smaller models (e.g. 7/13B), with slightly smaller datasets, catching the eye of the community, etc. in general it’s not a bad approach to research too, prove out concepts at smaller scale before scaling up!
- thewataccount 3y agoTotally understand! I'm sure you'd get swarmed with requests. Are you interested in non-LLMs as well? Stable diffusion for example?
- rajko_rad 3y agoDefinitely. This was kicked off in the last month or two when there just seemed to be a bit more happening in OSS LLMs, but we are prioritizing diversifying this for the next cohort!