4 ms·
title is missing: "trained in 1 week, and like most open source LLMs so far... it sucks compared to the closed source alternatives" Great effort of course bla
by youssefabdelm 3y ago
title is missing: "trained in 1 week, and like most open source LLMs so far... it sucks compared to the closed source alternatives"
Great effort of course bla bla bla...
Open source really needs some benchmarking, and up their game quality-wise.
And yes I know they're expensive as shit to train... let's not keep wasting our money and actually work together, pool our resources, to make a GOOD model.
But oh no, everyone wants to put their stamp on it. "Replit did this! Look at us!"
- ImprobableTruth 3y agoThis is easy to say, but I think the issue is that getting an LLM right isn't easy, so it's not clear who should steward such a project. Something like BLOOM shows that even if you have the necessary compute, you can still get a model that isn't good. I think it will take some time for it to be clear who is a leader in training open source models (maybe it will be the red pajama folks?) and I think they'll get more support after that.
- youssefabdelm 3y agoFair point