3 ms·
I would say that unless you really change the goalposts of your new model or it is open (source), it is not going to do much. We already have incredible models
by anonzzzies 2y ago
I would say that unless you really change the goalposts of your new model or it is open (source), it is not going to do much. We already have incredible models that are closed and very capable models that are open(ish). I am not even sure where this is trying to play?
- valine 2y agoDemonstrating good performance from a non-transformer based architecture is cool. I agree though these particular models aren’t that useful given the current landscape. I think the intent here is probably to justify training a larger 400B model with their architecture.
- anonzzzies 2y agoBut then why introduce lukewarm?