3 ms·
Is it me or do they not mention the size of the model at all? Pretty hard to compare it with other models when we don't know what weight class it's in...
by Philpax 3y ago
Is it me or do they not mention the size of the model at all? Pretty hard to compare it with other models when we don't know what weight class it's in...
- moonsu 3y agoWhy? You’re not going to be running it on your own hardware. As an end user all that matters are the results.
- csjh 3y agoI disagree, IMO for any model that isn't open source model size is just an implementation detail. If someone released a 10 trillion parameter model that's better than GPT4 it isn't somehow inferior because it has more parameters.
- machdiamonds 3y agoEmad (Stability AI) thinks it's a 300B model https://twitter.com/EMostaque/status/1727373950685200674 https://twitter.com/EMostaque/status/1727373950685200674
- thawab 3y agoWhy would the deepmind cofounder go for 1 model and not a MOE architecture like gpt4? 1.3 billion dollars is not enough to get you to gpt4?