3 ms·
Yeah, especially with how much Google is hyping it. It could have been long context? Or a little bigger, to fill the relative gap in the 13B-30B area? Even if
by brucethemoose2 3y ago
Yeah, especially with how much Google is hyping it.
It could have been long context? Or a little bigger, to fill the relative gap in the 13B-30B area? Even if the model itself was mediocre (which you can't know until after training), it would have been more interesting.