3 ms·
With a large model? How many parameters? See my other comment here: https://news.ycombinator.com/item?id=38536178 https://news.ycombinator.com/item?id=3853617
by cs702 3y ago
With a large model? How many parameters?
See my other comment here:
https://news.ycombinator.com/item?id=38536178 https://news.ycombinator.com/item?id=38536178
- jefft255 3y agoA couple millions IIRC. Nothing "large" compared to modern transformer models.
- deleted 3y ago[deleted]
- cs702 3y agoThanks for getting back to me. That's what I thought. The magic seems to start happening in the low billions of parameters -- and I say "seems" b/c there's no consensus as to whether it's really truly magic! In any case, it's a shame that most of the human brainpower capable of improving SotA AI doesn't have access to large-scale resources.