4 ms·
I have to say that I really doubt this as they've released model weights for their several last few models that have been of nearly this size (and have been tra
by robkop 6y ago
I have to say that I really doubt this as they've released model weights for their several last few models that have been of nearly this size (and have been trained on the same dataset).
See https://github.com/google-research/text-to-text-transfer-transformer https://github.com/google-research/text-to-text-transfer-tra...
- deleted 6y ago[deleted]
- GrantZvolsky 6y agoI'm not sure whether I'd call 10e10 nearly the size of 10e12, but the dataset is open, so it shouldn't be an issue. https://github.com/google-research/text-to-text-transfer-transformer/blob/master/released_checkpoints.md https://github.com/google-research/text-to-text-transfer-tra...