3 ms·
T5 was open-sourced on release (up to 11B params): https://github.com/google-research/text-to-text-transfer-transformer#released-model-checkpoints https://githu
by minimaxir 4y ago
T5 was open-sourced on release (up to 11B params): https://github.com/google-research/text-to-text-transfer-transformer#released-model-checkpoints https://github.com/google-research/text-to-text-transfer-tra...
It is also available via Hugging Face transformers.
However, the paper mentions T5-XXL is 4.6B, which doesn't fit any of the checkpoints above, so I'm confused.