3 ms·
You can skip to step 4 using something like GPT-J as far as I understand: https://github.com/kingoflolz/mesh-transformer-jax#links https://github.com/kingoflolz
by rockwotj 4y ago
You can skip to step 4 using something like GPT-J as far as I understand: https://github.com/kingoflolz/mesh-transformer-jax#links https://github.com/kingoflolz/mesh-transformer-jax#links
The pretrained model is already available.
- tysam_and 4y agoGPT-J I think hasn't gone beyond 20B parameters, and while it is not the most obvious I think the original question is asking about the full 180B parameter+ kind of model. :) :thumbsup: