I know nothing, but have heard Hugging Face is in that direction. https://github.com/huggingface/transformers https://github.com/huggingface/transformers >Tra

I know nothing, but have heard Hugging Face is in that direction. https://github.com/huggingface/transformers https://github.com/huggingface/transformers >Transformers provides thousands of pretrained models to perform tasks on different modalities such as text, vision, and audio. > These models can be applied on: > - Text, for tasks like text classification, information extraction, question answering, summarization, translation, text generation, in over 100 languages. > - Images, for tasks like image classification, object detection, and segmentation. > - Audio, for tasks like speech recognition and audio classification. --- Also I read about GPT-J, whose capability is comparable with GTP-3. https://github.com/kingoflolz/mesh-transformer-jax https://github.com/kingoflolz/mesh-transformer-jax But I believe it requires buying or renting GPUs.