4 ms·
You can run GPT-J and GPT-Neo on (2) 24Gb GPUs, like a pair of 3090s. Not to mention Stable Diffusion which has much lower requirements to produce amazing AI im
by oceanplexian 4y ago
You can run GPT-J and GPT-Neo on (2) 24Gb GPUs, like a pair of 3090s. Not to mention Stable Diffusion which has much lower requirements to produce amazing AI images. Now, if you want to train a huge model from scratch that’s a different story, but running your own server is definitely possible and improving every day.
- armchairhacker 4y agoHow much would 2 24gb GPUs cost? Unfortunately I think it’s still unaffordable for most Maybe you could rent GPU space on a service like vast.ai. But I imagine it would be difficult to set up, and at that point currently you’re better off just using GPT3…
- mosseater 4y agoGPT-J specifically was written using Google Cloud's TPU stuff. https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b They even have a google colab notebook thingie. Not much setup needed, just an account. https://colab.research.google.com/github/kingoflolz/mesh-transformer-jax/blob/master/colab_demo.ipynb#scrollTo=lwNETD2Uk8nu https://colab.research.google.com/github/kingoflolz/mesh-tra...