3 ms·
... using the GPT-3 api. Not something you can run on your own machine (or data center) unfortunately.
by xg15 4y ago
... using the GPT-3 api.
Not something you can run on your own machine (or data center) unfortunately.
- oceanplexian 4y agoYou can run GPT-J and GPT-Neo on (2) 24Gb GPUs, like a pair of 3090s. Not to mention Stable Diffusion which has much lower requirements to produce amazing AI images. Now, if you want to train a huge model from scratch that’s a different story, but running your own server is definitely possible and improving every day.
- armchairhacker 4y agoHow much would 2 24gb GPUs cost? Unfortunately I think it’s still unaffordable for most Maybe you could rent GPU space on a service like vast.ai. But I imagine it would be difficult to set up, and at that point currently you’re better off just using GPT3…
- mosseater 4y agoGPT-J specifically was written using Google Cloud's TPU stuff. https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b They even have a google colab notebook thingie. Not much setup needed, just an account. https://colab.research.google.com/github/kingoflolz/mesh-transformer-jax/blob/master/colab_demo.ipynb#scrollTo=lwNETD2Uk8nu https://colab.research.google.com/github/kingoflolz/mesh-tra...
- ilaksh 4y agoYou can run the OpenAI completions endpoint with the text-davinci-003 model.
- v3ss0n 4y agoIs that model opensource or downloadable?