3 ms·
How much would 2 24gb GPUs cost? Unfortunately I think it’s still unaffordable for most Maybe you could rent GPU space on a service like vast.ai. But I imagine
by armchairhacker 4y ago
How much would 2 24gb GPUs cost? Unfortunately I think it’s still unaffordable for most
Maybe you could rent GPU space on a service like vast.ai. But I imagine it would be difficult to set up, and at that point currently you’re better off just using GPT3…
- mosseater 4y agoGPT-J specifically was written using Google Cloud's TPU stuff. https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b They even have a google colab notebook thingie. Not much setup needed, just an account. https://colab.research.google.com/github/kingoflolz/mesh-transformer-jax/blob/master/colab_demo.ipynb#scrollTo=lwNETD2Uk8nu https://colab.research.google.com/github/kingoflolz/mesh-tra...