I was going to suggest that you could post the code until I got to the bottom and you already had! Very cool project. I love cloud tooling but in some cases a l

I was going to suggest that you could post the code until I got to the bottom and you already had! Very cool project. I love cloud tooling but in some cases a local machine is something like 1000s of times cheaper. Best to mix and match and you get outrageous amounts of compute and efficiency for relatively little money. This reminds me of a similar project that might interest you. GPT-J is an open source alternative to GPT-3 made by a former Googler. I've read it works suprisingly well. People claim close to GPT-3. To run it people talk about using services like vast.ai. Don't get me wrong it's cool that exists, but I admit I've been tempted to build out a dedicated machine just to run this model in my basement. You need 24 GB of video memory to run it though so you're probably looking at around $4000 to build it (depending on graphics card prices). But! For that price you could have your own unmetered GPT-3 knock off in your basement, thereafter also for the price of electricity.