I agree, GPT-2 makes an excellent writing companion. I actually developed my own version of talktotransformer.com to introduce some features that were missing f

I agree, GPT-2 makes an excellent writing companion. I actually developed my own version of talktotransformer.com to introduce some features that were missing from the public demo, including: * support for custom/fine-tuned/international GPT-2 models. Use any text generation model you want! * support for multiple outputs. Generate as many suggestions as you want! * support for customizing the prediction length. Can't think of that next word? You can effectively 'poll' the model by reducing the window size and increasing the number of suggestions: the most 'sensible' (or safe) choice usually appears most often. Or, go wild and let GPT-2 write the entirety of your boring, corporate email for you. * a more interactive user experience. No need to submit a blocking POST request and wait for the server to respond; just type '...' to (async) fetch a new batch of suggestions. The interface will update as soon as those predictions become available. Here's a video of the application brainstorming some new features for itself: https://streamable.com/jij614 https://streamable.com/jij614 I didn't realize talktotransformer.com had been taken down. I hadn't been in a hurry to publish the code, mainly because it's going to be a little tricky to distribute (you might have noticed in the video that the GPT-2 model is loaded into a Google Colab notebook that accepts GET requests, then queried remotely), but if people are interested I can absolutely give it a shot.