> I've started to suspect that generating code is actually one of the easier things for a predictive text completion model to achieve. > Programming languages

> I've started to suspect that generating code is actually one of the easier things for a predictive text completion model to achieve. > Programming languages are a whole lot more structured and predictable than human language. > In JavaScript the only token that ever comes after "if " is "(" for example. But isn't that like saying that it's easy to generate English text, all you need is a dictionary table where you randomly pick words? (BTW, keep up the blog posts, I really enjoy them!)