For the casually curious, the reason it frequently pops up real words with fake definitions is (roughly speaking) one of the steps in the ML code is a dictionar

For the casually curious, the reason it frequently pops up real words with fake definitions is (roughly speaking) one of the steps in the ML code is a dictionary check which tries to stop the model from generating existing words, since there’s a lot of combinations of word like phonemes that are actually already words, so the training data is going to naturally generate a lot of existing words without a rejection stage, and the rejection stage is based on a dictionary. I’ve spent a fair bit of time working with this code (I’m not the original author) as I sort of decided it was a small enough ML project it would be a good way to learn how to work with some real world practical ML code, and it’s been quite educational, mostly in the realm of Torch and other ML dependencies and how important it can be to keep on top of them. My own fork runs well in a current python environment on my M1 MacBook Pro but due to architectural limitations I haven’t yet been able to get the code in a format where I can benefit from the M1s ML acceleration hardware, mostly due to the Transformer library using torchscript and preventing a lot of Tracing/Scripting that Apple’s libraries need to use in order to generate the accelerated model code. It’s been pretty fun and I’ve actually got a prototype product that uses my code, still noodling at the best business model since charging for “here’s this list of <data>, I’ve done the hard work for you” is a little awkward when you’re preprocessing all the data so that you can serve potential customers in a timely way. There’s a lot of background processing, Trademark Databases, social media scanning, fast DNS based and slower Whois based domain name lookups for the dozens of TLDs gTLDs, and ccTLDs… far too much to do real time after generating a fresh result from the ml model itself. If anyone is curious feel free to contact me, (info in profile) it’s not yet in a position to link to a website since the UI will naturally depend a fair bit on the eventual business model may or may not come up with. Neat to see it on the front page again.