I know this is different than what the article is talking about, but I've wondered if something like a GPTZero would be possible. Train a model to reproduce ran

I know this is different than what the article is talking about, but I've wondered if something like a GPTZero would be possible. Train a model to reproduce random sequences, and see if it's able to learn any patterns that are also useful for language or other real-world tasks. If there's nothing to be gained from training on pure noise, what is the most generic and generally useful sequence we could train on?