It really depends on the use case, which the author didn't hint to (sure, they say procedurally generating text, but exactly how and for what reason?). But what

It really depends on the use case, which the author didn't hint to (sure, they say procedurally generating text, but exactly how and for what reason?). But whatever it is, I assume it needs to be accurate to some degree, and having a deterministic ruleset is just too subjective and superficial to cover all cases. It doesn't need to be a full-fledged LLM either. What I mean is that a probabilistic machine learning model trained on a sufficiently large dataset is probably a better choice here. Small language models are pretty efficient nowadays, even for on-device use cases with constrained resources.