In the case of text generation, we call this "Constrained Text Generation" and it is an active field of research. Without going into too many details (I have a

In the case of text generation, we call this "Constrained Text Generation" and it is an active field of research. Without going into too many details (I have a paper out for review about this), it's pretty trivial to get "interactive control over how much or how little the AI generates" by a combination of filters on the LMs vocabulary, and effective selection of the various hyperparamaters in the decoder (top_p, top_k, temperature)...