You can constrain LLMs (like LLAMA) to only output certain tokens that match some schema (e.g. valid code syntax). I don't see why you can't get a LLM to outpu

You can constrain LLMs (like LLAMA) to only output certain tokens that match some schema (e.g. valid code syntax). I don't see why you can't get a LLM to output something like "research tech332; build city3 building24".