What I've seen of current experiments with integrating LLMs into NPC conversations (I believe someone even got it integrated with a Skyrim mod, iic) is that to

What I've seen of current experiments with integrating LLMs into NPC conversations (I believe someone even got it integrated with a Skyrim mod, iic) is that to skirt around this issue, they just make HTTP requests to OpenAI or whatever. Game runs smoothly, but there's still a weird lag around NPC responses that makes it feel stilted and unnatural, and obviously relies on having a stable internet connection at all times.