4 ms·
would love to learn more and help out on NPCs llms. What sort of performance hit are you seeing?
by moneywoes 3y ago
would love to learn more and help out on NPCs llms. What sort of performance hit are you seeing?
- joegibbs 3y agoSure, here's my writeup about it: https://jgibbs.dev/blogs/local-llm-npcs-in-unreal-engine https://jgibbs.dev/blogs/local-llm-npcs-in-unreal-engine. There's barely any performance hit, only a slight hitch when it starts generating a response.