4 ms·
Just need to figure out how to do AI inference without tanking rendering performance. Offloading AI stuff to a cloud would make single player games unplayable
by zirgs 3y ago
Just need to figure out how to do AI inference without tanking rendering performance.
Offloading AI stuff to a cloud would make single player games unplayable offline and their servers won't stay online forever.
Another solution would be to use a second GPU just for AI stuff. But that would make most current gaming devices useless.
- Aerroon 3y agoReal time might be difficult right now anyway. It takes too long to figure out what the AI would do with the more powerful LLMs. On the bright side, compute power is probably going to continue increasing. Consumers might be able to run current LLMs on home hardware in a decade or two.
- mywittyname 3y agoWe've already crossed the Rubicon of single player games that require internet connectivity and are unplayable if some server disappears. GPUs will probably get a PhysX-like API for these kind of AI calculations in the future.