4 ms·
One dimension that I think is pretty important is compute cost due to its effect on how they’re used. The chatbots are expensive to run, which means they’re imp
by skybrian 4y ago
One dimension that I think is pretty important is compute cost due to its effect on how they’re used. The chatbots are expensive to run, which means they’re implemented as request-response API’s that cost money, which means that loops are expensive and they normally don’t do any idle-time thinking.
When you play a turn-based game with a bot, that means you don’t need to worry about its reaction time. It’s paused most of the time, waiting on you. A sorcerer’s apprentice scenario isn’t going to happen when you’re single-stepping.
Moving to routine use of bots that run continuously with fast reaction times will be much more dangerous.
- jacquesm 4y agoYes, that's a very good point. Effectively it is 'ping pong' right now, when you get to always on + push things will change quite a bit. Model efficiency is a very active field.