5 ms·

Pretty cool. It's going to take a while to make it into a usable product though. Having conversations with people flailing their hands algorithmically is going

• kridsdale1 3y ago
  Every video game NPC is basically following such an algorithm.
  • tetrisgm 3y ago
    It's incorrect to generalize like this. NPCs maybe use broad procedural rules, full mocap or really anything in between. Yes, this could apply to them. No, it doesn't mean it always does. This also doesn't really add to the point that it wouldn't be suited to human conversation. You rarely use NPCs to have human like chats, especially for several minutes. The few games that do would be Mass Effect or LA Noire, both of which use mocap to avoid the effect I'm referring to.
  • alanbernstein 3y ago
    See this classic deep-learning based example: https://m.youtube.com/watch?v=pAsw16y3U-c https://m.youtube.com/watch?v=pAsw16y3U-c
• jillesvangurp 3y ago
  Like with audio, the challenges are going to be doing this in real time. You can have a conversation with e.g. chat gpt but it needs a few seconds to process what you say, come up with an answer, and then talk to you. It's a bit awkward. Imagine a version of that with an AI avatar like this. It would probably require quite a bit of performance improvements to get that to level of responsiveness that feels natural. And real life conversations are not just about talking realistically but also about non verbal communication when listening. So, it would have to adapt to what you are saying while your saying it for it to be completely natural. That being said, this is pretty awesome for a lot of use cases that are less interactive.