5 ms·

Care to explain what this does? I don’t get it from the readme

OneDeuxTriSeiGo 2y ago
It creates a "pngtuber" i.e. a static image vtuber. So you get a very limited amount of animation that is voice activated (basically animated discord speaking icons). It's used for streamers who are getting into vtubing but who can't yet afford a full vtubing rig (or the hardware to run it).
- aravindet 2y ago
  What's vtubing?
  - ronsor 2y ago
    > VTuber (Japanese: ブイチューバー, Hepburn: BuiChūbā) or virtual YouTuber (バーチャルユーチューバー, bācharu YūChūbā) is an online entertainer who uses a virtual avatar generated using computer graphics. https://en.wikipedia.org/wiki/Virtual_YouTuber https://en.wikipedia.org/wiki/Virtual_YouTuber
    - DidYaWipe 2y ago
      "a virtual avatar generated using computer graphics" So... an avatar. Let's all agree not to use this stupid "VTuber" term.
      - Sharlin 2y ago
        “Vtuber” refers to the the virtual persona but also the real person behind the avatar, cf. “Youtuber”, “blogger”. And “avatar” is a much less specific and less informative term than “vtuber”. And anyway the street finds its own names for things.
        DidYaWipe 2y ago
        Well, "the street" also huffs glue.
      - Kiro 2y ago
        Yeah, no. We will continue calling it VTuber whether you like it or not. You're also wrong.
        DidYaWipe 2y ago
        Except you haven't managed to show how. So... continue pushing ignorant blather.
  - OneDeuxTriSeiGo 2y ago
    The act of being a vtuber where vtuber means "virtual youtuber". Essentially youtubers or streamers in general who don't show their face but instead use an animated character model that is controlled by the user's face and/or body. Some fancier vtubers use mocap suits for this but generally it's done with phone or desktop based face tracking software. That then maps to control inputs for manipulating the rigged model. Examples: - https://www.youtube.com/watch?v=ELjB3xWC3F0 https://www.youtube.com/watch?v=ELjB3xWC3F0 - https://www.youtube.com/watch?v=944BE6_Brks https://www.youtube.com/watch?v=944BE6_Brks - https://www.youtube.com/watch?v=kxKH3EsI4dM https://www.youtube.com/watch?v=kxKH3EsI4dM - https://www.youtube.com/watch?v=e818LgnJ9rI https://www.youtube.com/watch?v=e818LgnJ9rI
    - ziddoap 2y ago
      That last video was pretty interesting with the side-by-side, showing how things are re-calibrated, etc. I figured that being a vtuber wasn't cheap, but that's a lot of (expensive looking) gear on top of the cost of the software, model, etc.
      - OneDeuxTriSeiGo 2y ago
        It really does depend. If you are doing full mocap with a rig it gets super expensive. If you are doing basic 3d you more or less just need a VR setup with hand and feet tracking (still not cheap). The cheapest hardware wise is your standard face tracking Live2D system. Pretty much just need an iphone (commonly used because they have good face tracking natively) or a webcam based face tracker. The thing that really makes vtubing expensive is the cost of getting a model. If you aren't making it all yourself, those commissions for the design and then the rigging can very quickly go from a few thousand dollars to well over 10k. And that video specifically is code miko. Her setup is one of the most expensive setups I've seen to be honest. She built the system herself however nowadays I think she pays a dedicated engineer to develop and maintain tooling for her bespoke setup. It's certainly not normal compared to most vtubers. Hardware-wise most vtubers don't have much more than a good microphone, a gaming PC, and an iphone (which is much easier to achieve than the setup code miko has)
    - 2y ago
- pryelluw 2y ago
  Thank you for answering. I needed the context in order to understand the code better (learning more rust).
joshdavham 2y ago
It'd be cool if maybe there was a quick video demo!
atoav 2y ago
Minimalist stop-motion-style avatar switching between two poses/images with an audio threshold level, giving the impression the avatar is talking.

It creates a "pngtuber" i.e. a static image vtuber. So you get a very limited amount of animation that is voice activated (basically animated discord speaking icons). It's used for streamers who are getting into vtubing but who can't yet afford a full vtubing rig (or the hardware to run it).

aravindet 2y ago
What's vtubing?
- ronsor 2y ago
  > VTuber (Japanese: ブイチューバー, Hepburn: BuiChūbā) or virtual YouTuber (バーチャルユーチューバー, bācharu YūChūbā) is an online entertainer who uses a virtual avatar generated using computer graphics. https://en.wikipedia.org/wiki/Virtual_YouTuber https://en.wikipedia.org/wiki/Virtual_YouTuber
  - DidYaWipe 2y ago
    "a virtual avatar generated using computer graphics" So... an avatar. Let's all agree not to use this stupid "VTuber" term.
    - Sharlin 2y ago
      “Vtuber” refers to the the virtual persona but also the real person behind the avatar, cf. “Youtuber”, “blogger”. And “avatar” is a much less specific and less informative term than “vtuber”. And anyway the street finds its own names for things.
      - DidYaWipe 2y ago
        Well, "the street" also huffs glue.
    - Kiro 2y ago
      Yeah, no. We will continue calling it VTuber whether you like it or not. You're also wrong.
      - DidYaWipe 2y ago
        Except you haven't managed to show how. So... continue pushing ignorant blather.
- OneDeuxTriSeiGo 2y ago
  The act of being a vtuber where vtuber means "virtual youtuber". Essentially youtubers or streamers in general who don't show their face but instead use an animated character model that is controlled by the user's face and/or body. Some fancier vtubers use mocap suits for this but generally it's done with phone or desktop based face tracking software. That then maps to control inputs for manipulating the rigged model. Examples: - https://www.youtube.com/watch?v=ELjB3xWC3F0 https://www.youtube.com/watch?v=ELjB3xWC3F0 - https://www.youtube.com/watch?v=944BE6_Brks https://www.youtube.com/watch?v=944BE6_Brks - https://www.youtube.com/watch?v=kxKH3EsI4dM https://www.youtube.com/watch?v=kxKH3EsI4dM - https://www.youtube.com/watch?v=e818LgnJ9rI https://www.youtube.com/watch?v=e818LgnJ9rI
  - ziddoap 2y ago
    That last video was pretty interesting with the side-by-side, showing how things are re-calibrated, etc. I figured that being a vtuber wasn't cheap, but that's a lot of (expensive looking) gear on top of the cost of the software, model, etc.
    - OneDeuxTriSeiGo 2y ago
      It really does depend. If you are doing full mocap with a rig it gets super expensive. If you are doing basic 3d you more or less just need a VR setup with hand and feet tracking (still not cheap). The cheapest hardware wise is your standard face tracking Live2D system. Pretty much just need an iphone (commonly used because they have good face tracking natively) or a webcam based face tracker. The thing that really makes vtubing expensive is the cost of getting a model. If you aren't making it all yourself, those commissions for the design and then the rigging can very quickly go from a few thousand dollars to well over 10k. And that video specifically is code miko. Her setup is one of the most expensive setups I've seen to be honest. She built the system herself however nowadays I think she pays a dedicated engineer to develop and maintain tooling for her bespoke setup. It's certainly not normal compared to most vtubers. Hardware-wise most vtubers don't have much more than a good microphone, a gaming PC, and an iphone (which is much easier to achieve than the setup code miko has)
  - 2y ago
pryelluw 2y ago
Thank you for answering. I needed the context in order to understand the code better (learning more rust).

joshdavham 2y ago

It'd be cool if maybe there was a quick video demo!

atoav 2y ago

Minimalist stop-motion-style avatar switching between two poses/images with an audio threshold level, giving the impression the avatar is talking.