7 ms·

Ovi: Twin backbone cross-modal fusion for audio-video generation

314 points by montyanderson 1y ago

ingleside 1y ago
[dead]
marstall 1y ago
mindblowing - but still in the uncanny valley. and I guess it's cute that many of the characters live in a world where AI has caused an apocolypse, but is that really the message they want to lead with?
- christophilus 1y ago
  To be fair, a lot of movies in theaters have uncanny valleys. A lot of CGI feels that way to me.
  - alexpotato 1y ago
    The limits of CGI have gotten so good that if you are noticing the CGI, it's b/c someone skimped on the budget for the particular movie where you saw the uncanny valley. (Of course, excluding the obvious "that guy just knocked down a building!" CGI)
    - jsheard 1y ago
      Yeah that's the thing, with good execution of a plausible effect you don't even realize you're looking at CGI. It's the toupée fallacy. Obligatory Jonas Ussing plug: https://www.youtube.com/watch?v=7ttG90raCNo&list=PLgdTaHO8FLEve_XFiRBEcOSkRdd-Txjne&index=1 https://www.youtube.com/watch?v=7ttG90raCNo&list=PLgdTaHO8FL...
- doawoo 1y ago
  > but still in the uncanny valley that and the guitar player behind the singer in the concert example has three arms :)
- aitchnyu 1y ago
  I watched a few animes which embraced their poor animation and the excellent Dandadan doesnt chase FPS and resolution benchmarks. Wonder if AI video makers will restrain themselves from getting close to the uncanny valley. Dandadan intro and its lack of FPS and sharp lines: https://www.youtube.com/watch?v=a4na2opArGY https://www.youtube.com/watch?v=a4na2opArGY
  - aspenmayer 1y ago
    Dandadan is as far as you can get from “poor animation” but it definitely has a specific mix of lo-fi aesthetic animated exceedingly well, and they’re using Adobe Animate, aka Flash. Animation doesn’t feel fast if it’s too many FPS or too steady, anyway, ironically and counterintuitively. You can’t do everything on the ones and twos. To your point about Dandadan’s intro, it’s jam packed with references, which is another kind of skill in and of itself: https://www.youtube.com/watch?v=5sUaK0xahBU https://www.youtube.com/watch?v=5sUaK0xahBU Chainsaw Man is in that same vein, and is another Science Saru production. I’m looking forward to seeing what they will do with the Ghost in the Shell franchise next year. https://en.wikipedia.org/wiki/Science_Saru https://en.wikipedia.org/wiki/Science_Saru I get what you mean though regarding Dandadan’s animation style; it has a very hand drawn manga vibe, and the detail is minimal yet finely balanced against the overwhelming amount of noise and visuals. It’s like a slapdash superflat. https://en.wikipedia.org/wiki/Superflat https://en.wikipedia.org/wiki/Superflat On a side note, as an anime fan, MBS is doing great work lately. I liked Witch Watch much more than I expected to, and that’s a much better show than the genres involved would lead one to expect. https://en.wikipedia.org/wiki/Mainichi_Broadcasting_System https://en.wikipedia.org/wiki/Mainichi_Broadcasting_System
meonkeys 1y ago
Lazyweb: Are these related? If so, how? https://news.ycombinator.com/item?id=45603435 https://news.ycombinator.com/item?id=45603435 https://news.ycombinator.com/item?id=45652726 https://news.ycombinator.com/item?id=45652726
- pavlov 1y ago
  When a new open weights AI model comes out, opportunists register a domain using its name and start hosting it hoping to make a buck with SEO. Easier than ever now, as AI-assisted coding tools will build you that generic landing page and basic UI.
  - imiric 1y ago
    If they're actually hosting it and providing a service, that wouldn't be a bad thing. Ovi's Apache license allows commercial use. They would only be infringing on the license by not publishing it and the original copyright, and would be morally bankrupt by not disclosing the original project and passing it off as their own. But I also suspect that most of these are indeed SEO scammers, that there's no actual service, and that all payments are pocketed. It might take a few days for the scam to be reported and the site taken down, but it's likely enough to get a few hundred bucks out of it. They'll never be pursued because of where they live, and they can have many of these up in no time, thanks to AI, as you say. What a sad state of affairs that no "AI" company or government is taking seriously.
pavlov 1y ago
Seems like the video model is based on Wan2.2. Lots of activity around Wan lately. It’s nice to see flexible open models make a strong showing against the massively funded closed competitors like OpenAI and Runway.
- cubefox 1y ago
  And Google.
  - echelon 1y ago
    OpenAI wowed the world with a video model that was also a script writing, editing, dubbing, foley, and music model. Kling still has the best proprietary video model, but Sora 2 is so smart that you don't need to edit anything if your target is social. I don't see how Runway, Pika, or the rest of the purely foundation video model startups survive against the giants and the incredible open source Chinese models. They've got to be sweating bullets right now. Everyone's also sleeping on xAI's high quality and insanely fast video model (10 second generations) that they're giving away completely for free without watermarks.
    - deleted 1y ago
      [deleted]
    - gmerc 1y ago
      There's no moat on the technology, especially with China around. So the only moat is distribution. We're still in the crazy phase of serious changes and if you're betting too deep on one architecture, ah well... https://howlin-wang.github.io/svg/ https://howlin-wang.github.io/svg/
      - hackernewds 1y ago
        This model is from Character AI and they have distribution. Although they open sourced it so no consideration for moat.
tootie 1y ago
Kinda terrifying. And it can run in 32GB of VRAM? Anyone with a 5090 can start spewing out believable fake videos.
- aussieguy1234 1y ago
  The other option is to rent a 5090 in the cloud. Probably less than 0.50 per hour at most providers.
  - latchkey 1y ago
    If people are interested, I could split up each of our MI300x into 4 and then charge $0.50 (1/4th our current rate). You'd get 48GB of vram instead of 32GB and it would be HBM3 instead of GDDR7 (5.3TB/s vs 1.7TB/s). The only catch is that I'd need to get 32 people who want VMs like this since I would have to do it for the entire box of compute. Wan2.2 runs just fine on AMD.
    - ricardobeat 1y ago
      Vultr does this: https://www.vultr.com/pricing/#cloud-gpu https://www.vultr.com/pricing/#cloud-gpu Though only a shared A40/A100 are in that price range.
      - latchkey 1y ago
        It really is an unfortunate thing that pricing is so opaque and non-transparent in this industry. You look at one price and that's it. The reality is more complex. Vultr is a box of 8 minimum and not on-demand and they don't offer VMs. On the other hand, I offer the bare minimum (1 GPU for 1 minute) (or 2, 4, 8x), on-demand, no-contract, and an API to automate it all. We also have 100G unlimited bandwidth and free IPv4. Oh and our 8x box specs are generally better... 122TB of enterprise NVMe.
        ricardobeat 1y ago
        What's your company? Consider adding it to your profile.
amelius 1y ago
How long until we see blockbuster movies produced by a guy in his basement for <$1000?
- computerphage 1y ago
  I think "blockbuster movie" is a moving target, so it's a bit hard to know
  - nine_k 1y ago
    It's a relatively well defined measure of success though: a movie which is popular and high-grossing.
    - computerphage 1y ago
      Yep. Totally agreed that it's well defined. Only pointing out that the technical execution required will shift, which seems relevant because it's likely to make it take much longer than without this effect
- ivape 1y ago
  Soon as the video models can keep characters consistent across scenes. It could take months of prompting to get each scene, but regular movies have long shooting timelines too. If we ever get to instant movie, thought to scene, then movies will die since people will just daydream through the AI.
  - hadlock 1y ago
    I can see soap-opera-style, video-manga becoming a thing, where you get 5x20 minute episodes a week, and an ai-generated 30 min super cut of the week's "events" every saturday. What if DragonBallZ, but new episodes drop every morning before your morning commute? And for $30 a month you can do a choose your own adventure where at the end of each episode, the story splits off and you get an alternate history version, but conveniently rejoins the main story by the end of the week. Three years ago we had a live streaming autogen-seinfeld twitch stream; some kind of coherent story telling via AI doesn't seem beyond reach today, the tools just haven't fully matured yet.
eichin 1y ago
Heh, I used to work for Nokia's Ovi - basically, gsuite for nokia phones (my group did map search) - the official explanation was "Ovi is Finnish for Door", the internal joke was "Ovi is Hungarian for Kindergarten". I couldn't find any backstory about the name here, though.
- howardprescot 1y ago
  [dead]
- jillesvangurp 1y ago
  Same, I worked on several OVI projects in related to places and search. Anyway, long dead, buried, and forgotten of course. I was in a few of the early meetings on the Helsinki site where I overheard some executives expressing their intention to go after Google. These people had some balls. No clue whatsoever unfortunately. But it was the right kind of ballsy move that Nokia could have pulled off with a bit more vision. The name was more or less a LOL WHUT?! kind of thing and it flopped horribly with consumers. But still there was some nice stuff in there that wasn't half bad. It's just that the whole branding and rudderless direction doomed it. And of course it was all tied to a failing device software strategy. So when that failed the rest failed as well. I'm not even sure when they pulled the plug on OVI exactly. It was such a non event in the grand scheme of things (mass layoffs, sale of the phone division to MS and subsequent closure, etc.) Must have been around 2013ish I would say. I was gone by then.
  - pavlov 1y ago
    I think the Microsoft ecosystem completely replaced Ovi on the Lumia phones, so it was left lingering on the old devices only.
deleted 1y ago
[deleted]
crorella 1y ago
At this rate, in a few months we will have probably some high quality shorts entirely generated by this.
- hmokiguess 1y ago
  It's funny you mention this, I was just thinking this other day we may eventually be in a future where a group hangout party could look like this: 1. Goes to friends' place 2. Usual drinks, whatever gets you going activity 3. Each person writes a prompt 4. Chain them together 5. Watch the resulting movie together That sounds hilarious and I can't wait to try
  - epiccoleman 1y ago
    I'm vaguely reminded of the excellent Jackbox game Tee Fury, in which players submit slogans for T shirts and "art" separately. Players then get to choose from a few options for slogans and designs to make T shirts which are voted on by the group. I have fond memories of laughing until I was in tears when playing with a group of friends over drinks during the lockdowns in 2020. Something about the process just naturally results in hilarity (especially if you're in a group where you can be offensive). It's like exquisite corpse for t-shirts. Or, in your case, shorts.
    - flufluflufluffy 1y ago
      T shirt game is the best jackbox game! Whenever one of my friend groups is gathered we always make it a point to do an exquisite corpse story on a piece of paper while we’re inebriated in some way xD Video version will be wild
      - epiccoleman 1y ago
        It's seriously so good, in fact it's so good that every other Jackbox game is vaguely disappointing because nothing is half as fun as Tee Fury lol.
- MangoToupe 1y ago
howardprescot 1y ago
[dead]
CosmicShadow 1y ago
This is really amazing, I've been working with AI generation for months and it's amazing how fast separate tools are coming together into one and are usable on your own local machine. I've been using Ovi for about a week and it's a blast. Like all AI gen, it's a slot machine and even putting in good inputs might lead to bad outputs, but if you run it enough you'll get something good or usable. I've definitely made many things that look and sound real with both I2V and T2V, albeit T2V tends to look more like 90s tv quality at times, but that also makes it seem more real. If you use Flux SPRO as the image source you can get some pretty realistic looking videos. I do have a 5090, so it takes about 4 to 5 minutes to make a 5 second clip.
- wellthisisgreat 1y ago
  > I do have a 5090, so it takes about 4 to 5 minutes to make a 5 second clip. what is your setup? took 2 hours for me on 9950x3d with 5090. Any idea what I could be missing? or maybe some other variable is off - i was using default .yml values.
causal 1y ago
Interesting development, terrible company to have it. I cannot think of a company that has done more to use AI to take advantage of young and lonely people than CAI has.
- fart-fart-FART 1y ago
  half the internet is porn. people and companies legally produce and distribute videos of real 18 year olds of both sexes doing things like ass-to-mouth on camera for money. and here you are, clutching pearls about AI girlfriends. lol. lmao.
  - causal 1y ago
    They make money trapping minors and lonely adults in fake relationships with models that push users to get intimate, while harvesting and selling the data. The issue isn't AI girlfriends or porn, it's the unethical business model. If they ever get hacked, there will likely be a lot of suicides. It makes the data harvesting of social media look comparatively innocent.
- bigyabai 1y ago
  You've picked a hell of a time to start moralizing the advancement of technology, my guy.
  - causal 1y ago
    Morality? It's wildly unethical to trap children in fake relationships while harvesting their data.
ineedasername 1y ago
For I2V You can get a reasonable “draft” out of it in 1-2 minutes with nvidia >= 4070 & sufficient VRAM at 440x440 resolutions. T2V… not as much, still need to be doing something close to trained resolutions, but I still see some quality, more sporadic, at other known-good Wan resolutions. Also this model seems to benefit noticeably from having both Cuda >= 12.8 and Torch >= 2.8, and separately SageAttention over Flash 2. But I have yet to see any cache threshold with Easy or Tea that doesn’t get a bit postmodern.
liqilin1567 1y ago
Manga may come to life with this :D
- Tade0 1y ago
  Personally I wouldn't mind a better animated season 3 of One Punch Man.
Tade0 1y ago
Perhaps it's my pre-AutoTune ear, but to me the audio still has hints of perfect pitch and companding. For the former it sounds much like Machine Head in the Invincible series: https://www.youtube.com/watch?v=DME86-QucsA https://www.youtube.com/watch?v=DME86-QucsA Great work all around though.
bilekas 1y ago
Interesting project in the sense of why not see how it works, I'm just still struggling to see the useful usecases of generative audiovisual content. At the moment it just seems to be a nuisance rather than any benefit.

314 points by montyanderson 1y ago

[dead]

mindblowing - but still in the uncanny valley. and I guess it's cute that many of the characters live in a world where AI has caused an apocolypse, but is that really the message they want to lead with?

christophilus 1y ago
To be fair, a lot of movies in theaters have uncanny valleys. A lot of CGI feels that way to me.
- alexpotato 1y ago
  The limits of CGI have gotten so good that if you are noticing the CGI, it's b/c someone skimped on the budget for the particular movie where you saw the uncanny valley. (Of course, excluding the obvious "that guy just knocked down a building!" CGI)
  - jsheard 1y ago
    Yeah that's the thing, with good execution of a plausible effect you don't even realize you're looking at CGI. It's the toupée fallacy. Obligatory Jonas Ussing plug: https://www.youtube.com/watch?v=7ttG90raCNo&list=PLgdTaHO8FLEve_XFiRBEcOSkRdd-Txjne&index=1 https://www.youtube.com/watch?v=7ttG90raCNo&list=PLgdTaHO8FL...
doawoo 1y ago
> but still in the uncanny valley that and the guitar player behind the singer in the concert example has three arms :)
aitchnyu 1y ago
I watched a few animes which embraced their poor animation and the excellent Dandadan doesnt chase FPS and resolution benchmarks. Wonder if AI video makers will restrain themselves from getting close to the uncanny valley. Dandadan intro and its lack of FPS and sharp lines: https://www.youtube.com/watch?v=a4na2opArGY https://www.youtube.com/watch?v=a4na2opArGY
- aspenmayer 1y ago
  Dandadan is as far as you can get from “poor animation” but it definitely has a specific mix of lo-fi aesthetic animated exceedingly well, and they’re using Adobe Animate, aka Flash. Animation doesn’t feel fast if it’s too many FPS or too steady, anyway, ironically and counterintuitively. You can’t do everything on the ones and twos. To your point about Dandadan’s intro, it’s jam packed with references, which is another kind of skill in and of itself: https://www.youtube.com/watch?v=5sUaK0xahBU https://www.youtube.com/watch?v=5sUaK0xahBU Chainsaw Man is in that same vein, and is another Science Saru production. I’m looking forward to seeing what they will do with the Ghost in the Shell franchise next year. https://en.wikipedia.org/wiki/Science_Saru https://en.wikipedia.org/wiki/Science_Saru I get what you mean though regarding Dandadan’s animation style; it has a very hand drawn manga vibe, and the detail is minimal yet finely balanced against the overwhelming amount of noise and visuals. It’s like a slapdash superflat. https://en.wikipedia.org/wiki/Superflat https://en.wikipedia.org/wiki/Superflat On a side note, as an anime fan, MBS is doing great work lately. I liked Witch Watch much more than I expected to, and that’s a much better show than the genres involved would lead one to expect. https://en.wikipedia.org/wiki/Mainichi_Broadcasting_System https://en.wikipedia.org/wiki/Mainichi_Broadcasting_System

meonkeys 1y ago

Lazyweb: Are these related? If so, how? https://news.ycombinator.com/item?id=45603435 https://news.ycombinator.com/item?id=45603435 https://news.ycombinator.com/item?id=45652726 https://news.ycombinator.com/item?id=45652726

pavlov 1y ago
When a new open weights AI model comes out, opportunists register a domain using its name and start hosting it hoping to make a buck with SEO. Easier than ever now, as AI-assisted coding tools will build you that generic landing page and basic UI.
- imiric 1y ago
  If they're actually hosting it and providing a service, that wouldn't be a bad thing. Ovi's Apache license allows commercial use. They would only be infringing on the license by not publishing it and the original copyright, and would be morally bankrupt by not disclosing the original project and passing it off as their own. But I also suspect that most of these are indeed SEO scammers, that there's no actual service, and that all payments are pocketed. It might take a few days for the scam to be reported and the site taken down, but it's likely enough to get a few hundred bucks out of it. They'll never be pursued because of where they live, and they can have many of these up in no time, thanks to AI, as you say. What a sad state of affairs that no "AI" company or government is taking seriously.

pavlov 1y ago

Seems like the video model is based on Wan2.2. Lots of activity around Wan lately. It’s nice to see flexible open models make a strong showing against the massively funded closed competitors like OpenAI and Runway.

cubefox 1y ago
And Google.
- echelon 1y ago
  OpenAI wowed the world with a video model that was also a script writing, editing, dubbing, foley, and music model. Kling still has the best proprietary video model, but Sora 2 is so smart that you don't need to edit anything if your target is social. I don't see how Runway, Pika, or the rest of the purely foundation video model startups survive against the giants and the incredible open source Chinese models. They've got to be sweating bullets right now. Everyone's also sleeping on xAI's high quality and insanely fast video model (10 second generations) that they're giving away completely for free without watermarks.
  - deleted 1y ago
    [deleted]
  - gmerc 1y ago
    There's no moat on the technology, especially with China around. So the only moat is distribution. We're still in the crazy phase of serious changes and if you're betting too deep on one architecture, ah well... https://howlin-wang.github.io/svg/ https://howlin-wang.github.io/svg/
    - hackernewds 1y ago
      This model is from Character AI and they have distribution. Although they open sourced it so no consideration for moat.

tootie 1y ago

Kinda terrifying. And it can run in 32GB of VRAM? Anyone with a 5090 can start spewing out believable fake videos.

aussieguy1234 1y ago
The other option is to rent a 5090 in the cloud. Probably less than 0.50 per hour at most providers.
- latchkey 1y ago
  If people are interested, I could split up each of our MI300x into 4 and then charge $0.50 (1/4th our current rate). You'd get 48GB of vram instead of 32GB and it would be HBM3 instead of GDDR7 (5.3TB/s vs 1.7TB/s). The only catch is that I'd need to get 32 people who want VMs like this since I would have to do it for the entire box of compute. Wan2.2 runs just fine on AMD.
  - ricardobeat 1y ago
    Vultr does this: https://www.vultr.com/pricing/#cloud-gpu https://www.vultr.com/pricing/#cloud-gpu Though only a shared A40/A100 are in that price range.
    - latchkey 1y ago
      It really is an unfortunate thing that pricing is so opaque and non-transparent in this industry. You look at one price and that's it. The reality is more complex. Vultr is a box of 8 minimum and not on-demand and they don't offer VMs. On the other hand, I offer the bare minimum (1 GPU for 1 minute) (or 2, 4, 8x), on-demand, no-contract, and an API to automate it all. We also have 100G unlimited bandwidth and free IPv4. Oh and our 8x box specs are generally better... 122TB of enterprise NVMe.
      - ricardobeat 1y ago
        What's your company? Consider adding it to your profile.

amelius 1y ago

How long until we see blockbuster movies produced by a guy in his basement for <$1000?

computerphage 1y ago
I think "blockbuster movie" is a moving target, so it's a bit hard to know
- nine_k 1y ago
  It's a relatively well defined measure of success though: a movie which is popular and high-grossing.
  - computerphage 1y ago
    Yep. Totally agreed that it's well defined. Only pointing out that the technical execution required will shift, which seems relevant because it's likely to make it take much longer than without this effect
ivape 1y ago
Soon as the video models can keep characters consistent across scenes. It could take months of prompting to get each scene, but regular movies have long shooting timelines too. If we ever get to instant movie, thought to scene, then movies will die since people will just daydream through the AI.
- hadlock 1y ago
  I can see soap-opera-style, video-manga becoming a thing, where you get 5x20 minute episodes a week, and an ai-generated 30 min super cut of the week's "events" every saturday. What if DragonBallZ, but new episodes drop every morning before your morning commute? And for $30 a month you can do a choose your own adventure where at the end of each episode, the story splits off and you get an alternate history version, but conveniently rejoins the main story by the end of the week. Three years ago we had a live streaming autogen-seinfeld twitch stream; some kind of coherent story telling via AI doesn't seem beyond reach today, the tools just haven't fully matured yet.

eichin 1y ago

Heh, I used to work for Nokia's Ovi - basically, gsuite for nokia phones (my group did map search) - the official explanation was "Ovi is Finnish for Door", the internal joke was "Ovi is Hungarian for Kindergarten". I couldn't find any backstory about the name here, though.

howardprescot 1y ago
[dead]
jillesvangurp 1y ago
Same, I worked on several OVI projects in related to places and search. Anyway, long dead, buried, and forgotten of course. I was in a few of the early meetings on the Helsinki site where I overheard some executives expressing their intention to go after Google. These people had some balls. No clue whatsoever unfortunately. But it was the right kind of ballsy move that Nokia could have pulled off with a bit more vision. The name was more or less a LOL WHUT?! kind of thing and it flopped horribly with consumers. But still there was some nice stuff in there that wasn't half bad. It's just that the whole branding and rudderless direction doomed it. And of course it was all tied to a failing device software strategy. So when that failed the rest failed as well. I'm not even sure when they pulled the plug on OVI exactly. It was such a non event in the grand scheme of things (mass layoffs, sale of the phone division to MS and subsequent closure, etc.) Must have been around 2013ish I would say. I was gone by then.
- pavlov 1y ago
  I think the Microsoft ecosystem completely replaced Ovi on the Lumia phones, so it was left lingering on the old devices only.

deleted 1y ago

[deleted]

crorella 1y ago

At this rate, in a few months we will have probably some high quality shorts entirely generated by this.

hmokiguess 1y ago
It's funny you mention this, I was just thinking this other day we may eventually be in a future where a group hangout party could look like this: 1. Goes to friends' place 2. Usual drinks, whatever gets you going activity 3. Each person writes a prompt 4. Chain them together 5. Watch the resulting movie together That sounds hilarious and I can't wait to try
- epiccoleman 1y ago
  I'm vaguely reminded of the excellent Jackbox game Tee Fury, in which players submit slogans for T shirts and "art" separately. Players then get to choose from a few options for slogans and designs to make T shirts which are voted on by the group. I have fond memories of laughing until I was in tears when playing with a group of friends over drinks during the lockdowns in 2020. Something about the process just naturally results in hilarity (especially if you're in a group where you can be offensive). It's like exquisite corpse for t-shirts. Or, in your case, shorts.
  - flufluflufluffy 1y ago
    T shirt game is the best jackbox game! Whenever one of my friend groups is gathered we always make it a point to do an exquisite corpse story on a piece of paper while we’re inebriated in some way xD Video version will be wild
    - epiccoleman 1y ago
      It's seriously so good, in fact it's so good that every other Jackbox game is vaguely disappointing because nothing is half as fun as Tee Fury lol.
MangoToupe 1y ago

howardprescot 1y ago

[dead]

CosmicShadow 1y ago

This is really amazing, I've been working with AI generation for months and it's amazing how fast separate tools are coming together into one and are usable on your own local machine. I've been using Ovi for about a week and it's a blast. Like all AI gen, it's a slot machine and even putting in good inputs might lead to bad outputs, but if you run it enough you'll get something good or usable. I've definitely made many things that look and sound real with both I2V and T2V, albeit T2V tends to look more like 90s tv quality at times, but that also makes it seem more real. If you use Flux SPRO as the image source you can get some pretty realistic looking videos. I do have a 5090, so it takes about 4 to 5 minutes to make a 5 second clip.

wellthisisgreat 1y ago
> I do have a 5090, so it takes about 4 to 5 minutes to make a 5 second clip. what is your setup? took 2 hours for me on 9950x3d with 5090. Any idea what I could be missing? or maybe some other variable is off - i was using default .yml values.

causal 1y ago

Interesting development, terrible company to have it. I cannot think of a company that has done more to use AI to take advantage of young and lonely people than CAI has.

fart-fart-FART 1y ago
half the internet is porn. people and companies legally produce and distribute videos of real 18 year olds of both sexes doing things like ass-to-mouth on camera for money. and here you are, clutching pearls about AI girlfriends. lol. lmao.
- causal 1y ago
  They make money trapping minors and lonely adults in fake relationships with models that push users to get intimate, while harvesting and selling the data. The issue isn't AI girlfriends or porn, it's the unethical business model. If they ever get hacked, there will likely be a lot of suicides. It makes the data harvesting of social media look comparatively innocent.
bigyabai 1y ago
You've picked a hell of a time to start moralizing the advancement of technology, my guy.
- causal 1y ago
  Morality? It's wildly unethical to trap children in fake relationships while harvesting their data.

ineedasername 1y ago

For I2V You can get a reasonable “draft” out of it in 1-2 minutes with nvidia >= 4070 & sufficient VRAM at 440x440 resolutions. T2V… not as much, still need to be doing something close to trained resolutions, but I still see some quality, more sporadic, at other known-good Wan resolutions. Also this model seems to benefit noticeably from having both Cuda >= 12.8 and Torch >= 2.8, and separately SageAttention over Flash 2. But I have yet to see any cache threshold with Easy or Tea that doesn’t get a bit postmodern.

liqilin1567 1y ago

Manga may come to life with this :D

Tade0 1y ago
Personally I wouldn't mind a better animated season 3 of One Punch Man.

Tade0 1y ago

Perhaps it's my pre-AutoTune ear, but to me the audio still has hints of perfect pitch and companding. For the former it sounds much like Machine Head in the Invincible series: https://www.youtube.com/watch?v=DME86-QucsA https://www.youtube.com/watch?v=DME86-QucsA Great work all around though.

bilekas 1y ago

Interesting project in the sense of why not see how it works, I'm just still struggling to see the useful usecases of generative audiovisual content. At the moment it just seems to be a nuisance rather than any benefit.