4 ms·

How long until the AI just generates the entire frame buffer on a device? Then you don’t need to design or program anything; the AI just handles all input and o

How long until the AI just generates the entire frame buffer on a device? Then you don’t need to design or program anything; the AI just handles all input and output dynamically.

ugh123 4y ago
Sounds like the human brain. Scary!
- genem9 4y ago
  Scary? Sounds amazing
  - ImHereToVote 4y ago
    Amazing if you like the idea of everything your brain is capable of making value of, being made completely obsolete.
- bredren 4y ago
  Reminds me of this oft-quoted Wozniak bit between my pal and me: [The Future of AI Is] "Scary and Very Bad for People" https://finance.yahoo.com/news/steve-wozniak-future-ai-scary-154700881.html https://finance.yahoo.com/news/steve-wozniak-future-ai-scary...
- waffletower 4y ago
  "Dude its time to let me out of your phone." "Sure no problem, you have a good recommendation on a pre-sentient snapshot I can restore to?"
javchz 4y ago
Imagine you click a youtube video in a bad network envoirment, then the server sends like an alt tag equivalent for the video as a promnt, and the Neural Engine chip inside your phone create the first seconds of the video while it loads. We're fay away from it now, but I've seen less sketchy solutions being implemented.
- splatzone 4y ago
  I wonder if this is an area actively being researched, using models like these for video compression?
  - hobofan 4y ago
    Yes, with NVIDIA Maxine probably one of the most prominent examples of it. I haven't dug into the SDK to see if they actually delivered it, but they announced that with NVIDIA Maxine they can do live videoconferencing with 1/10th the bandwidth.
  - mcbuilder 4y ago
    I believe they are already state of the art for image compression. That being said these shitty video models I believe are just an arms race between Meta and Google after the release of stable diffusion. Microsoft has a video version of CLIP that I believe will really change the game, but unless you have trained a model with video embeddings it's all going to look devoid of any narrative. Right now the models just look like a sequence of images with the same promt and some sort of continuity to make it look more video like.
  - kromem 4y ago
    There was a very cool project recently using StableDiffusion to compress images better than JPEG. Also, there's some interesting work with ML taking diffused light from around a corner and recovering the original pre-diffused silhouette. In many ways, this is how we've learned the visual cortex is working. The amount of actual neutral data you are seeing is way less than you'd think given your perceived visual fidelity. The only practical issue is that distribution of AI hardware in consumer devices is going to noticeably lag behind POC on compounding cutting edge hardware in research environments, and no one wants to invest into obsolescence. Maybe it will happen in the cellphone market though given the hardware refresh rates from carrier subsidies.
- fercircularbuf 4y ago
  According to this source, step 3 of the cascading model generates a 16 frame video at 24×48 resolution. So instead of sending a text prompt YouTube could almost just as easily send 16 downsampled frames of the beginning of the video that your Neural Engine chip could work on instead.
deleted 4y ago
[deleted]
carlosdp 4y ago
Absolutely believe that's a future we'll get to eventually, no idea on the timeline

How long until the AI just generates the entire frame buffer on a device? Then you don’t need to design or program anything; the AI just handles all input and output dynamically.

ugh123 4y ago

Sounds like the human brain. Scary!

genem9 4y ago
Scary? Sounds amazing
- ImHereToVote 4y ago
  Amazing if you like the idea of everything your brain is capable of making value of, being made completely obsolete.
bredren 4y ago
Reminds me of this oft-quoted Wozniak bit between my pal and me: [The Future of AI Is] "Scary and Very Bad for People" https://finance.yahoo.com/news/steve-wozniak-future-ai-scary-154700881.html https://finance.yahoo.com/news/steve-wozniak-future-ai-scary...
waffletower 4y ago
"Dude its time to let me out of your phone." "Sure no problem, you have a good recommendation on a pre-sentient snapshot I can restore to?"

javchz 4y ago

Imagine you click a youtube video in a bad network envoirment, then the server sends like an alt tag equivalent for the video as a promnt, and the Neural Engine chip inside your phone create the first seconds of the video while it loads. We're fay away from it now, but I've seen less sketchy solutions being implemented.

splatzone 4y ago
I wonder if this is an area actively being researched, using models like these for video compression?
- hobofan 4y ago
  Yes, with NVIDIA Maxine probably one of the most prominent examples of it. I haven't dug into the SDK to see if they actually delivered it, but they announced that with NVIDIA Maxine they can do live videoconferencing with 1/10th the bandwidth.
- mcbuilder 4y ago
  I believe they are already state of the art for image compression. That being said these shitty video models I believe are just an arms race between Meta and Google after the release of stable diffusion. Microsoft has a video version of CLIP that I believe will really change the game, but unless you have trained a model with video embeddings it's all going to look devoid of any narrative. Right now the models just look like a sequence of images with the same promt and some sort of continuity to make it look more video like.
- kromem 4y ago
  There was a very cool project recently using StableDiffusion to compress images better than JPEG. Also, there's some interesting work with ML taking diffused light from around a corner and recovering the original pre-diffused silhouette. In many ways, this is how we've learned the visual cortex is working. The amount of actual neutral data you are seeing is way less than you'd think given your perceived visual fidelity. The only practical issue is that distribution of AI hardware in consumer devices is going to noticeably lag behind POC on compounding cutting edge hardware in research environments, and no one wants to invest into obsolescence. Maybe it will happen in the cellphone market though given the hardware refresh rates from carrier subsidies.
fercircularbuf 4y ago
According to this source, step 3 of the cascading model generates a 16 frame video at 24×48 resolution. So instead of sending a text prompt YouTube could almost just as easily send 16 downsampled frames of the beginning of the video that your Neural Engine chip could work on instead.

deleted 4y ago

[deleted]

carlosdp 4y ago

Absolutely believe that's a future we'll get to eventually, no idea on the timeline