9 ms·
Animated AI
- i_like_apis 3y agoCool idea and I like the format. Transformer circuits and attention would be a cool thing too.
- api 3y agoI'm excited to see attention layers animated like this. I feel like I'm this close to grasping them.
- Animated-AI 3y agoHi! I'm the creator of the site. Good news: I'm currently working on animations and an explainer video on transformers and self-attention. The best way to be notified is probably to subscribe to my YouTube channel and hit the bell icon for notifications.
- imjonse 3y agoYou mean you would be excited to see attention animations? The page presents convolutions not attention.
- Greenpants 3y agoI still haven't found "that one visualisation" that makes the attention concept in Transformers as easily understood as these CNNs. If someone here on HN has a link to a page that has helped them get to the Eureka-point of fully grasping attention layers, feel free to share!
- juliangoldsmith 3y agoI found this video helpful for understanding transformers in general, but it covers attention too: https://www.youtube.com/watch?v=kWLed8o5M2Y https://www.youtube.com/watch?v=kWLed8o5M2Y The short version (as I understand it) is that you use a neural network to weight pairs of inputs by their importance to each other. That lets you get rid of unimportant information while keeping what actually is important.
- ahamm 3y agoThese are sweet - does anyone know how these animations are being generated?
- Uehreka 3y agoPretty sure these were animated in Blender. This feels pretty doable with Geometry Nodes, and the particular look of the blurred reflections in the floor trips my “it’s Blender” sense.
- johndough 3y agoYou are spot-on. In one of his videos, the author mentions that he used Blender's Geometry Nodes: https://www.youtube.com/watch?v=w4kNHKcBGzA&t=190s https://www.youtube.com/watch?v=w4kNHKcBGzA&t=190s
- qwertox 3y agoGreat use of colors. Initially I thought these were AI made, and that those animations are examples. But not being so really shows the effort put into this, these are great animations. Thanks for sharing. * And the videos on the YT channel are really worth watching.
- qwertyforce 3y agohttps://www.youtube.com/@animatedai/videos https://www.youtube.com/@animatedai/videos for visibility
- Animated-AI 3y agoHi! I'm the creator of the site. I'd just like to say thank you for posting this and for everyone that took the time to visit the site and/or my YouTube channel! Seeing people get value out of my content is what really makes the effort worthwhile.
- machinekob 3y agoThis is super good looking content i love also his youtube content.
- holtkam2 3y agoThese are great! Would love it if you had a section on RNNs / Transformers. I’d even pay for it.
- deleted 3y ago[deleted]
- Anita87 3y ago[flagged]
- pkdpic 3y agoThese are excellent! Can't wait to share them with some art folks Ive been trying to explain AI processes to and I can't wait to see more! Bravo :^)
- CyberDildonics 3y agoAccording to this page, scaling an image down is "AI".
- vidarh 3y agoClick through to the videos and you'll see that these are supporting animations that form part of explanations of specific algorithms.
- esafak 3y agoThe name of the site is misleading. A more accurate one might be "Animated CNN architecture diagrams". You need to know a bit about neural networks to make sense of these images. Watch the accompanying video, and compare with the images here: https://en.wikipedia.org/wiki/Convolutional_neural_network https://en.wikipedia.org/wiki/Convolutional_neural_network
- hunkins 3y agoLove visualizations like this, bravo. There is a mental stickiness to animations like this for me personally.
- ekianjo 3y agoNot very helpful to show blocks of only one color...
- niceice 3y agoBeautifully done. It reminds me of these wonderful 3D animated explainer videos https://www.youtube.com/@animagraffs https://www.youtube.com/@animagraffs.
- solardev 3y agoThis is really cool. Thanks! Just subbed.
- floatrock 3y agoI've often wished the pandas documentation had animations like this. The groupby/split-apply-combine pipeline could probably be explained in one 10-sec clip.
- dpflan 3y agoNicely designed. Here is another visualizer for CNNs, from research at Georgia Tech: https://poloclub.github.io/cnn-explainer/ https://poloclub.github.io/cnn-explainer/ Another link to various visualization tools: https://github.com/ashishpatel26/Tools-to-Design-or-Visualize-Architecture-of-Neural-Network https://github.com/ashishpatel26/Tools-to-Design-or-Visualiz... Another one: https://playground.tensorflow.org/ https://playground.tensorflow.org/
- butterlesstoast 3y agoThanks for sharing this as well! Love Georgia Tech!
- 3abiton 3y agoThere used to be this video explaining each layer of a neural network visually on youtube back in the days.
- laszlokorte 3y agoThanks for sharing! I especially like the "Understanding Hyperparameters" widget in the poloclub article. I built something similar that people might find helpful[1]. [1]: https://static.laszlokorte.de/conv2d/ https://static.laszlokorte.de/conv2d/
- dpflan 3y agoExcellent, thanks for sharing. These can be such good ways to learn and internalize intuition (and of course teach others!).
- westurner 3y agoManimML: https://github.com/helblazer811/ManimML https://github.com/helblazer811/ManimML "But what is a convolution?" https://youtu.be/KuXjwB4LzSA?si=qwnZMQYJhDxraGc8 https://youtu.be/KuXjwB4LzSA?si=qwnZMQYJhDxraGc8 https://github.com/3b1b/videos/tree/master/_2022/convolutions https://github.com/3b1b/videos/tree/master/_2022/convolution... https://github.com/3b1b/videos/tree/master/_2023/convolutions2 https://github.com/3b1b/videos/tree/master/_2023/convolution... "Convolution Is Fancy Multiplication" https://news.ycombinator.com/item?id=25190770#25194658 https://news.ycombinator.com/item?id=25190770#25194658 https://news.ycombinator.com/item?id=37953886 https://news.ycombinator.com/item?id=37953886 : > Manim, Blender, ipyblender, PhysX, o3de, [FEM, CFD, [thermal, fluidic,] engineering]: https://github.com/ManimCommunity/manim/issues/3362 https://github.com/ManimCommunity/manim/issues/3362 Manim + O3DE would be neat and probably useful for learning A Manim Rubik's cube algorithm video: https://github.com/polylog-cs/rubiks-cube-video/blob/main/code/rubik_mitm_solution.cpp https://github.com/polylog-cs/rubiks-cube-video/blob/main/co... Manim API docs: https://docs.manim.community/en/stable/reference.html https://docs.manim.community/en/stable/reference.html
- givemeethekeys 3y agoHi there, I realize that this is dumbed down "without the numbers". Is there a dumbed down "without the numbers" prerequisite I should look at? Thanks!
- renewiltord 3y agoAh, it's the convolutions part. It's a very nice visual demonstration. I'll subscribe on YT. Would be neat to see the other parts: attention and so on.
- seydor 3y agoI can imagine kindergartens using legos to teach children "And this is , children, how the multi-head attention works". Matrix algebra as used in AI is very good fit for geometric visualizations. But in the end , it doesn't explain Why it works so good or so human-like. Valuable kindergarten lesson though
- jlebar 3y agoShameless plug for a recent blog post of mine where I try to explain ML convolutions, https://jlebar.com/2023/9/11/convolutions.html https://jlebar.com/2023/9/11/convolutions.html
- deleted 3y ago[deleted]
- Vox_Leone 3y agoCongratulations. Great material, great site. Keep up the good work.
- anon_cow1111 3y agoThis is a nice project, but please don't hit people with 100+ mbs of gif images without a warning
- Animated-AI 3y agoHi! I'm the creator of the site. Thanks for pointing this out! The number of animations has grown over time, and I didn't realize how big the size has gotten. Do you have an idea in mind for how you'd like the site to behave? E.g., static images that play when you click/tap on them? Sections that are hidden until you expand them? Other ideas? Thanks!
- Zitrax 3y ago134 MB to be exact.
- deleted 3y ago[deleted]
- HenryBemis 3y agoIt should be tagged like "56k killer" like the good old days!
- jackblemming 3y agoHow about you Americans stop bending over for monopolies that make you worry about such trivial things in 2023?
- httpsterio 3y agoI think this might be less of an issue for HN browsing American nerds (who likely have great Internet connections) and more of an issue for people in developing countries or with poor network infrastructure.
- theelous3 3y agoI mean, you can stream netflix in rural Cambodia and not worry about data limits so I'm not so sure. Of course someone will be able to name somewhere this is a concern, but then you should be running browser extensions to manage media loading.
- ww520 3y agoExcellent visuals for ELI5 on complicated subjects. I especially like the use of different colors and 3D animations.
- blondie9x 3y agoThe author says in his videos images on web are wrong but then for the why says they are missing details mostly because they aren’t 3D. Isn’t that incomplete not wrong?
- SAI_Peregrinus 3y agoIncomplete is a strict subset of wrong. That doesn't mean it's not useful.
- andrecarol 3y ago[dead]
- asrael_io 3y agoThe later slices remind me of a gifted test I failed, because I rabbit holed on dividing the shapes...
- orena 3y agoVery cool! Now Conv3D.. I always wonder how to present a realistic Conv3D, as with channels it is actually 4D, it is an interesting challenge.
- jerpint 3y agoI made my own animations once upon a time using manim, not as shiny but might be helpful too https://www.jerpint.io/blog/cnn-cheatsheet/ https://www.jerpint.io/blog/cnn-cheatsheet/
- jwilber 3y agoFor interactive articles on specific ai algorithms, checkout Amazon’s mlu-explain: https://mlu-explain.github.io/ https://mlu-explain.github.io/
- cocochanel 3y agoPixel Shuffle is so satifying :)
- Bvlynicole 3y ago[dead]
- streakfix 3y agoVery nice illustrations.