4 ms·

Visualizing large dimensional matrices is a way of starting to develop intuition about llms. If you can't visualize high dimensional spaces, and you haven't stu

Visualizing large dimensional matrices is a way of starting to develop intuition about llms. If you can't visualize high dimensional spaces, and you haven't studied llms, you're not going to have any intuition about how they work. Depending on your knowledge of math, I recommend starting with linear algebra, building an understanding of the equations and try to visualize more and more complex systems, then study llms to see how you can apply your linear algebra intuition to your understanding of llms. VTK is a great toolkit for visualizing complex systems. 3 blue one brown on YouTube has other visuals that might help you. It takes time but it's possible. Good luck.

dominotw 1mo ago
you are just dancing around the question without addressing it directly. > Visualizing large dimensional matrices is a way of starting to develop intuition about llms. one last time before i disengage. how do you know this and what intuitions have you personally developed.
- megaloblasto 1mo ago
  In my understanding of the word intuition, it comes from a deep understanding of a concept that allows you to know why certain things happen with a "gut feeling", almost unconsciously. For example, I can intuit where my feet should move while jumping over river rocks, but I can't explain to you how to do it. I can only suggest that you spend a lot of time jumping on river rocks to develop the intuition. I've spent a great deal of time studying llms and NN architectures in general. This allows me to intuit things about them and that intuitive understanding for my comes mainly from visualizations. Are you able to visualize much about llms? I ask because if not, starting by learning to visualize high dimensional complex systems is what I would personally recommend. Check out this video for a really nice visualization into NN architecture https://youtu.be/QgH9sr7G13Q?si=iTn1FiFsYCZCJKE_ https://youtu.be/QgH9sr7G13Q?si=iTn1FiFsYCZCJKE_

dominotw 1mo ago

you are just dancing around the question without addressing it directly. > Visualizing large dimensional matrices is a way of starting to develop intuition about llms. one last time before i disengage. how do you know this and what intuitions have you personally developed.

megaloblasto 1mo ago
In my understanding of the word intuition, it comes from a deep understanding of a concept that allows you to know why certain things happen with a "gut feeling", almost unconsciously. For example, I can intuit where my feet should move while jumping over river rocks, but I can't explain to you how to do it. I can only suggest that you spend a lot of time jumping on river rocks to develop the intuition. I've spent a great deal of time studying llms and NN architectures in general. This allows me to intuit things about them and that intuitive understanding for my comes mainly from visualizations. Are you able to visualize much about llms? I ask because if not, starting by learning to visualize high dimensional complex systems is what I would personally recommend. Check out this video for a really nice visualization into NN architecture https://youtu.be/QgH9sr7G13Q?si=iTn1FiFsYCZCJKE_ https://youtu.be/QgH9sr7G13Q?si=iTn1FiFsYCZCJKE_