4 ms·

AI research in 2024, both fundamental and applied, is probably the most funded research in the history of mankind..

by Maro 2y ago

max_ 2y ago
Grant funders only finance projects with high probability of success. It's very difficult to get funding on projects that don't already have a track record of success. Which is why all research facilities working in AI today that I have read about only do research on Neural Networks
- itchyjunk 2y ago
  Do you have any citation on lack of funding for foundational research? From the looks of things, it seems like there is insane amount of money in AI and while maybe majority of it goes to "projects with high probability of success", whatever that means, fringe ideas seem to generate good amount of capital as well. Even (what I would consider to be) academic projects seems to get good funding [0]. On top of that, it seems like you're not saying that Transformers might be a dead end but Neural Networks itself might be one. At this point, NNs already gives a lot of value. If someone's goal is to just get products out that say diffusion models already helps you achieve, how is that even a dead end? Do you mean dead end for AGI? In which case, there seems to be research on alternatives there as well? [1] [0] https://www.youtube.com/watch?v=rie-9AEhYdY https://www.youtube.com/watch?v=rie-9AEhYdY [1] https://ai.meta.com/blog/yann-lecun-ai-model-i-jepa https://ai.meta.com/blog/yann-lecun-ai-model-i-jepa
  - max_ 2y ago
    I don't have any citations. Just look at what is being published in Arxiv. Call your friends in university departments. Ask people working in startups or corporation. AI at this point is just Neural Networks. Do I think it's a dead end for AGI? I really don't know what AGI is, but for what ever new possibilities we can unlock. We need newer techniques that are less intensive computationally.

4 ms·

AI research in 2024, both fundamental and applied, is probably the most funded research in the history of mankind..

by Maro 2y ago

AI research in 2024, both fundamental and applied, is probably the most funded research in the history of mankind..

max_ 2y ago
Grant funders only finance projects with high probability of success. It's very difficult to get funding on projects that don't already have a track record of success. Which is why all research facilities working in AI today that I have read about only do research on Neural Networks
- itchyjunk 2y ago
  Do you have any citation on lack of funding for foundational research? From the looks of things, it seems like there is insane amount of money in AI and while maybe majority of it goes to "projects with high probability of success", whatever that means, fringe ideas seem to generate good amount of capital as well. Even (what I would consider to be) academic projects seems to get good funding [0]. On top of that, it seems like you're not saying that Transformers might be a dead end but Neural Networks itself might be one. At this point, NNs already gives a lot of value. If someone's goal is to just get products out that say diffusion models already helps you achieve, how is that even a dead end? Do you mean dead end for AGI? In which case, there seems to be research on alternatives there as well? [1] [0] https://www.youtube.com/watch?v=rie-9AEhYdY https://www.youtube.com/watch?v=rie-9AEhYdY [1] https://ai.meta.com/blog/yann-lecun-ai-model-i-jepa https://ai.meta.com/blog/yann-lecun-ai-model-i-jepa
  - max_ 2y ago
    I don't have any citations. Just look at what is being published in Arxiv. Call your friends in university departments. Ask people working in startups or corporation. AI at this point is just Neural Networks. Do I think it's a dead end for AGI? I really don't know what AGI is, but for what ever new possibilities we can unlock. We need newer techniques that are less intensive computationally.