3 ms·

To put another perspective on this, lots of modern advancements in both ML/AI and especially computer graphics has come from ideas already from the 70-80s that

To put another perspective on this, lots of modern advancements in both ML/AI and especially computer graphics has come from ideas already from the 70-80s that were published, forgotten, and revived. Because underlying dependencies change, like the profile of the HW of the day. So just let the ideas flow, not every paper has to have an immediate payoff.

KeplerBoy 2y ago
To be fair, Hochreiter seems pretty confident that this will be a success. He stated in interviews "Wir werden das blöde GPT einfach wegkicken" (roughly: We will simply kick silly GPT off the pitch) and he just founded a company to secure funding. Interesting times. Someone gathered most of the available information here: https://github.com/AI-Guru/xlstm-resources https://github.com/AI-Guru/xlstm-resources
- imjonse 2y ago
  With all due respect for his academic accomplishments, confidence in this domain in the current climate is usually a signal towards potential investors; it can be backed by anything between solid work (as I hope this turns out to be) and a flashy slide deck combined with a questionable character.
  - KeplerBoy 2y ago
    Which is a legitimate stance. Being a researcher at a public university in a country that doesn't exactly splurge on this kind of research he has to get creative to get any meaningful amount of funding.
    - l33tman 2y ago
      To say the least. It's a bit unfortunate that there is about 0 culture in the EU regarding moonshot projects compared to silicon valley. I've tried to get money a couple of times from government grants for (yet another..) foundational AI model, neuroscience inspired, but the grants instead seem to almost exclusively go to well developed industrial companies that now wants some free money to "leverage" ChatGPT in their existing internal processes.. and being still in the research phase, the more risk-averse VCs here are not touching stuff like this either. So I guess what's left is doing these grand proclamations that you are going to "knock the crown off OpenAI" etc. Though, some sort of vision is good to have for sure :)

KeplerBoy 2y ago

To be fair, Hochreiter seems pretty confident that this will be a success. He stated in interviews "Wir werden das blöde GPT einfach wegkicken" (roughly: We will simply kick silly GPT off the pitch) and he just founded a company to secure funding. Interesting times. Someone gathered most of the available information here: https://github.com/AI-Guru/xlstm-resources https://github.com/AI-Guru/xlstm-resources

imjonse 2y ago
With all due respect for his academic accomplishments, confidence in this domain in the current climate is usually a signal towards potential investors; it can be backed by anything between solid work (as I hope this turns out to be) and a flashy slide deck combined with a questionable character.
- KeplerBoy 2y ago
  Which is a legitimate stance. Being a researcher at a public university in a country that doesn't exactly splurge on this kind of research he has to get creative to get any meaningful amount of funding.
  - l33tman 2y ago
    To say the least. It's a bit unfortunate that there is about 0 culture in the EU regarding moonshot projects compared to silicon valley. I've tried to get money a couple of times from government grants for (yet another..) foundational AI model, neuroscience inspired, but the grants instead seem to almost exclusively go to well developed industrial companies that now wants some free money to "leverage" ChatGPT in their existing internal processes.. and being still in the research phase, the more risk-averse VCs here are not touching stuff like this either. So I guess what's left is doing these grand proclamations that you are going to "knock the crown off OpenAI" etc. Though, some sort of vision is good to have for sure :)