3 ms·
I listened to the latest about it from Prof Sepp himself on the Industrial AI podcast channel. See the link below. He consistently called Transformers... "nons
by rock_ 3y ago
I listened to the latest about it from Prof Sepp himself on the Industrial AI podcast channel. See the link below.
He consistently called Transformers... "nonsense" and said that xLSTM has beaten Transformer-based models across several small dataset benchmarks. They are busy scaling the training to large datasets and planning to keep the technology in Europe. I doubt they will make it public once it is available. The coming months will be interesting. More about the interview here.
https://podcasts.google.com/u/1/feed/aHR0cHM6Ly9raXBvZGNhc3QucG9kaWdlZS5pby9mZWVkL21wMw/episode/YWFlZWJhNDE5NTUzYzEzNzg5NDhmMTQyOTkzNDNkNWI?sa=X&ved=0CAUQkfYCahcKEwi43MOGt5aEAxUAAAAAHQAAAAAQRA https://podcasts.google.com/u/1/feed/aHR0cHM6Ly9raXBvZGNhc3Q...
- Trapais 3y agoPeople say lots of stupid shit. If there is no code or even paper, there is no reason to believe. Beating benchmarks requires something more than a blind faith.