4 ms·
I understand that a group of motivated individuals, even without significant financial resources, could attempt to tackle these challenges, much like the way fr
by wslh 2y ago
I understand that a group of motivated individuals, even without significant financial resources, could attempt to tackle these challenges, much like the way free and open-source software (FOSS) is developed. The key ingredients would be motivation and intelligence, as well as a shared passion for advancing mathematics and solving foundational problems.
- uptownfunk 2y agoOk but how do you get around needing a 10k or 100k h100 cluster
- wslh 2y agoIt is well known that cloud services like Google Cloud subsidizes some projects and we don't even know if in a few years improvements will arise.
- uptownfunk 2y agoPossible but unlikely given how much demand there is and the pressure to deliver returns to shareholders, however sure it is possible. Right now search is very inefficient, the search space is massive. That is the main problem. You can have many sequences of text that sound plausible, but of them a much smaller number will be logically valid. This is the main challenge. Once we can search efficiently not just in semantically valid space but I suppose what you can call syntactically valid space then we will be able to crack this.