3 ms·
Ok but how do you get around needing a 10k or 100k h100 cluster
by uptownfunk 2y ago
Ok but how do you get around needing a 10k or 100k h100 cluster
- wslh 2y agoIt is well known that cloud services like Google Cloud subsidizes some projects and we don't even know if in a few years improvements will arise.
- uptownfunk 2y agoPossible but unlikely given how much demand there is and the pressure to deliver returns to shareholders, however sure it is possible. Right now search is very inefficient, the search space is massive. That is the main problem. You can have many sequences of text that sound plausible, but of them a much smaller number will be logically valid. This is the main challenge. Once we can search efficiently not just in semantically valid space but I suppose what you can call syntactically valid space then we will be able to crack this.