3 ms·
GPT-2/3 is at the high end in terms of size. There's a whole universe of problems, and most of the market, below it. A great many business/research needs for
by blihp 5y ago
GPT-2/3 is at the high end in terms of size. There's a whole universe of problems, and most of the market, below it. A great many business/research needs for at least the near future would fit into a CS-2 quite nicely.
- extr 5y agoYes I suppose you're right, GPT-2/3 aren't particularly representative of the "average" industry problem. Honestly what I'm jonesing for is an insider's take on the cost/benefit of a solution like this vs cloud, in terms of problem size, future flexibility, raw price, talent required, etc. Even just a ballpark "this is probably an order of magnitude more efficient vs cloud GPU compute, game changer" vs "we'd have to carefully consider and test performance, etc" But hey, that's the hard part right. Probably aren't many people total with experience with CS-1, let alone browsing HN :D