3 ms·
Well, there's not only monetary cost on compute, you need humans interacting with it for RLHF, it takes time as well, you need engineers, and at the end of it,
by mannerheim 4y ago
Well, there's not only monetary cost on compute, you need humans interacting with it for RLHF, it takes time as well, you need engineers, and at the end of it, if you're just copying the leader, you're always going to be behind and not going to be coming up with the latest and greatest.
I'm just disappointed the compute cost alone seems difficult to surmount for open source/community projects.