thrwjud

3 ms·

1. 1.▲
   by thrwjud 3y ago

   The more compute you need to get state of the art performance the closer to the plateau you are. If you didn't need the compute researchers would be getting better results with smarter training. Given that the gpt family of models need
2. 2.▲
   by thrwjud 3y ago

   Every deep learning tech had an exponential growth phase, followed by a slowdown followed by a platou the nothing could break until a fundamentally new architecture came along. People get excited about the first part, project it into the se
3. 3.▲
   by thrwjud 3y ago

   >Nuance and subtlety is impossible to distinguish from dog whistling. Most users don't understand that by "dunking" on someone, they are actually promoting the content. In summary, it gave me a darker feeling about the wor