Not quite sure the hate on this thread. He's right, theres not much you can contribute to LLMs. LLMs are unlike traditional software, they require large expens

Not quite sure the hate on this thread. He's right, theres not much you can contribute to LLMs. LLMs are unlike traditional software, they require large expensive machines and access to these is difficult to come by. Compare that with studying databases for example you can get quite far just with a laptop, the bottleneck is the knowledge. Take for example even simple systems like wav2vec 2.0. The original model was trained on 128Gpus and if one were to try and reproduce the paper on normal hardware it will take months to get to a result. Not just individuals, these applications are put of the reach of all but the most well funded of companies.