5 ms·
Maybe there will be a time where programing in high-level languages will be seen as punch cards are seen today. Even if that happens maybe the ones that know h
by melenaboija 4y ago
Maybe there will be a time where programing in high-level languages will be seen as punch cards are seen today.
Even if that happens maybe the ones that know how programming languages work will be the good ones, as today a good programmer knows about OS’, architecture or compilers.
- acover 4y agoHow many programmers are there for large language models? It seems like there are very few ai researchers compared to the number of programmers. There will be more people using the ai to program computers, but the ai interface may be so easy that it's no longer a skill.
- sakex 4y agoWhat kind of maths is required? I am not a practitioner but I try to stay up to date. I read ML papers, and it seems like they only require pretty basic maths (as in High School level.) Linear algebra, calculus, and stochastic calculus. It seems to me you can go a long way with just understanding the chain rule and dot products. I am trying to build my own Language Model using Pytorch and it is much easier than a lot of the stuff I've had to do as a traditional SWE over the years. My understanding is that the difficulty comes from training massive models that cannot fit on a single GPU efficiently, so more of a software problem than a maths problem. Am I suffering from the Dunning-Kruger effect ? Or is the genius of the field in the combination of this limited set of techniques ?