3 ms·

Everything I know about ML is self taught. My local Uni has a ML Engineering degree that's relatively new. Every once in a while I look at the curriculum, outsi

Everything I know about ML is self taught. My local Uni has a ML Engineering degree that's relatively new. Every once in a while I look at the curriculum, outside of some higher lvl math, 90% of that four year degree consists of topics I "mastered" in the first 6-12 months of self study trying to build prediction models for various sports.

alephnerd 2y ago
Good for you. Do you know how to optimize the MTU of an Infiniband interconnect? Do you understand how to schedule multiple models being trained concurrently? Do you know why you cannot directly leverage bare metal compute within a Docker image? This is important Infra knowledge you need to take full advantage of any model you are training on your own hardware. And this is why Deepseek was successful - they understood the ins-and-outs of systems programming and the H800 architecture to maximize the compute performance they needed to train their model.
- beardedwizard 2y ago
  What about Linux namespaces makes you think it's not running on bare metal? Maybe you are thinking of versions of docker that introduce a Linux hyper visor like macos?
  - alephnerd 2y ago
    > What about Linux namespaces makes you think it's not running on bare metal Nothing! That's my point! I've met a number of "MLEs" who couldn't push back like that with my very basic "fizzbuzz" question
blackkat 2y ago
Would you mind giving some pointers of where to start? There is a wasteland of blogspam around the topic of getting started with ML and it’s hard to know what is useful at the beginning.
- TechDebtDevin 2y ago
  If I could go back I would start by reading Josh Starmer's Statquest Guide to Machine Learning, and then his guide to AI/Nueral Networks[0]. Starmer does the best job at explaining advanced ML topics in a very beginner friendly way, the books are literally written in the format of a children's book. Then just start tinkering. I got interested in ML because of sport's analytics and betting markets so I read a lot of papers on that topic and books similar to Bayesian Sports Models in R by Andrew Mack[1].Also, Jake VanderPlas's Python Data Science Handbook is good[2]. Ideally, find a vertical you're interested in where experts have applied ML and read their papers/books and work backwards from there. [0]: https://statquest.org/statquest-store/ https://statquest.org/statquest-store/ [1]: https://www.goodreads.com/book/show/216487475-bayesian-sports-models-in-r https://www.goodreads.com/book/show/216487475-bayesian-sport... [2]: https://www.oreilly.com/library/view/python-data-science/9781491912126/ https://www.oreilly.com/library/view/python-data-science/978...

alephnerd 2y ago

Good for you. Do you know how to optimize the MTU of an Infiniband interconnect? Do you understand how to schedule multiple models being trained concurrently? Do you know why you cannot directly leverage bare metal compute within a Docker image? This is important Infra knowledge you need to take full advantage of any model you are training on your own hardware. And this is why Deepseek was successful - they understood the ins-and-outs of systems programming and the H800 architecture to maximize the compute performance they needed to train their model.

beardedwizard 2y ago
What about Linux namespaces makes you think it's not running on bare metal? Maybe you are thinking of versions of docker that introduce a Linux hyper visor like macos?
- alephnerd 2y ago
  > What about Linux namespaces makes you think it's not running on bare metal Nothing! That's my point! I've met a number of "MLEs" who couldn't push back like that with my very basic "fizzbuzz" question

blackkat 2y ago

Would you mind giving some pointers of where to start? There is a wasteland of blogspam around the topic of getting started with ML and it’s hard to know what is useful at the beginning.

TechDebtDevin 2y ago
If I could go back I would start by reading Josh Starmer's Statquest Guide to Machine Learning, and then his guide to AI/Nueral Networks[0]. Starmer does the best job at explaining advanced ML topics in a very beginner friendly way, the books are literally written in the format of a children's book. Then just start tinkering. I got interested in ML because of sport's analytics and betting markets so I read a lot of papers on that topic and books similar to Bayesian Sports Models in R by Andrew Mack[1].Also, Jake VanderPlas's Python Data Science Handbook is good[2]. Ideally, find a vertical you're interested in where experts have applied ML and read their papers/books and work backwards from there. [0]: https://statquest.org/statquest-store/ https://statquest.org/statquest-store/ [1]: https://www.goodreads.com/book/show/216487475-bayesian-sports-models-in-r https://www.goodreads.com/book/show/216487475-bayesian-sport... [2]: https://www.oreilly.com/library/view/python-data-science/9781491912126/ https://www.oreilly.com/library/view/python-data-science/978...