3 ms·
Realistically speaking, how long would it take for someone who has college-level Linear Algebra and multi-variable Calculus knowldge and rusty familiarity with
by ducktective 4y ago
Realistically speaking, how long would it take for someone who has college-level Linear Algebra and multi-variable Calculus knowldge and rusty familiarity with ML (via Andrew NG's matlab course) to learn the concept of LLM and state of the art algorithms behind SDs and GPTs?
Would it even make sense if one's interest is not image or text generation?
- swyx 4y agoi mean to learn all the details it'd prob take the equivalent work of doing a phd + research fellowship or two. but i have the qualifications you cite and I'm doing the fast.ai courses to get a working knowledge of things and that seems to take 4-8 weeks depending on your pace
- rakejake 4y agoNot really. These algorithms are generally quite simple and you are not coming up with them from scratch. It might take a PhD to build the JVM, but you don't need one to understand what it does (at least most parts of it).
- deleted 4y ago[deleted]
- macrolocal 4y agoOnly a month or two for the basics, if you're willing to take some stochastic calculus in the SDs for granted. Part of what's eluded public awareness so far is that these algorithms are simple.
- greesil 4y agoThe algos are but the architecture isn't.
- macrolocal 4y agoFor example, cf. ZionEX and Pathways. AI accelerators are important.
- kitsune_ 4y agoA couple of months. Also, there is a world of difference between knowing the topic on a superficial level and training and evaluating a model yourself.