4 ms·

What was your approach to getting started doing this? I’m curious to learn more about how LLMs work too.

• moralestapia 3y ago
  Try to get something like tinygrad[1] running locally, that way you can tweak things a bit, run it again and see how it performs. While doing this you'll pick up most of the concepts and get a feeling of how things work. Also, take a look at projects like llama.cpp[2], you don't have to fully understand what's going on here, though. You may need some intermediate knowledge of linear algebra and this thing called "data science" nowadays, which is pretty much knowing how to mangle data and visualize it. Try creating a small model on your own, it doesn't have to be super fancy just make sure it does something you want it to do. And then ... you'll probably could go on your own then. 1: https://github.com/tinygrad/tinygrad https://github.com/tinygrad/tinygrad 2: https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp