4 ms·

This is also recommended reading if you want to learn more about building LLMs from scratch: See: Train your own LLM - https://github.com/angelos-p/llm-from-sc

This is also recommended reading if you want to learn more about building LLMs from scratch: See: Train your own LLM - https://github.com/angelos-p/llm-from-scratch https://github.com/angelos-p/llm-from-scratch HN Discussion - https://news.ycombinator.com/item?id=48017948 https://news.ycombinator.com/item?id=48017948

bcjdjsndon 2mo ago
Are there any like this but in c or c++?
- deleted 2mo ago
  [deleted]
- smokel 2mo ago
  https://github.com/karpathy/llm.c https://github.com/karpathy/llm.c However, I wonder about the use of this. Typically, you'd want to use a GPU for inference, and programming those in C is quite a challenge. The educational value of learning LLMs in C/C++ seems a lot lower than in Python. May I ask why you're interested in this specifically? Also, why ask this here, and not simply use Google or an LLM to find the information? It comes off as a bit lazy, especially given that you provide no extra context.
  - ghostby_md 2mo ago
    Username checks out
  - DrewADesign 2mo ago
    > Also, why ask this here, and not simply use Google or an LLM to find the information? It comes off as a bit lazy You gave a good answer: why SO the thread? Conversation is the goal here, right? If you’re feeling put out by the question, why bother answering it and then complaining that they asked it? Just move along.
  - bcjdjsndon 2mo ago
    > Also, why ask this here, and not simply use Google or an LLM to find the information? It comes off as a bit lazy - why answer? - Google is a fucking mess, no thanks, quicker to ask a person who knows the answer already - llms don't always give you a decent answer, and the time I spend back and forth would be greater than just asking a human Why c? Because I want to hand craft a minimal llm without calling in a bunch of libraries that do the actual LLM part for me... I want to know the actual maths going into it. Plus I don't know python. By the looks of it, you can code an llm ina few lines of correctly chosen python; to me this is very unenlightening and I might as well have just ran ollama

bcjdjsndon 2mo ago

Are there any like this but in c or c++?

deleted 2mo ago
[deleted]
smokel 2mo ago
https://github.com/karpathy/llm.c https://github.com/karpathy/llm.c However, I wonder about the use of this. Typically, you'd want to use a GPU for inference, and programming those in C is quite a challenge. The educational value of learning LLMs in C/C++ seems a lot lower than in Python. May I ask why you're interested in this specifically? Also, why ask this here, and not simply use Google or an LLM to find the information? It comes off as a bit lazy, especially given that you provide no extra context.
- ghostby_md 2mo ago
  Username checks out
- DrewADesign 2mo ago
  > Also, why ask this here, and not simply use Google or an LLM to find the information? It comes off as a bit lazy You gave a good answer: why SO the thread? Conversation is the goal here, right? If you’re feeling put out by the question, why bother answering it and then complaining that they asked it? Just move along.
- bcjdjsndon 2mo ago
  > Also, why ask this here, and not simply use Google or an LLM to find the information? It comes off as a bit lazy - why answer? - Google is a fucking mess, no thanks, quicker to ask a person who knows the answer already - llms don't always give you a decent answer, and the time I spend back and forth would be greater than just asking a human Why c? Because I want to hand craft a minimal llm without calling in a bunch of libraries that do the actual LLM part for me... I want to know the actual maths going into it. Plus I don't know python. By the looks of it, you can code an llm ina few lines of correctly chosen python; to me this is very unenlightening and I might as well have just ran ollama