3 ms·

There was a post yesterday about a 500 line single-file C implmenetation of llama2 with no dependencies. The llama2 architecture is hard coded. It shouldn't be

by pests 3y ago

There was a post yesterday about a 500 line single-file C implmenetation of llama2 with no dependencies. The llama2 architecture is hard coded. It shouldn't be too hard to port to python. Found the repo, couldn't easily find the HN thread. https://github.com/karpathy/llama2.c https://github.com/karpathy/llama2.c

treprinum 3y ago
That's Andrej's toy project, it won't run 7B LLaMA.
- NateGenX 3y ago
  It does now: https://github.com/karpathy/llama2.c#metas-llama-2-models https://github.com/karpathy/llama2.c#metas-llama-2-models