3 ms·MiniLLM: A minimal system for running LLMs on consumer-grade Nvidia GPUs31 points by volodia 4y ago22c 4y agoGitHub link: https://github.com/kuleshov/minillm https://github.com/kuleshov/minillmnoonething 4y agogood luck with this, looks good so far