4 ms·Show HN: Run Llama3.1 405B on a 8GB VRAM challenge [video]19 points by lyogavin 2y agoHow to run Llama3.1 405B on a 8GB VRAMlangcss 2y agohttps://github.com/lyogavin/airllm https://github.com/lyogavin/airllm What sort of speed do you get?lyogavin 2y agoNot fast, not a good fit for realtime interaction applications, but for offline data processing cases, it works perfectly. I use it for my offline tasks.