Title here seems clickbait. The title from the article I see it now is "Falcon 180B: Can It Run on Your Computer?" The content does mention 720GB RAM, but qui

Title here seems clickbait. The title from the article I see it now is "Falcon 180B: Can It Run on Your Computer?" The content does mention 720GB RAM, but quickly clarifies that it can be reduced: QUOTE: Step 1 and step 2 are the ones that consume memory. In total, you would need 720 GB of memory available. This can be CPU RAM, but for fast inference, you may want to use GPUs, e.g., 9 A100 with 80 GB of VRAM. This wouldn’t be enough for batch inference. With either CPU RAM or VRAM, that’s a lot of memory. Fortunately, these requirements can be easily reduced.