3 ms·GPT-3 sized models need that kind of memory for inferenceby visarga 4y agoGPT-3 sized models need that kind of memory for inferencesudosysgen 4y agoGPT-3 is more like 300GB iirc