2 ms·
Depends on which version you're running. According to https://github.com/amirgholami/ai_and_memory_wall https://github.com/amirgholami/ai_and_memory_wall And a
by TheRoque 4y ago
Depends on which version you're running. According to https://github.com/amirgholami/ai_and_memory_wall https://github.com/amirgholami/ai_and_memory_wall
And a guy with a youtube channel called "Asianometry" who did a video on this https://www.youtube.com/watch?v=5tmGKTNW8DQ https://www.youtube.com/watch?v=5tmGKTNW8DQ the full GPT-3 model needs thousands of high-end GPUs (meaning: not your home 1080 GPU)