4 ms·
What type of hardware is needed as the bare bones for this?
by cdnsteve 4y ago
What type of hardware is needed as the bare bones for this?
- TheRoque 4y agoDepends on which version you're running. According to https://github.com/amirgholami/ai_and_memory_wall https://github.com/amirgholami/ai_and_memory_wall And a guy with a youtube channel called "Asianometry" who did a video on this https://www.youtube.com/watch?v=5tmGKTNW8DQ https://www.youtube.com/watch?v=5tmGKTNW8DQ the full GPT-3 model needs thousands of high-end GPUs (meaning: not your home 1080 GPU)