2 ms·
A few 4090Ti GPUs might be good enough, if they do indeed end up with 48GB of VRAM.
by ronsor 4y ago
A few 4090Ti GPUs might be good enough, if they do indeed end up with 48GB of VRAM.
- deleted 4y ago[deleted]
- firsttimebigboy 4y agoAccording to wikipedia ChatGPT is built on GPT-3 which has 175B parameters requiring 800GB of memory, so a few 4090s will fall short.
- samr71 4y agoLet's say the 4090ti is priced around $2500. 16 of them would set you back just $40 grand. That's quite a bit for the average consumer, but people spend that kinda dough on cars/boats/planes etc. It's well within the realm of dedicated hobbyists. For companies it's nothing. Someone will come along selling pre-builts for this purpose, if that's not already available for their current research/enterprise cards.