3 ms·
It uses GPT-3 under the hood which requires about 350 gigabytes of GPU VRAM (back of the envelope calc, likely more) to perform these inferences.
by DeWilde 4y ago
It uses GPT-3 under the hood which requires about 350 gigabytes of GPU VRAM (back of the envelope calc, likely more) to perform these inferences.
- bozhark 4y ago7x NVIDIA RTX A6000's so ~$32,550
- KaoruAoiShiho 4y agoThis is honestly affordable for a lot of upper-middle class people and might well it worth it. It's like the cost of a car. I can seriously see this writing a book for me if I can get it tuned to study only my writing style and remember all of my texts. But it could also only cost $14000 14x RTX 3090s.
- heartbreak 4y agoI’ll wait a year and buy $2k worth of hardware that runs it.
- llampx 4y agoDifference is in first mover advantage. If you can be the first to use it to bring value to yourself and your clients, you can easily make up the cost of that hardware.
- jasmer 4y agoOr wait a further few years and spend $20. Or a couple years later for it to be 20 cents. Or a couple years later for them to give it to you for buying a bottle of Coke. In the interim, they will find ways to make money from us.
- bozhark 4y ago5x limit per manufacturer, maybe 3rd party for the additional?
- lmarcos 4y agoSo maybe in 5 years we would be able to run it in our $800 smart glasses.
- KaoruAoiShiho 4y agoIf this was open sourced it may be quickly optimized, the amount of VRAM required for image generation went down very quickly, I'm sure Dalle-2 is still using enormous vrams but other solutions are not.