3 ms·
This post may be tongue in cheek, but realistically that's right. I ran the Facebook chatbot that was posted maybe a month ago and didn't get good performance u
by ganstyles 6y ago
This post may be tongue in cheek, but realistically that's right. I ran the Facebook chatbot that was posted maybe a month ago and didn't get good performance until I was using many Tesla v100 GPUs, which are $8k each. Thankfully modern CSPs like Azure allow renting rigs that can handle this pretty easily.
- aquajet 6y agoHow much does that cost?
- ganstyles 6y agoThe largest AWS instances are $30-something/hr on demand, less with reserved time. So pretty expensive.
- cambalache 6y ago21.3 USD/h in vast.ai (8X Tesla V100, 118.8 TFLOPS)
- lumost 6y agoMore or less the cost of a well trained, experienced customer service representative?
- FeepingCreature 6y agoYeah but the cost will come down.
- Jack000 6y agothat's only 256GB, which isn't enough. I'm not sure it's even possible to nvlink 16 v100s. I'd love to try it out for $40/hr if it were possible though.