2 ms·
Yep, have been playing with the 18USD API credit and indeed the cost is not trivial enough for casual use cases. That said, these new developments give us a ne
by mrtksn 4y ago
Yep, have been playing with the 18USD API credit and indeed the cost is not trivial enough for casual use cases.
That said, these new developments give us a new reason to have powerful computers. The last 10 years computers were way more powerful for most of the task for their conventional use cases but now computers are yet again way less powerful for the new frontier use cases.
Apparently GPT-3 runs on 350GB VRAM, so it requires specialised hardware, so the best we can do today is to sneak peak into the future of on-device GPT-3 like LLMs.