3 ms·
Get used to it. The infrastructure involved is just too expensive to run at home. The same applies to quantum computers. Models like GPT-3 are way too big for
by qayxc 6y ago
Get used to it. The infrastructure involved is just too expensive to run at home.
The same applies to quantum computers. Models like GPT-3 are way too big for a consumer machine to handle and require something like a DXG-station [0][1] with 4x 80 GiB A100 GPUs to run properly.
So even if the model were available for download, you wouldn't be able to even run it without hardware costing north of $125,000.
It's less about restricting knowledge and more about the insane amount of resources required. It's not as bad as getting access to FMRI or particle accelerators, but it's getting there ;)
[0] https://bdtechtalks.com/2020/09/21/gpt-3-economy-business-model/ https://bdtechtalks.com/2020/09/21/gpt-3-economy-business-mo...
[1] https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/dgx-station/nvidia-dgx-station-a100-datasheet.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...