3 ms·
>LLMs have the unfortunate limitation of being both powerful and lending themselves to centralized control choke-points due to how resource intensive they are t
by RobotToaster 4y ago
>LLMs have the unfortunate limitation of being both powerful and lending themselves to centralized control choke-points due to how resource intensive they are to train.
I wonder if that will continue.
My understanding is that's partially because it currently relies on GPUs, which until relatively recently there was a limited demand for, and the market is basically controlled by a single company.
Will we see cheaper special purpose AI accelerators? Like happened with crypto mining ASICs.