3 ms·
ChatGPT style AI is an example of an innovation that seems to be very capital intensive. People are generally not going to be spinning up viable competitors in
by AlexandrB 4y ago
ChatGPT style AI is an example of an innovation that seems to be very capital intensive. People are generally not going to be spinning up viable competitors in their garage. The reliance on tons of capital up-front will drive the need to monetize the resulting product in as many ways as possible to recoup the investment.
- HDThoreaun 4y agoI don't agree. Within a couple years wealthy technocrats will absolutely be spinning up low cost minimal ad LLMs in their garage. Running these things certainly isn't cheap, but most of the cost is in training which can be crowdfunded and the model released for free. At which point anyone with 100k can buy a computer that can run the model commercially. We're also seeing smaller models with equivalent performance such as the recent one from facebook. If that trend continues it will be even easier for small groups to train and run models with minimal advertising.
- jodrellblank 4y agoWithin a couple years wealthy technocrats will absolutely be spinning up low cost minimal ad LLMs in your browser. Running these things certainly isn't cheap on your battery, but that's a cost they're willing to pay.
- int_19h 4y agoThe LLaMA 13B and 30B models that Facebook leaked a few days ago have already been successfully spun up on home-grade GPUs using 8-bit and 4-bit quantization, and they work surprisingly well: https://rentry.org/llama-tard-v2 https://rentry.org/llama-tard-v2 30B is not quite as good as ChatGPT yet, but that's mainly a function of fine-tuning quality prompts, and the model is comparable in principle. There are already scripts for fine-tuning, so I expect plenty of pre-tuned chat models to show up very soon now.