3 ms·
Even if there's enough GPUs they also needs to be available at a cost that makes it financially viable, both in terms of purchasing price, but also power and co
by mrweasel 3y ago
Even if there's enough GPUs they also needs to be available at a cost that makes it financially viable, both in terms of purchasing price, but also power and cooling. Environmentally it might not look to good to offer LLM answers to a wider audience, there are already concerns about the water consumption of ChatGPT in some regions, see: https://fortune.com/2023/09/09/ai-chatgpt-usage-fuels-spike-in-microsoft-water-consumption/ https://fortune.com/2023/09/09/ai-chatgpt-usage-fuels-spike-...