4 ms·
Has there been any breakthroughs or sign of a breakthrough in term of LLM training efficiency and inference cost? Right now it seems like the capabilities of th
by tomohelix 3y ago
Has there been any breakthroughs or sign of a breakthrough in term of LLM training efficiency and inference cost? Right now it seems like the capabilities of the models are the focus with more accurate image generation, videos, less hallucinations, etc. But it always at the cost of computing power. Average guy can't afford a $600 GPU to run Stable Diffusion at home at full capacity...
- chpatrick 3y agoDepends on where the average guy lives, even in Eastern Europe $600 is something you can save up for if it's your hobby. A used 3090 is around $550 now and it's only going to get cheaper.
- meiraleal 3y agoMake it work, make it right, make it fast. Most players are still in the make it work part or before that. Only OpenAI is in the make it fast part.