3 ms·
We could make LLM inference 100x cheaper to run at home efficiently, but that solution might need to be updated every 1-2 years, whereas current GPU are useful
by ttoinou 3mo ago
We could make LLM inference 100x cheaper to run at home efficiently, but that solution might need to be updated every 1-2 years, whereas current GPU are useful for various others tasks and last longer
- nektro 3mo ago> We could make LLM inference 100x cheaper to run at home efficiently do you genuinely think that's going to happen?