4 ms·
As it has been mentioned numerous times in the past, we are not the average user. I don't know anyone outside our bubble who would bother running a local LLM, o
by elorant 2y ago
As it has been mentioned numerous times in the past, we are not the average user. I don't know anyone outside our bubble who would bother running a local LLM, or going into all the trouble building an x8 GPU rig to run one of the biggest models.
- bryanlarsen 2y agoEasy to run locally for geeks means easy to package up and sell to non-geeks.
- elorant 2y agoWhy would non-geeks want to run a local LLM? Electricity prices alone are quite high. Why not pay a subscription on a cloud service and be done with it.
- xyc 2y agoPrivacy could be one reason. There are a lot of cases where people do not want to send data to a cloud service.
- bryanlarsen 2y agoMy point is that you will have many cloud services to choose from if geeks can build them easily, which will keep prices down.