3 ms·
Also, there's a nontrivial learning curve involved in running your own inference server, once you move past the casual-goofing-around-with-llama-server stage.
by CamperBob2 4mo ago
Also, there's a nontrivial learning curve involved in running your own inference server, once you move past the casual-goofing-around-with-llama-server stage. If you care about not being a sharecropper on Sam's or Dario's plantation, you should consider learning the ropes. Even if you don't put these skills to immediate use in your day job.
I didn't appreciate this until I started down that road myself.
- matheusmoreira 4mo ago> If you care about not being a sharecropper on Sam's or Dario's plantation Couldn't have put it better myself. That's what all this comes down to. Owning the hardware, owning the inference. Not perpetually renting them out on a meter like in the dystopian future they're envisioning.
- inigyou 4mo agoYou also have the option to not use AI
- CamperBob2 4mo agoNot in the future, not if you want to get paid.
- matheusmoreira 4mo agoYeah but the truth is I don't want to go back to the pre-LLM world. I've been programming alone for over ten years. Having a coding buddy to talk to, collaborate with or just bounce ideas off of quite literally changed my life. I don't want to go back to solo programming, and my projects aren't exactly swimming in a sea of active contributors.