3 ms·
An one thing which isn't free is AI. Try to maintain moderately complex app with AI and not spend $ on tokens or GPUs.
by imhoguy 5mo ago
An one thing which isn't free is AI. Try to maintain moderately complex app with AI and not spend $ on tokens or GPUs.
- i_think_so 5mo agoWe really really need a high quality coding assistant that runs in 4GB of VRAM. It doesn't have to be the best, and it doesn't need to be able to handle more than say 2 languages at a time, like C and whatever. That would open up the field to a whole new demographic of potential coders, which is what the industry desperately needs right now. ...because right now no one is hiring _anybody_ who isn't a super duper senior 100x dev. The whole world of tech is facing a generational collapse. We need to pull a rabbit out of hat soon or we're all screwed.
- imhoguy 5mo agoYou can't encode high quality coding practices and conversation skills in 4GB model. Information compression is too lossy. No one is hiring because IT hit peak of usefulness. I delete more apps from my phone than install every month. I don't need more services. My rusty car is enough, no need for more touch interfaces.