captainregex

5 ms·

31.
by captainregex 1y ago
this is such a clean and articulate way of putting it. The discussion around here the last few days about local and the role it is going to play has been phenomenal and really genuine
32.
by captainregex 1y ago
more likely than not I think this ends with a vague promise, a loudly declared victory, and a quiet defanging of the promise or just outright ignoring it in the future
33.
by captainregex 1y ago
money is great! I like money! but if this is their version of buy me a coffee I think there’s room to run elsewhere for their skillset/area of expertise
34.
by captainregex 1y ago
I am so so so confused as to why Ollama of all companies did this other than an emblematic stab at making money-perhaps to appease someone putting pressure on them to do so. Their stuff does a wonderful job of enabling local for those who w
35.
by captainregex 1y ago
I do think Devs are one of the genuine users of local into the future. No price hikes or random caps dropped in the middle of the night and in many instances I think local agentic coding is going to be faster than the cloud. It’s a great us
36.
by captainregex 1y ago
love the first and am sad you’re going to be right about the second
37.
by captainregex 1y ago
Aren’t there HIPPA compliant clouds? I thought Azure had an offer to that effect and I imagine that’s the type of place they’re doing a lot of things now. I’ve landed roughly where you have though- text stuff is fine but don’t ask it to int
38.
by captainregex 1y ago
I am all for the privacy angle and while I think there’s certainly a group of us, myself included, who care deeply about it I don’t think most people or enterprises will. I think most of those will go for the easy button and then wring thei
39.
by captainregex 1y ago
I’m still trying to understand what is the biggest group of people that uses local AI (or will)? Students who don’t want to pay but somehow have the hardware? Devs who are price conscious and want free agentic coding? Local, in my experienc
40.
by captainregex 1y ago
What is the biggest group of people that uses local AI? Students who don’t want to pay but somehow have hardware? Devs who are price conscious? I kinda think about it like Linux- there’s an audience for it but most people will just use Wind
41.
by captainregex 1y ago
yes but think of all those poor shareholders with unmaximized value you heartless man!
42.
by captainregex 1y ago
you’re not the enterprise they’re going after. buying a used fleet is going to be a different exercise in risk mitigation
43.
by captainregex 1y ago
ah yes. “park far away and simply walk 300 pounds of groceries to be stocked at the only corner store for miles” is a very clean and simple solution only you were smart enough to think of. There definitely aren’t hills or ruts making this i
44.
by captainregex 1y ago
spoken like a person who’s never had to load/unload a truck before
45.
by captainregex 1y ago
Anyone else just refreshed and happy to be reading about something not AI?
46.
by captainregex 1y ago
Why not just do it locally? Or were the RAM consumption and the cloud cost comments distinct?
47.
by captainregex 1y ago
AnythingLLM uses NPU
48.
by captainregex 1y ago
literally all of them
49.
by captainregex 2y ago
he…isn’t?
50.
by captainregex 4y ago
Easy for AH- they charge fees on the capital they deploy. Adam and his BS are ultimately the problem of your poor grandmother’s teaching pension getting invested in a noted charlatan.