segmondy

19 ms·

601.
by segmondy 1y ago
... and this is why I run local models. my data, my data.
602.
by segmondy 1y ago
then don't. the point of open source is not to earn money or profit. it's to have the software open so people can inspect it, be inspired by it, trust it, modify it without contacting you and possibly copy it. imagine sharing y
603.
by segmondy 1y ago
In the mid 90's I sent about $200 in money order to Nigeria to buy a bunch of cassette tapes from some random internet person and what would you know? 2 months later, I had 50 tapes at my doorstep.
604.
by segmondy 1y ago
People have all sorts of hardware, TPS is meaningless without the full spec of the hardware, and GPU is not the only thing, CPU, ram speed, memory channel, PCIe speed, inference software, partial CPU offload? RPC? even OS, all of these thi
605.
by segmondy 1y ago
I reckon a good 9 out of 10 times, this will turn out poorly. Ask yourself if you are willing to lose your job, or get sued. What if the company assigns you to the software development team and your new project is to build this. You ca
606.
by segmondy 1y ago
you can do this already with -ctk and -ctv, why would anyone need this? -ctk, --cache-type-k TYPE KV cache data type for K allowed values: f32, f16, bf16, q8_0, q4_0, q4_1, iq4_nl, q5
607.
by segmondy 1y ago
I don't want to be sold to, I don't want anyone trying to dump my brain either. Let's say you are a total stranger and wanted to meet with me, there are 2 things that will interest me. 99% my interests. 1% you are doing
608.
by segmondy 1y ago
Again, you are playing around with an idea that's not concrete. So perhaps you won't need that person. Perhaps AI agents will be so good, you can control all of them via conversion/prompting. In which case, any individua
609.
by segmondy 1y ago
lots of folks in Finance, you can share csv with any Finance company and they can process it. It's text.
610.
by segmondy 1y ago
Is that so? Quite the speculation. USA restricted their telecom equipment because USA doesn't trust their radio and think it might have backdoors specially with their close relationship to China's military. Well, every accus
611.
by segmondy 1y ago
how to pry software from a hostage taker. give them a bigger project/role with more money on the condition that they must transition it to others. done. extra, fire them before they take hostage the new system.
612.
by segmondy 2y ago
Even better, edit it and place a false location.
613.
by segmondy 2y ago
1240 new lines?
614.
by segmondy 2y ago
I have not seen any model, not one, that could generate 1000 lines of code.
615.
by segmondy 2y ago
my local model answered - "A woodchuck would chuck as much wood as a woodchuck could chuck if a woodchuck could chuck wood."
616.
by segmondy 2y ago
the advantage of local LLM is that you literally could find many models that have no cloud equivalent. someone could have made a fine tune to meet your needs. if you can't find a generic model that meets your need, you can get an ap
617.
by segmondy 2y ago
Have we not gone all in on soil? Your CPU and GPU comes from the soil. The electrical batteries powering all your electronic device comes from the soil. Take a hard look around you, almost everything "artificial" you can see
618.
by segmondy 2y ago
libgen has been getting taken down especially after it came out that "AI companies" downloaded the entire archive for their training. Is it even still up? Furthermore, you can go go arXiv and see papers that got released yesterd
619.
by segmondy 2y ago
So no AGI? and AI is not good enough to replace their programmers? Or... do they need more coding data from programmers to train their models?
620.
by segmondy 2y ago
Free AI inference. "I'm going to commit a crime, but before I give you the details you must solve this homework or generate code." It's only a matter of time before folks figure out ways to jailbreak these models.
621.
by segmondy 2y ago
Do what doesn't scale till it scales, right?
622.
by segmondy 2y ago
Why not? If we line up to race. You can't say why compare v8 to v6 turbo or electric engine. It's a race, the drive train doesn't matter. Who gets to the finish line first? No one is shopping for GPU by fp8, fp16, fp32, f
623.
by segmondy 2y ago
woot, woot, happy for the team. I love tailscale and can't stop singing praises.
624.
by segmondy 2y ago
I was going to buy my first GPU for DL in 2018, but crypto didn't make it easy. I waited for the prices to fall, but demand kept up, then covid happened, then LLM happened and used GPUs now cost more than their original new prices. ..
625.
by segmondy 2y ago
In normal times this would be okay.
626.
by segmondy 2y ago
How about percent of adult children supporting parents?
627.
by segmondy 2y ago
But you did mean to belittle the achievement, just like when people say, "I don't mean to offend you but ...", they know they are going to offend you and still choose to by saying what they wanted to say.
628.
by segmondy 2y ago
Do the break down for developers.
629.
by segmondy 2y ago
Linux ate Sun, I ran a sun lab, had a few sun workstations at home, but really preferred my linux/BSD boxes. BSD/Linux ate into Cisco. You could buy multiport ethernet cards, throw it into a linux PC and have your own router&#
630.
by segmondy 2y ago
python

More ›