segmondy

28 ms·

811.
by segmondy 3y ago
Not necessarily, I'm not sure about AMD GPUs, but he tweeted that AMD supports linking all 6 together. If that's the case, then 6 of those XTX should crush 6 3090's. For us techies we definitely will decide to build vs b
812.
by segmondy 3y ago
full riser cables like they used doesn't impact performance. Hanging it off on open air frame IMO is better, keeps everything cooler, not just the GPU but the motherboard and surrounding components. With only 2 24gb GPU they are not
813.
by segmondy 3y ago
Unless you are training maximizing the PCIe lanes is truly overrated. You certainly don't want to be running at 1x speed. But 8x speed is enough with minimal impact. 8*3 = 32 lanes. Most CPUs can provide that. I'm runni
814.
by segmondy 3y ago
Well, almost. GPUs have not be depreciating. The cost of 3090's and 4090's have gone up. Folks are selling it for what they paid for or even more. With the recent 40's SUPER series from Nvidia, I'm not expecting any
815.
by segmondy 3y ago
Most people don't think of storage costs and network bandwidth. I have about 2tb of local models. What's the cost of storing this in the cloud? If I decide not to store them in the cloud, I have to transfer them in anytime I
816.
by segmondy 3y ago
Unless you are training, you never hit peak watts. When inferring, the watt is still minimal. I'm running inference now and using 20%. GPU 0 is using more because I have it as main GPU. Idle watt sits at about 5%. Device 0 [NVIDIA G
817.
by segmondy 3y ago
This defeatist mentality is plain stupid. There are under 20yrs old working on AI today, they went from 0 to their current knowledge in most cases 2-3 years. So what to do? Level up. I'm an old fart too, blah, blah, blah, since the
818.
by segmondy 3y ago
A mining rack would mean the metal frame where the 4090's are mounted, not the motherboard. Since they pulled off this build, We will assume they are smart to use a server motherboard with enough PCIe slots and lanes.
819.
by segmondy 3y ago
Yeah for $51,000. I will happy run a rack of 4090s.
820.
by segmondy 3y ago
Just do it. Lots of people are running home labs serving the internet, and we have been since the days of phone modem.
821.
by segmondy 3y ago
I have one, and I occasionally drive to Canada. Definitely need to be aware not to have it on me anymore. :-/
822.
by segmondy 3y ago
it's actually a wrapper around llama-cpp-python. they ought to be embarrassed.
823.
by segmondy 3y ago
I have seen them used extensively, especially pypy & jython by big companies. I have seen ironpython twice, but I rarely venture into windows/.NET land.
824.
by segmondy 3y ago
I really hope Oxide succeeds. I thought they were crazy when they announced what they were going to do. It's not the kind of play you see from a start up, but they were determined. Most folks that started the race at that time are
825.
by segmondy 3y ago
The bar has been raised. That's what happened.
826.
by segmondy 3y ago
Yes, I saw one in huggingface a few days ago. https://huggingface.co/GeorgeNhj/BERT_based_My_SecurityLLM
827.
by segmondy 3y ago
Goes to show we have always had the "tech" just not the idea.
828.
by segmondy 3y ago
my daily driver is an i5 PC that I bought in 2012. Haven't even thought much about it. It had 12gb, I recently upgraded it to 24gb. No plans to really upgrade, it runs linux and get's the job done. My macbook is a 2012 too.
829.
by segmondy 3y ago
Wow, folks are writing new code bases in Pascal and Prolog. At least that I know.
830.
by segmondy 3y ago
Don't buy anything from Amazon that you would put in your mouth, supplements, food, toothpaste, mouthwash, anything! I'm even wondering if to do the same for things applied to body as well, my wife recently bought a hair cream be
831.
by segmondy 3y ago
if you don't get anything out of this and don't know Hoare's work, go read CSP - http://www.usingcsp.com/cspbook.pdf
832.
by segmondy 3y ago
It's time for someone else to replace Canonical, that's all I can read from this. We can expect more of this rubbish in the future.
833.
by segmondy 3y ago
Profitability likewise means jack shit. You just need to be have a successful acquisition by a lazy dinosaur or go make enough income to go public. You can lose money for 10yrs straight while transferring wealth from the public to the inv
834.
by segmondy 3y ago
Now, do the inverse and implement postscript in BF
835.
by segmondy 3y ago
if you don't pass the PIP, you often get blacklisted and won't ever get hired again. so if you get another job and quit, say good bye. If the new company you work for get's acquired, you will be let go and won't be in
836.
by segmondy 3y ago
Racism and class warfare fueled the decline. Look at every single location that has declined, it can be attributed to one or the other. Hate is causing the country to implode and we can't even see it.
837.
by segmondy 3y ago
What's lazy about it?! You still understood the message
838.
by segmondy 3y ago
are you offering 50%?
839.
by segmondy 3y ago
I suspect they are trying to do for gaming what they did for videos. Saying it's not going to happen is like saying video streaming just isn't going to happen. The tech was far behind but it caught up.
840.
by segmondy 3y ago
Terrifying as someone who has well water. I don't use chemicals to control the weed on the lawn, but who knows what my neighbors are doing. Guess I'm going to switch to bottled water. :-/

More ›