kolbe

8 ms·

61.
by kolbe 2y ago
I think the bigger issue is hardware utilization. Meta and Qwen's medium sized models are fantastic and competitive with 6 month old offerings from OpenAI and Claude, but you need to have $2500 of hardware to run it. If you're goi
62.
by kolbe 2y ago
They might be talking about 70B
63.
by kolbe 2y ago
AMD GPUs are a fantastic deal until you hit a problem. Some models/frameworks it works great. Others, not so much.
64.
by kolbe 2y ago
If you want to wait until the 5090s come out, you should see a drop in the price of the 30xx and 40xx series. Right now, shopping used, you can get two 3090s or two 4080s in your price range. Conventional wisdom says two 3090s would be bett
65.
by kolbe 2y ago
The only thing you ever say is baseless criticisms of the intellectual prowess of HN and the media. Either justify these criticisms, accept we are the way we are, or leave.
66.
by kolbe 2y ago
Sounds like his problem
67.
by kolbe 2y ago
Just like advertising--if they have earned my attention by saying things I want to read, then they have the right to dilute its quality with whatever else they want, up until it net doesn't interest me anymore. In this case, the jab is
68.
by kolbe 2y ago
It's likely probabilistically linear... like speeding on a street with random traffic lights.
69.
by kolbe 2y ago
Maybe. Gemini Exp 1121 is blowing my mind. Could be that OpenAI is seeing the context window disadvantage vs Google looming.
70.
JPEG compress your LLM weights(pepijndevos.nl)
3 points by kolbe 2y ago|2 comments
71.
by kolbe 2y ago
I still like ispc, but that's not going to catch on.
72.
by kolbe 2y ago
You must never have seen Breaking Bad
73.
by kolbe 2y ago
They did it in the 90s as well, and it worked out fabulously. "The internet is a thing? Okay, now _everything_ is the internet." They lean hard into new technologies. That's the nature of VC. Sometimes they're right and
74.
by kolbe 2y ago
I think the reality is that it's too costly to put together a process that filters better. This has been deemed "good enough" and they can fire you if the filter didn't work properly.
75.
by kolbe 2y ago
I don't mind the coding challenges necessarily, but more how they're implemented. I find them to be far too broad relative to the day-to-day, and it only showcases how quickly someone can write unthoughtful code. For example, it&#
76.
by kolbe 2y ago
Scalar languages can go a long ways in this exercise. There are a few hiccups in trying to vectorize scalar languages, but see how well clang's latest -O3 models can do on C++. I would love to see ISPC take off. It's my favorite w
77.
by kolbe 2y ago
How does this argument square with them driving a $150k BMW?
78.
by kolbe 2y ago
Agreed. I gave up on trying to navigate the fraud. I've gone once in the past 15 years because my wife begged me to. I have yet to regret it whatsoever.
79.
by kolbe 2y ago
I find it less that the fines are trivial than it is fines are levied on the wrong entities. Consultants break the law--fine them personally. Police's officers abuse power--fine them personally. Bankers shirk regulation--fine them pers
80.
by kolbe 2y ago
He's high quality research by comparison to the absolute garbage that exists today--not by say classical Frontline or 60 Minutes standards
81.
by kolbe 2y ago
I don't think people who are so bitter about not being in a position of power that they will say any hyperbolic thing they can about McKinsey should be trusted on the topic either
82.
by kolbe 2y ago
If all comments here were eyed with the same cynicism, we'd have no genuine discussions. And maybe we don't.
83.
by kolbe 2y ago
How did that strategy work out for Intel?
84.
by kolbe 2y ago
The H100 has 16,000 cuda cores at 1.2ghz. My rough calculation is it can handle 230k concurrent calculations. Whereas a 192 core avx512 chip (assuming it calculates on 16 bit data) can handle 6k concurrent calculations at 4x the frequency.
85.
by kolbe 2y ago
For numerical PDE solvers, you never do the actual inversion, but the discretization of the system (denoted A) can have significant sensitivity to numerical precision. Look up Condition Number and Preconditioning. In fact, resolving the pro
86.
by kolbe 2y ago
Until my hardware implements f128, even if I had a solid use for it, I cannot sacrifice the speed relative to f64.
87.
by kolbe 2y ago
I love how the comment I'm responding to literally says "then collect $250k per year risk free after taxes," and then you all pile onto me with downvotes telling me that's he's not just going to invest in treasuries
88.
by kolbe 2y ago
The original comment was premised on them being income-generating assets, which gold and btc are not
89.
by kolbe 2y ago
And I would argue his "soft power" is greatly diminished as well
90.
by kolbe 2y ago
Assuming they're 40, how far do you think $250k will go 20-30-40 years from now? It's not a stretch to think dollars could be devalued by 90%, possibly even worthless, within 30 years.

More ›