checker659

7 ms·

61.
by checker659 10mo ago
OS kernels? Everything from numpy to CUDA to NCCL is using C/C++ (doing all the behind the scene heavy lifting), never mind the classic systems software like web browsers, web servers, networking control plane (the list goes on).
62.
by checker659 10mo ago
I think the burden of proof is on the people making the original claim (that LLMs are indeed spitting out original code).
63.
by checker659 10mo ago
I've always wondered. If you have fuck you money, wouldn't it be possible to build GPUs to do LLM matmul with 2008 technology. Again, assuming energy costs / cooling costs don't matter.
64.
by checker659 10mo ago
> The fundamentals actually haven't changed that much in the last 3 years Even said fundamentals don't have much in the way to foundations. It's just brute forcing your way using a O(n^3) algorithm using a lot of data and
65.
by checker659 10mo ago
Great tool. Thank you.
66.
by checker659 10mo ago
I think the current grads are going to be shafted either way. In 5 years, there might be more opening for "fresh" young grads and the companies will prefer them over the young people who're just graduating.
67.
by checker659 11mo ago
Without open source there would be no code writing LLMs. It is charity of the highest order (to say the least).
68.
by checker659 11mo ago
You're right. But I easily round robin between Claude, ChatGPT and Gemini every day without noticing any friction whatsoever.
69.
by checker659 11mo ago
This is the most creative comment I've read on HN as of late.
70.
by checker659 11mo ago
The structure in the README.md (not the actual structure).
71.
by checker659 11mo ago
That project structure is reminding me of claude.
72.
by checker659 11mo ago
But isn't that their "moat"? If the moat is the source of losses, then yes, they're operating at a huge loss.
73.
by checker659 11mo ago
Are the companies making a profit on every prompt I give it (factoring in the cost of upgrading GPUs every year or two)?
74.
by checker659 11mo ago
The economics of it is what's the problem, not the power of LLMs.
75.
by checker659 11mo ago
Ray Kurzweil
76.
by checker659 11mo ago
We need to start a company that is like a cooperative that trains juniors to become seniors.
77.
by checker659 11mo ago
I think you'd get better answers from GLP1 subreddits and /r/science than from HN readers.
78.
by checker659 11mo ago
> ~7× faster than NumPy Is that on the CPU (not sure if NumPy has a GPU backend)
79.
by checker659 11mo ago
I meant that IFF the author wrote it themself. IFF.
80.
by checker659 11mo ago
I was skeptical at first, but this does stink of auto-generated code. I want to believe it is not.
81.
by checker659 11mo ago
It could be a vehicle to learn about traceroute / ICMP.
82.
by checker659 1y ago
> making it quite unappealing from an engineering standpoint The other option being rewriting everything under the sun from scratch.
83.
by checker659 1y ago
Latency Numbers Every Programmer Should Know (originally by Jeff Dean / Peter Norvig) https://gist.github.com/jboner/2841832
84.
by checker659 1y ago
The concept of pages is baked deep into the memory hierarchy (cache, TLBs). What exactly do you mean by precursor? I imagine you're thinking of pages as an abstraction over something more fundamental (?).
85.
by checker659 1y ago
I mean, sandboxing AI agents once they get smarter is a valid concern (if not a major future concern).
86.
by checker659 1y ago
They are working with tiny models. Not sure how well it'd scale to bigger models (if at all).
87.
by checker659 1y ago
Isn't it the DMA engine that's responsible for the data movement? How does the size of the BAR even factor into that?
88.
by checker659 1y ago
> Even when looking at something as barebones as perceptrons I was thinking something like "it is trying to approximate a non-linear function" (which is what it is in the case of MLPs).
89.
by checker659 1y ago
I have done a little bit of DL stuff (with keras) before this. I'm currently in the attention chapter. The book gives you the code, but I feel like there is very little in the way of building intuition. Thankfully, there are tons of vi
90.
by checker659 1y ago
So, they were all blind? They couldn't see each other? (Not to mention reflection in water).

More ›