georgehotz

6 ms·

31.
by georgehotz 10mo ago
What's even sadder is that because of AI coding agents it's possible the bounty system will go away. The value today is much less in writing the code and much more in defining the tasks and validating the code. We don't have
32.
by georgehotz 10mo ago
tinygrad has a PyTorch frontend, we fully encourage the frontend to stay PyTorch and for them to integrate tinygrad at any level. Our mission is to commoditize the petaflop, all frontends are welcome. We also have a quite complete ONNX fron
33.
by georgehotz 10mo ago
That's comma.ai's policy since they make hardware and solve physical problems. The tiny corp has been hybrid (remote-first) since day 1 because it primarily writes open source software, and there's a long track record of succ
34.
by georgehotz 11mo ago
I mean, everyone else was using them too, how can you not? That was the name of the game if you wanted to be competitive in 2024. Not using them would be like trying to do competitive pro cycling without steroids, basically impossible.
35.
by georgehotz 11mo ago
I support the no global leaderboard. I was in 7th place last year but quickly got bored maintaining the aggressive AI pipeline required to achieve that. If I wanted to maintain pipelines I'd just do work, and there will never be a good
36.
by georgehotz 11mo ago
comma.ai owns a lot of cars, including a Tesla, so I have tried most cars in the price range. Tesla is certainly no more of a scam than the other cars, and compared to say, the Chevy Bolt, it's a lot better. Can you suggest a better ca
37.
by georgehotz 11mo ago
Musk sells several things. Electric cars for $40k-$100k. Satellite internet for $40-$120 per month. X/Grok premium for $8/mo. And space launch services for about $2,500 per kg. Which one(s) of these are the scam? Prices seem decen
38.
by georgehotz 11mo ago
Maybe a few people managed to outsource their own job and sit in the middle for a bit. But that's not the common story, the common story is that your employer cut out the middle man and outsourced all the jobs. The same thing will happ
39.
by georgehotz 11mo ago
How do they own it? I see two scenarios. 1. They built the agent and it's somehow competitive. If so, they shouldn't just replace their own job with it, they should replace a lot more jobs and get a lot more rich than one salary.
40.
by georgehotz 11mo ago
Do people on Hacker News actually believe this? Each one of the four people named built a product I happily pay for! Then they used investment and profits to hire people to build more products and better products. There's a lot of scam
41.
by georgehotz 11mo ago
You are welcome to try to cut them out and start your own business. But I suspect you might find it a bit harder than your employer signing up for a SaaS AI agent. Actually wait, isn't that what this website is? Does it work?
42.
by georgehotz 11mo ago
Who's giving you that paycheck? Why don't they just hire that AI agent themselves and cut out the middle man?
43.
by georgehotz 11mo ago
1 and 2 are supported, 1 you need to specify, 2 will be found with BEAM. We are working on reimplementing HipKittens in tinygrad, all the stuff is there to do it. See the amd_uop_matmul example. tinygrad doesn't support 3 yet, it'
44.
by georgehotz 11mo ago
Nope! Works fine with in-tree somewhat recent kernel. The AMD driver is actually open source, not just a wrapper into a big on device blob like the NVIDIA one. tinygrad also has a driver that doesn't even need the kernel module, just m
45.
by georgehotz 11mo ago
Full disclosure, we have a contract with AMD to get Llama 405B training on MI350X on MLPerf. Things are turning around for AMD. If you have an AMD card, go to pytorch.org, click Linux+ROCm and install PyTorch. 3 years ago, this was hopeless
46.
NVIDIA eGPU over USB4 on MacBook(twitter.com)
4 points by georgehotz 1y ago|1 comments
47.
by georgehotz 1y ago
This is bait. The comment and the blog post say mostly the same thing, the debate is around the subtle edges. It's not a "compiler," it's a "probabilistic code synthesizer guided by your constraints" The latter
48.
by georgehotz 1y ago
Author here. I agree with this comment, but if I wrote more like this my blog post would get less traction. "LLM coding tools are search-based program synthesizers," in my mind this is what compilers are. I think most compilers do
49.
by georgehotz 1y ago
That's not price discrimination, like hardcover vs paperback if you have two versions of something and people can choose which they want. That's totally fine and actually something that makes capitalism great. The rich usually end
50.
by georgehotz 1y ago
Nice try. I worked at Facebook for 9 months and left (before vesting any shares) because I didn't agree with the mission, even back in 2012. I worked at Twitter for 5 weeks and left because I realized nothing was going to change (and t
51.
by georgehotz 1y ago
We got the MI300X box on MLPerf too, and every MLPerf from here on general tinygrad improvements should bring down the times. We're still quite focused on AMD. Like it's strange people think I give up on things, I think they liste
52.
by georgehotz 1y ago
AMD has legitimately been making great progress. They still have a long way to go, and I appreciate SemiAnalysis taking up the mantle of calling them out, but I ran: pip3 install torch torchvision torchaudio --index-url https://d
53.
openpilot (open source ADAS) 0.9.8 release(blog.comma.ai)
8 points by georgehotz 2y ago|3 comments
54.
by georgehotz 2y ago
Unlike gold, the "finite supply" of BTC is socially constructed. That's my whole argument for gold. The finite supply isn't socially constructed, and getting more requires building real infrastructure.
55.
YOLOv8 demo using WebGPU on phones and laptops(wpmed92.github.io)
1 points by georgehotz 2y ago|0 comments
56.
In-browser Stable Diffusion with tinygrad WebGPU backend(wpmed92.github.io)
6 points by georgehotz 2y ago|0 comments
57.
by georgehotz 2y ago
FFI? This isn't how GPUs work...they are MMIO (mostly) Those drivers are faster than anything else when used to run fixed command queues (what neural network runs are)
58.
by georgehotz 2y ago
This sounds like prejudice. Have you benchmarked it?
59.
by georgehotz 2y ago
Umm, why not? We wrote entire NVIDIA, AMD, and QCOM drivers in that style. https://github.com/tinygrad/tinygrad/blob/master/tinygrad/ru... https://github.com/tinygrad/tinygrad&#
60.
by georgehotz 2y ago
Specs on website updated, anywhere from 100-240V is fine

More ›