yu3zhou4

7 ms·

31.
Ask HN: Did Claude lowered its usage limits?
7 points by yu3zhou4 6mo ago|2 comments
32.
by yu3zhou4 6mo ago
Thx, great read about Yemen from Maciej Cegłowski https://idlewords.com/2014/07/sana_a.htm
33.
Benchmark LLM Inference on WebGPU(arxiv.org)
1 points by yu3zhou4 6mo ago|0 comments
34.
by yu3zhou4 6mo ago
An open course on building high performance LLM inference engine! Hope to finish by the end of April https://github.com/jmaczan/tiny-vllm
35.
by yu3zhou4 6mo ago
I love this article, the edge cases are where the seeming “simplicity” of floating-point numbers breaks down Recently wrote a chapter in tiny-vllm course about floats in context of LLM inference, much shorter and not that deep as this one,
36.
by yu3zhou4 6mo ago
Honestly there is a lot for room of improvement in torch-webgpu for performance. Needs involvement of community but the opportunities are definitely there
37.
Show HN: WebGPU LLM inference comprehensive benchmark(arxiv.org)
2 points by yu3zhou4 6mo ago|2 comments
38.
by yu3zhou4 6mo ago
Overall I think it’s a good perspective and worth reading to learn your perspective and experience. Just for anyone who doesn’t come from a good place, please be kind to yourself. You probably really need to work exceptionally hard and need
39.
by yu3zhou4 6mo ago
Good for the maintainer, hope they find peace and do things just for their fun, without needing to deal with comments like that anymore
40.
by yu3zhou4 7mo ago
So in some sense we start recreating an operating system, or at least the userspace, within the Claude code. There was some name for this pattern but I can’t recall
41.
by yu3zhou4 7mo ago
Can confirm that it also happens in other complex systems! Still a lot of good time and the novelty factor helps with pushing through
42.
by yu3zhou4 7mo ago
Congrats and happy for you, you had a lot of fun and did something genuinely interesting
43.
by yu3zhou4 7mo ago
I’m recreating a tiny version of vLLM in C++ and CUDA from scratch (high throughput LLM inference server) https://github.com/jmaczan/tiny-vllm
44.
by yu3zhou4 8mo ago
Liar paradox
45.
by yu3zhou4 8mo ago
I had to use AI to actually understand what you wrote it and I think it's an underrated comment
46.
by yu3zhou4 8mo ago
Thank you very much!
47.
by yu3zhou4 8mo ago
Please share prompts or md files so we can generate more!
48.
by yu3zhou4 8mo ago
I try my best to push ML things into WebGPU and I think it has a future, but performance is not there yet. I have little experience with Vulkan except toy projects, but WebGPU and Vulkan seem very similar
49.
by yu3zhou4 8mo ago
PyTorch compiler and runtime for WebGPU!
50.
by yu3zhou4 8mo ago
ngmi
51.
by yu3zhou4 8mo ago
At this point, I genuinely don't know what to learn next to not become obsolete when another Opus version gets released
52.
by yu3zhou4 9mo ago
This is hilarious, 5 years ago I built a very similar cli tool based on the same idea and with the same name (whosthere but in Polish, ktotu [0]). I wonder if you used AI to generate the project and the idea Congrats for the execution, it l
53.
Show HN: You can run real PyTorch in a browser(browser-torch.maczan.pl)
3 points by yu3zhou4 9mo ago|0 comments
54.
by yu3zhou4 9mo ago
Performance is not there yet, honestly. I haven’t focus on running things fast, but it’s one of next directs steps I’ll take. The problem with running it in a browser is that we need to find a way to run the PyTorch itself in a browser and
55.
Show HN: I got PyTorch models running on WebGPU without ONNX export(github.com)
1 points by yu3zhou4 9mo ago|1 comments
56.
Show HN: Run and Compile LLMs in PyTorch on WebGPU(github.com)
1 points by yu3zhou4 9mo ago|0 comments
57.
by yu3zhou4 9mo ago
PyTorch compiler and runtime for WebGPU https://github.com/jmaczan/torch-webgpu
58.
by yu3zhou4 10mo ago
On Safari mobile it shows a modal that can’t be scrolled nor closed
59.
by yu3zhou4 10mo ago
Good luck to everyone in achieving their goals and exploring new paths! To me it's deep learning compilers since mid 2025. I am a person who can't learn just from reading books, so 80% of time I learn by doing (contribute to PyTor
60.
by yu3zhou4 10mo ago
WebGPU backend for PyTorch https://github.com/jmaczan/torch-webgpu

More ›