steeve

5 ms·

1.
by steeve 10d ago
https://x.com/harshagundal/status/2100044305536889015?s=20 > They were building in stealth for 2 years, I was building in stealth for 2 hours… > Happy to open source Qwen-2.5-1B-RLCD, 5x faster on-device inf
2.
by steeve 2mo ago
XLA uses MLIR very much, the interface to it is StableHLO, which is a MLIR dialect.
3.
by steeve 2mo ago
> Plus, no need to build XLA using Bazel either! You’re welcome. I don't get it, Bazel is incredible.
4.
ZML/LLMD alpha – cross platform LLM server(zml.ai)
16 points by steeve 3mo ago|3 comments
5.
by steeve 4mo ago
sidenote: it is possible to use Vulkan to map GPU memory to CPU space and even map it back to CUDA: https://x.com/steeve/status/2055042304344231978?s=20
6.
by steeve 6mo ago
consider it done
7.
by steeve 6mo ago
Weird, because we tried it. It doesn’t show anything? We use the amdsmi to get metrics. I’ll investigate.
8.
by steeve 6mo ago
sadly, sandboxing is something that can't be upstreamed. this way, sandboxing is kept in zml instead of patching mesa. as for nvtop, great program, but we missed a few features (such as sandboxing)
9.
Zml-smi: universal monitoring tool for GPUs, TPUs and NPUs(zml.ai)
77 points by steeve 6mo ago|11 comments
10.
ZML/v2: Frontier performance through composability(zml.ai)
5 points by steeve 6mo ago|0 comments
11.
by steeve 7mo ago
hi, i'm the founder of https://github.com/zml/zml , very happy with Zig
12.
by steeve 7mo ago
Misleading title. It's about using their AI service, not the editor.
13.
by steeve 7mo ago
we (ZML) have been back to following Zig master since std.Io was introduced. It's not that bad tbh. Also most changes really feel like actual improvements to the language on a day to day basis.
14.
by steeve 7mo ago
ZML
15.
by steeve 8mo ago
tldr: they replaced using protobuf as the type system across language boundaries for FFI with true FFI
16.
by steeve 8mo ago
i can't help but think of the scammy communication around this on X. and the actual need to be deceitful about it. oh how low the mighty have fallen
17.
by steeve 8mo ago
very very cool !
18.
by steeve 9mo ago
This looks incredible, congratulations!
19.
by steeve 9mo ago
the upside is absolutely worth it
20.
by steeve 9mo ago
because he was been sending me updates about it for the last two weeks because we've been discussing architecture, optimisations and benchmarks because it's not a 13h old project
21.
by steeve 9mo ago
he’s been working on it for 2 weeks, as he said somewhere else
22.
by steeve 9mo ago
sure, i hereby disclose that he left in September i already said in another reply that i knew him personally
23.
by steeve 9mo ago
the way he came barging through the door doesn’t invite sympathy
24.
by steeve 9mo ago
well, bazel is by far the most reliable one so I'm not sure why you're complaining
25.
by steeve 9mo ago
and it would be terrible for hermeticity and reproducibility, nix tries very hard and gets mediocre results perhaps, just perhaps, why people go through the trouble not because they are idiots but for actual engineering reasons
26.
by steeve 9mo ago
nobody cares about the website being done with AI because the code of the project itself is not AI you need to touch grass
27.
by steeve 9mo ago
Thank you
28.
by steeve 9mo ago
Yes but have you heard of the Somali daycare in Minnesota? Also, something something great replacement.
29.
by steeve 9mo ago
this is incredible
30.
by steeve 10mo ago
with io_uring? How? I tried everything in the book

More ›