3 ms·
Zml-smi: universal monitoring tool for GPUs, TPUs and NPUs
- mrflop 6mo agoRenaming fopen64 to intercept library calls feels like a brittle hack masquerading as "sandboxing." Why not just upstream this hardware support to nvtop instead of fragmenting the ecosystem?
- steeve 6mo agosadly, sandboxing is something that can't be upstreamed. this way, sandboxing is kept in zml instead of patching mesa. as for nvtop, great program, but we missed a few features (such as sandboxing)
- pstuart 6mo agoIt looks cool and I was excited to get monitoring for the NPU on my Ryzen AI 395+, unfortunately it does not show. NPU support in linux really seems to be an afterthought.
- steeve 6mo agoWeird, because we tried it. It doesn’t show anything? We use the amdsmi to get metrics. I’ll investigate.
- marwanet 6mo agoIf this logic were pushed into nvtop, wouldn't the codebase become unmaintainable? Each vendor's interception method is going to be different.
- nareyko 6mo ago[dead]
- rdyro 6mo agoLooks cool! nvtop can actually support TPUs too via https://github.com/rdyro/libtpuinfo/ https://github.com/rdyro/libtpuinfo/ https://github.com/Syllo/nvtop/blob/76890233d759199f50ad3bdb57a0c0988e96fc44/CMakeLists.txt#L100 https://github.com/Syllo/nvtop/blob/76890233d759199f50ad3bdb...
- 152334H 6mo ago"NPU" seems to refer to trainium only?
- serialx 6mo agoLook into all-smi https://github.com/lablup/all-smi https://github.com/lablup/all-smi It supports all GPUs thinkable including Apple Silicon and many AI accelerator cards.
- imcritic 6mo agoIs it capable of exposing metrics in Prometheus format?
- steeve 6mo agoconsider it done
- synergy20 6mo agowould be nice to have cpu usage added so I have all in one? currently I use btop which shows basic gpu load along with cpu, network, etc.