magic_at_nodai

5 ms·

1.
by magic_at_nodai 8mo ago
yes lmk how i can help. at the minimum i can get you hw and help with PRs etc. firstname at amd.com to reach me.
2.
by magic_at_nodai 2y ago
Im running ROCm ok on my 9070XT. You can build it from source today if you have a card. rocminfo: **** Agent 2 **** Name: gfx1201 Uuid:
3.
by magic_at_nodai 2y ago
ROCm on Radeon should work too and the poll above was to seek feedback on what to cards to support next.
4.
by magic_at_nodai 2y ago
I will provide this feedback to the docs team to clean up. I found it hard when i was making that Poll :D but I looked harder instead of trying to fix the docs. So thank you for the feedback.
5.
by magic_at_nodai 2y ago
Is this the repo you are referring to https://github.com/amd/go_amd_smi ? Would having a prebuilt version there help you ?
6.
by magic_at_nodai 2y ago
yes. We are behind on software support for all consumer cards and would love to support all cards. But are looking for guidance / feedback so we can prioritize.
7.
by magic_at_nodai 2y ago
I have quad w7900s under my desk that work well for workloads on my desktop that translate well to MI300x. There are some perf gaps with FAv2, and FP8 but otherwise I get a seamless experience. lmk if you have a pointer to any github issues
8.
by magic_at_nodai 2y ago
We do care about software and acknowledge the gaps and will work hard to make it better. Please let me know any specific issues that are an issue for you and Im happy to push for it to get resolved or come back with why it isn't.
9.
by magic_at_nodai 2y ago
PTX does provide a low level machine abstraction. However you still target some version of hardware ( https://arnon.dk/matching-sm-architectures-arch-and-gencode-... ). However a lot of software effort has gone into it to m
10.
by magic_at_nodai 2y ago
hey thats me. Happy to help answer anything here and look forward to your constructive feedback to make AMD software better. We got work to do and look forward to it.
11.
by magic_at_nodai 3y ago
AMD Artificial Intelligence Group (AIG) | Remote / Global AMD Artificial Intelligence Group (AIG) leads AMD AI strategy and drives AI roadmap across client, edge, and cloud. We build AI capabilities, including silicon, software, models
12.
by magic_at_nodai 4y ago
We have it running as part of SHARK (which is built on IREE). https://github.com/nod-ai/SHARK/tree/main/shark/examples/sha...
13.
by magic_at_nodai 4y ago
Can you give SHARK a try and let us know on our discord? We can try to help. People have been using it on older AMD GPUs back to Polaris arch.
14.
by magic_at_nodai 4y ago
Here are a list of potential issues https://github.com/AUTOMATIC1111/stable-diffusion-webui/disc... That said we (Nod.ai team) will add support for xformers soon so you can opt in for xformers anyway.
15.
by magic_at_nodai 4y ago
Try SHARK on your AMD GPUs for SD. Follow the setup here: https://github.com/nod-ai/SHARK/tree/main/shark/examples/sha... . It works with Pytorch -> torch-mlir -> MLIR / IREE -> vu
16.
by magic_at_nodai 5y ago
unlikely since the interface from ANE is not public and it may change between hardware versions.
17.
by magic_at_nodai 5y ago
I updated the blog with the reference. Basically it crashes to compile the model with https://github.com/NodLabs/shark-samples/blob/main/examples/... . The coremltools converter is very version speci
18.
by magic_at_nodai 5y ago
Yeah the ANE and AMX on cpu are wrapped behind Accelerate Framework and CoreML. So you will have to use CoreML (which wasn't able to compile the latest TF BERT). ANE is also inference only. So if you want training you will have to use
19.
by magic_at_nodai 5y ago
Thanks to: LLVM/MLIR --> For the awesome compiler infrastructure IREE --> For the awesome backend to MLIR SHARK/nod.ai --> For adapting IREE for use on various hardware and fine tuning for target hardware. //par
20.
by magic_at_nodai 5y ago
This is not part of regular pytorch install. If you can build torch-mlir and SHARK from src you can use it. So hopefully soon we can make pip installable packages but for now the interfaces are in constant development so you will have to bu