3 ms·
So out of all the inference only chips which ones can I buy? The only report is a smartnic fpga from Alibaba where we take an onnx design and write our own. h
by iFire 1mo ago
So out of all the inference only chips which ones can I buy?
The only report is a smartnic fpga from Alibaba where we take an onnx design and write our own.
https://essenceia.github.io/projects/alibaba_cloud_fpga/ https://essenceia.github.io/projects/alibaba_cloud_fpga/
On my M2 Pro Mac Mini the ANE only allows 2 gigabytes compared to the Metal GPU which can use the system ram.
Currently playing with https://www.asus.com/motherboards-components/ai-accelerator/ugen/ugen300-usb-8g/ https://www.asus.com/motherboards-components/ai-accelerator/... which is a 4bit, 8bit and 16 bit ai inference chip with 8 gigabytes of ram.
The UGen300 has the Hailo-10H chipset.
The ASUS Store price for the ugen300-usb-8g costs $365.00 Canadian dollars.