3 ms·
I think it will be quite a few years before an LLM is built into their silicon. But I do see a Neural Engine 2.0 in the future that will better handle these th
by sroussey 4y ago
I think it will be quite a few years before an LLM is built into their silicon.
But I do see a Neural Engine 2.0 in the future that will better handle these things in the more near term future.
- Sugimot0 4y agoiirc creating new ml optimized chips/chiplets was part of the appeal for risc-v right? Is risc-v relevant yet, or are there any promising risc-v chips on the way? I know there's a lot of hype around them, so i'm curious to know how much is just noise or what the real sentiment is from the experts/industry.
- deleted 4y ago[deleted]
- bohadi 4y agoI've been looking into this. The great thing is riscv isa is free to license and customize. There's opportunity for efficient inference at the edge. If anyone is interested in working on this together, send me a private message.