3 ms·
That is awesome! I am curious about the decision to not use GPU since this is for Apple Silicon. Wouldn't the GPU potentially accelerate the DeltaNet/attentio
by felineflock 3mo ago
That is awesome!
I am curious about the decision to not use GPU since this is for Apple Silicon.
Wouldn't the GPU potentially accelerate the DeltaNet/attention layers and matrix multiplication in general?
- dwa3592 3mo agoIt will, but the process at this point is SSD bound rather than compute bound. On a bigger machine, Apple silicon must help but I don't have a bigger machine. I can think about this more and will make changes if that helps.
- deleted 3mo ago[deleted]