3 ms·
Hey! Yes please dive in :) It can be a starting point for learning Rust ;) MatMul is fine, the bottleneck is LayerNorm + Softmax gradients right now. Haven't be
by keyvank 3y ago
Hey! Yes please dive in :) It can be a starting point for learning Rust ;)
MatMul is fine, the bottleneck is LayerNorm + Softmax gradients right now. Haven't been able to optimize them well yet.
- quickthrower2 3y agoWell, first step is to run it. I am getting a step every 3 seconds. Is that typical? i7-13700H, 2400 Mhz, 14 Core(s), 20 Logical Processor(s). It is using 12 CPUs which is good. And 160Mb memory.
- keyvank 3y agoAh, that's slow. I have been able to reach 1.3s per step on my machine. Did you run with --release flag?
- quickthrower2 3y agoYes release. Is running on Windows which might affect things.