4 ms·
It wouldn't surprise me to see some ML algorithm in silico somewhere to select faster matmul paths on favorable data. Yo dawg, I heard you like AI, so we put so
by bitwize 5mo ago
It wouldn't surprise me to see some ML algorithm in silico somewhere to select faster matmul paths on favorable data. Yo dawg, I heard you like AI, so we put some AI in your AI so you can infer while you're inferring.
- falcor84 5mo agoAnd there's at least one more level of inception at the data center level, where they use AI to optimize power usage (particularly by predictively controlling cooling, and adaptively rescheduling tasks).
- Nevermark 5mo agoHere is one: An adjustment to weight updates, that makes it more likely for weights to stay uniformly distributed. ~257.5 teraflops for normal distribution, versus ~268 teraflops uniform, reported on the first graph. I would have liked to see a straight graph of performance vs. clock speed, for each type of data. Pick your data statistics, then pick the peak performance clock speed accordingly. And for actual runs, from a pre-run sampled curve.
- rowanG077 5mo agoThis is old news. AMD was this in their CPUs years ago.