4 ms·

A bit off topic, but does anyone knows if AI ( aka modern neural networks) plays a role in cpu design nowadays ?

by bsaul 9y ago

m-j-fox 9y ago
Here's one CPU that has nn in mind: https://cloudplatform.googleblog.com/2017/04/quantifying-the-performance-of-the-TPU-our-first-machine-learning-chip.html?m=1 https://cloudplatform.googleblog.com/2017/04/quantifying-the...
buryat 9y ago
not sure if they play a role in designing CPUs, but AMD says that their Zen CPUs have a neural network inside for branch prediction [1] which is not something new [2] [3] [1] https://www.amd.com/en/technologies/sense-mi https://www.amd.com/en/technologies/sense-mi [2] https://www.jilp.org/cbp2014/paper/DanielJimenez.pdf https://www.jilp.org/cbp2014/paper/DanielJimenez.pdf [3] http://cseweb.ucsd.edu/~atsmith/rnn_branch.pdf http://cseweb.ucsd.edu/~atsmith/rnn_branch.pdf
irishjohnnie 9y ago
Probably not. Do you use AI to write code?
- Symmetry 9y ago
  A compiler does a lot of AIish things in turning my C code into a sequence of instructions. Much more classical AI than machine learning but still within the AI umbrella.
  - irishjohnnie 9y ago
    I was referring to the RTL-based IP that goes into each subsystem of the CPU, hence the analogy to code. You're talking about compiler instruction scheduling, a lot of which are a bunch of non-AI algorithms. If I'm missing something, I would appreciate the references to the functionality you're referring to.
- manquer 9y ago
  Most of the time not even the natural one
- bsaul 9y ago
  Not now, but i'm pretty sure this would be a good technic to try for next gen autocomplete.
choudanu4 9y ago
Neural networks aside, machine learning is often used for implementing prediction mechanisms in CPUs. Good examples of prediction mechanisms are: - Branch Predictor - Cache Replacement Policy - Memory Prefetcher - Schedulers
- deleted 9y ago
  [deleted]
Nelson69 9y ago
In the designing of CPUs or if they are designed for running various neural networks? Because Nvidia seemed to be building giant products aimed pretty much exclusively at that. Google has their own "TPUs" for that. Intel's next Phi is designed for running that stuff. As for the design of CPUs, they do some automated layouts and some things like that, but I think that might not be what you mean.
- bsaul 9y ago
  Yes, i mean in the designing of CPUs. Like transistor layout. It seems like a big problem space where optimal arrangement is hard to find. So i wondered if people trained NN to do that.
Nokinside 9y ago
CPU layout and routing optimizations are global discrete optimization problems. Neural networks don't have much edge on these problems. Simulated annealing is the most used optimization method in routing and layout tools. There are number of research papers that attempt to use neural networks for combination optimization, but no interesting results.

A bit off topic, but does anyone knows if AI ( aka modern neural networks) plays a role in cpu design nowadays ?

by bsaul 9y ago

A bit off topic, but does anyone knows if AI ( aka modern neural networks) plays a role in cpu design nowadays ?

Here's one CPU that has nn in mind: https://cloudplatform.googleblog.com/2017/04/quantifying-the-performance-of-the-TPU-our-first-machine-learning-chip.html?m=1 https://cloudplatform.googleblog.com/2017/04/quantifying-the...

buryat 9y ago

not sure if they play a role in designing CPUs, but AMD says that their Zen CPUs have a neural network inside for branch prediction [1] which is not something new [2] [3] [1] https://www.amd.com/en/technologies/sense-mi https://www.amd.com/en/technologies/sense-mi [2] https://www.jilp.org/cbp2014/paper/DanielJimenez.pdf https://www.jilp.org/cbp2014/paper/DanielJimenez.pdf [3] http://cseweb.ucsd.edu/~atsmith/rnn_branch.pdf http://cseweb.ucsd.edu/~atsmith/rnn_branch.pdf

irishjohnnie 9y ago

Probably not. Do you use AI to write code?

Symmetry 9y ago
A compiler does a lot of AIish things in turning my C code into a sequence of instructions. Much more classical AI than machine learning but still within the AI umbrella.
- irishjohnnie 9y ago
  I was referring to the RTL-based IP that goes into each subsystem of the CPU, hence the analogy to code. You're talking about compiler instruction scheduling, a lot of which are a bunch of non-AI algorithms. If I'm missing something, I would appreciate the references to the functionality you're referring to.
manquer 9y ago
Most of the time not even the natural one
bsaul 9y ago
Not now, but i'm pretty sure this would be a good technic to try for next gen autocomplete.

choudanu4 9y ago

Neural networks aside, machine learning is often used for implementing prediction mechanisms in CPUs. Good examples of prediction mechanisms are: - Branch Predictor - Cache Replacement Policy - Memory Prefetcher - Schedulers

deleted 9y ago
[deleted]

Nelson69 9y ago

In the designing of CPUs or if they are designed for running various neural networks? Because Nvidia seemed to be building giant products aimed pretty much exclusively at that. Google has their own "TPUs" for that. Intel's next Phi is designed for running that stuff. As for the design of CPUs, they do some automated layouts and some things like that, but I think that might not be what you mean.

bsaul 9y ago
Yes, i mean in the designing of CPUs. Like transistor layout. It seems like a big problem space where optimal arrangement is hard to find. So i wondered if people trained NN to do that.

Nokinside 9y ago

CPU layout and routing optimizations are global discrete optimization problems. Neural networks don't have much edge on these problems. Simulated annealing is the most used optimization method in routing and layout tools. There are number of research papers that attempt to use neural networks for combination optimization, but no interesting results.