6 ms·

The most interesting thing about this announcement is the huge emphasis on GPUs at Baidu driven by Ren Wu: http://on-demand.gputechconf.com/gtc/2014/presentati

by varelse 12y ago

The most interesting thing about this announcement is the huge emphasis on GPUs at Baidu driven by Ren Wu: http://on-demand.gputechconf.com/gtc/2014/presentations/S4651-deep-learning-meets-heterogeneous-computing.pdf http://on-demand.gputechconf.com/gtc/2014/presentations/S465... Combine this with Andrew Ng, whose own student Adam Coates matched Google's cat detector network with 64 consumer grade GPUs, and we are in for interesting times... http://www.stanford.edu/~acoates/papers/CoatesHuvalWangWuNgCatanzaro_icml2013.pdf http://www.stanford.edu/~acoates/papers/CoatesHuvalWangWuNgC...

ccubess 12y ago
Adam Coates has done many more impressive things than that. The "cat detector" was an uninteresting piece of research and not very impressive at all. The image net results were bad and nets trained on one or two gpus were doing much more interesting things.
mark_l_watson 12y ago
In Hinton's Coursera class, which was very good, he made a strong point about GPUs being the way to go (at least for now) in building deep learning networks.
- visarga 12y ago
  Why are they still using GPUs? Maybe hardware companies should start making AI targeted processors instead. Could they boost performance 10 times with a dedicated processor?
  - p1esk 12y ago
    Until we know what is the best architecture for AI, it's just easier to play with it in software.
  - jmalicki 12y ago
    GPGPU designs from NVidia are an AI targeted processor. It's the application they're designed for, and used everywhere for.
seanmcdirmid 12y ago
GPUs out perform distributed computing currently for deep learning training, but it will be interesting to see how MPI and CUDA will be combined in the future (there are already people working on that, but its still early).
bhrgunatha 12y ago
In the presentation you linked by Baidu's Ren Wu on page 6 it says: Deep Learning: AI Brain - World's first RI What is RI? I haven't seen the acronym before.
- poopchute 12y ago
  I've seen the acronym used for Restricted Intelligence, though I'm not sure that its the intended meaning here.
- jimgardener 12y ago
  Reinforcement Learning?
  - gnurag 12y ago
    Says RI. Reinforced Intelligence?
- deleted 12y ago
  [deleted]
- Mercher 12y ago
  Might just be "Research Institute": 'The Institute of Deep Learning (IDL) is the first formally established research institution projected to be Baidu's “Artificial Intelligence Lab”.' source: http://idl.baidu.com/en/IDL-about.html http://idl.baidu.com/en/IDL-about.html
  - bhrgunatha 12y ago
    Ah yes I think you're right - I guessed the I stood for intelligence and couldn't come up with anything.

by varelse 12y ago

ccubess 12y ago

Adam Coates has done many more impressive things than that. The "cat detector" was an uninteresting piece of research and not very impressive at all. The image net results were bad and nets trained on one or two gpus were doing much more interesting things.

mark_l_watson 12y ago

In Hinton's Coursera class, which was very good, he made a strong point about GPUs being the way to go (at least for now) in building deep learning networks.

visarga 12y ago
Why are they still using GPUs? Maybe hardware companies should start making AI targeted processors instead. Could they boost performance 10 times with a dedicated processor?
- p1esk 12y ago
  Until we know what is the best architecture for AI, it's just easier to play with it in software.
- jmalicki 12y ago
  GPGPU designs from NVidia are an AI targeted processor. It's the application they're designed for, and used everywhere for.

seanmcdirmid 12y ago

GPUs out perform distributed computing currently for deep learning training, but it will be interesting to see how MPI and CUDA will be combined in the future (there are already people working on that, but its still early).

bhrgunatha 12y ago

In the presentation you linked by Baidu's Ren Wu on page 6 it says: Deep Learning: AI Brain - World's first RI What is RI? I haven't seen the acronym before.

poopchute 12y ago
I've seen the acronym used for Restricted Intelligence, though I'm not sure that its the intended meaning here.
jimgardener 12y ago
Reinforcement Learning?
- gnurag 12y ago
  Says RI. Reinforced Intelligence?
deleted 12y ago
[deleted]
Mercher 12y ago
Might just be "Research Institute": 'The Institute of Deep Learning (IDL) is the first formally established research institution projected to be Baidu's “Artificial Intelligence Lab”.' source: http://idl.baidu.com/en/IDL-about.html http://idl.baidu.com/en/IDL-about.html
- bhrgunatha 12y ago
  Ah yes I think you're right - I guessed the I stood for intelligence and couldn't come up with anything.