3 ms·
Most of the major labs I've seen pay six figures easily to their top researchers. Good compute is one of the biggest reasons why researchers would want to work
by deepnotderp 10y ago
Most of the major labs I've seen pay six figures easily to their top researchers. Good compute is one of the biggest reasons why researchers would want to work somewhere. Skimping on compute seems foolish at that stage.
Here's a half-joking, half-serious take on the matter: https://twitter.com/deliprao/status/842636496666419200 https://twitter.com/deliprao/status/842636496666419200
- taneq 10y agoYeah but is that P100 better than five or six 1080Ti cards?
- deepnotderp 10y agoBecause parallelization is so difficult, yes.
- milesrout 10y agoIf you are using a GPU, parallelisation is not difficult.
- jacquesm 10y agoI believe you may be missing something. Even on a GPU there are synchronization points in some algorithms and data needs to be passed from one processor to another once you spill over the boundary of what can be held in the RAM. Also, some parts of an algorithm may not be parallelizable at all. GPU parallelization is only 'not difficult' if: - all your data fits on a single GPU - your code is embarassingly parallel - for the total duration of one computation Bonus if you do can use the output of one computation as the input of the next. In all other kinds of computations the usual bottle-necks apply. https://en.wikipedia.org/wiki/Amdahl%27s_law https://en.wikipedia.org/wiki/Amdahl%27s_law
- deepnotderp 10y agoI was talking about multi-GPU parallelization. Multi GPU SGD parallelization is not easy. Single GPU parallelization is trivial of course.
- seanmcdirmid 10y ago> Most of the major labs I've seen pay six figures easily to their top researchers. Even a normal programmer easily makes six figures, I hope they are doing better than that given the demand in this space.
- deepnotderp 10y agoThat was a conservative estimate.
- posterboy 10y agoI thought you might have meant monthly