3 ms·
RL needs a supercomputer and its code is usually too fragile - making a trivial mistake anywhere (missing a constant multiplication, swapping the order of two c
by bitL 6y ago
RL needs a supercomputer and its code is usually too fragile - making a trivial mistake anywhere (missing a constant multiplication, swapping the order of two consecutive lines of code etc.) would likely lead to your model never converging even if you got everything else right.
- Ma8ee 6y agoWhich code is not fragile in that sense? I think that is a rather strange criticism.
- Iv 6y agoYou can do RL on an raspberry pi. Depends what problem you are trying to solve but not all of them require video analysis and billions of parameters.
- cbames89 6y agoTechnical point: Value functions that are a constant multiples of each other result in the same behavior.
- bitL 6y agoMaking a constant multiplication mistake somewhere in the code doesn't imply the new value function would be a constant multiply of the optimal one.
- chasely 6y agoThe hard part of RL for the problems I've encountered in my work is that you need a simulator. Building a reliable and accurate simulator is often an immense undertaking.
- dgb23 6y agoMaybe data scientists should team up (more?) with game programmers. They have a ton of experience in building very complex simulations.