3 ms·

This uses a more accurate neuron model than your everyday neural networks.

• gwern 9y ago
  Nevertheless, Cartpole is a trivial RL task which only requires a few neurons to solve, much less hundreds. Since they're training it in silico, I'm not sure what this demonstrates other than you can cudgel a vaguely spiking-like neural network into learning a simple task. It's not a C. elegans behavior.
  • guskel 9y ago
    Cartpole solved with 1 neuron, no weights. https://gym.openai.com/evaluations/eval_A7rFUDisQiOsADyvqYhVSA/#reproducibility https://gym.openai.com/evaluations/eval_A7rFUDisQiOsADyvqYhV...
    • gwern 9y ago
      I rest my case. :)
    • dekhn 9y ago
      This is very close to a P controller (like PID, but without the integral and derivative terms).
• simonster 9y ago
  It's a more accurate neuron model of some pretty weird neurons. In nearly all organisms, the vast majority of neurons fire all-or-nothing action potentials ("spikes"). C. elegans neurons do not.