3 ms·
I believe this paper by Marcus ( https://arxiv.org/ftp/arxiv/papers/1801/1801.00631.pdf https://arxiv.org/ftp/arxiv/papers/1801/1801.00631.pdf ) earlier this we
by BucketSort 9y ago
I believe this paper by Marcus ( https://arxiv.org/ftp/arxiv/papers/1801/1801.00631.pdf https://arxiv.org/ftp/arxiv/papers/1801/1801.00631.pdf ) earlier this week inspired this.
Edit: I don't mean Marcus inspired the term differentiable programming; he inspired LeCun to emphasize the wider scope of deep learning after Marcus attacked it. In fact, LeCun liked a post on twitter rebutting Marcus' paper that also talks about differentiable programming: https://twitter.com/tdietterich/status/948811917593780225 https://twitter.com/tdietterich/status/948811917593780225
- seanmcdirmid 9y agoOr the other way around... He has been throwing around the term for awhile now.
- BucketSort 9y agoIt was most certainly the other way around. Marcus does not focus on differentiable programming in his paper. See my edit.
- sytelus 9y agoI don't think so. LeCun seems to oppose Marcus's views... Related: https://twitter.com/ylecun/status/921409820825178114?lang=en https://twitter.com/ylecun/status/921409820825178114?lang=en I think LeCun doesn't want a repeat of AI winter because of exponentially rising hype and expectations out of Deep Learning. There have been few examples like Selena which he seems to think that people are trying to ride the deep learning wave to generate false buzz (and cash!) for themselves.
- BucketSort 9y agoHe does oppose Marcus' views, but he also knows neural nets are only one approach to differentiable programming. The term is confusing though. It should read like "linear programming" does, but people are not interpreting it that way.
- Ormus 9y agoI can guarantee you that Marcus has in no way ever inspired LeCun.
- albertzeyer 9y agoDiscussion about that paper here: https://news.ycombinator.com/item?id=16083469 https://news.ycombinator.com/item?id=16083469