4 ms·
Back in the nineteen-nineties I'd built a neural-net creator using a method other than back-propogation that was able to create nets with about a hundred neuron
by Nomentatus 9y ago
Back in the nineteen-nineties I'd built a neural-net creator using a method other than back-propogation that was able to create nets with about a hundred neurons that played tic-tac-toe well or perfectly (depending on the net created that day.) This was on a 12 mhz 286 using what I called static point multiplication (based on shift instructions, not multiplication instructions.) So I went to Toronto to see Professor Hinton, to share. My not being a big back-propagation fan was one thing that divided us before meeting him, but otherwise I thought we'd be pretty much on the same page.
It didn't go well. I happened to mention that I thought parallel programming would be a big help speeding up neural nets, and that I'd toured such a multi-processor computer in Alberta. He blew up. I never got to explain what I'd done with neural nets. He tossed me out of his office summarily and wouldn't listen to another word I had to say - somehow he'd gotten the idea in his head that I was a salesman for the company whose machine I'd seen, which machine was too weird to be considered anyway, and absolutely nothing I could say would persuade him that I wasn't a salesman. So the nets I'd created and methods other than back-propagation never got mentioned. Weirdest meeting of my life, and the end of my desire to do anything with neural nets, since other academic departments were even more violently rejecting of the idea back then.
- sjg007 9y agoWhat's the idea? Sounds interesting? Publish a paper on it? Or put up a blog post?
- deleted 9y ago[deleted]
- deleted 9y ago[deleted]
- shepardrtc 9y agoI'd like to hear more about your method. I've looked at a number of different ways of building neural nets over the years and all have their advantages and disadvantages, but if you have something completely different then I'd be thrilled to hear more. I agree with Hinton that we really need to rethink the way we're doing things.
- Nomentatus 9y agoMy method was evolutionary, put too simply - something not completely undiscussed even at the time and it's undoubtedly happening in one way or another now. I also designed a method for parallel processing dedicated to neural nets that seemed much more efficient than just "more processors", I've no idea whether NVIDIA et al have caught up with design that or passed it by now.
- Nomentatus 9y agoThis was mid-1980s, not 1990s. Hence the 80286 CPU. A bit of a cold caused a brain cramp for me.