4 ms·
Neural Network on a Commodore 64 (1987)
- drudru11 9y agoJohn Walker is awesome. Founder of Autocad and good guy to the hacker community when he was in the Bay Area.
- partycoder 9y agoThe 80s saw the creation of the neocognitron, self organized maps and the first recurrent neural networks (e.g: hopfield networks, boltzmann machines). It also saw the first application of backpropagation to neural networks.
- briga 9y agoIf you think that's cool, you might also be interested to know that Marvin Minsky programmed a neural network all the way back in 1951: https://en.m.wikipedia.org/wiki/Stochastic_neural_analog_reinforcement_calculator https://en.m.wikipedia.org/wiki/Stochastic_neural_analog_rei...
- jeffwass 9y agoAnybody know when the term "Neural Net" first appeared? Just read Heinlein's "The Moon is a Harsh Mistress", published in '66, and there are a couple of mentions of "neural nets".
- briga 9y agoMcColloch and Pitts and are generally credited with the theoretical foundations of artificial neurons in the 40s, and around that time Hebb was doing some pioneering work on activation potentials, but traces of the idea can be found as far back as James's Principles of Psychology.
- jeffwass 9y agoThanks, but I mean specifically the term "neural net". Saw some older papers mention artificial neutrons but interested when they used the term 'net'
- testvox 9y agoThe primary paper by McColloch and Pitts is "A Logical Calculus of Ideas Immanent in Nervous Activity" (1943) it doesn't use exactly the term "neural net" but it mentions nets, networks, and "nervous nets". But it seems like the term "nervous net" goes back to the 19th century as a description of primitive neural arrangements in biology.
- varjag 9y agoVery cool! I remember adapting backpropagation network code from German C't magazine to HiSoft Pascal on ZX Spectrum. Only a few bits worth of inputs, but watching it run and converge was fascinating.
- protomyth 9y agoPeople did some pretty cool things with the C64. Back when I was in college (88-91), two professors in the Math department built an interface that hooked up 4 C64 computers so they could run parallel stuff. I guess it was the cheapest solution to the problem.
- walkingolof 9y agoThats weird, you could get a (Atari 1040 STFM) 1M 8Mhz 68000 at that time for less than those 4 C64:s
- matt_the_bass 9y agoMaybe the point was to explore methods of parallelism?
- rexreed 9y agoPerhaps they already had them on hand? I have 2 C64 machines still!
- protomyth 9y agoYou and matt_the_bass are right. They had 4 on hand and wanted to explore parallelism. I think they tried to buy some transputer boards first without success then figured they could afford the parts to build the interface. I’m told it was pretty fun to program.
- vinw 9y agoIt's pretty neat that if you run Attneave's Cat through Google Images[0] its best guess is that it's an image of a cat. [0] https://www.google.com/search?tbs=sbi:AMhZZis-EoFUya0lMH5oOqtVXvqwwCZ3Ct5B4g8rjqcvcWOu6hfkjFh9wDH5pO0Pg7CwXO8ijR5oGPv5atV67roNQ7FfwzHIbzCP9BstA1wrptY5b6OKBAUzDR0jAUZemGvZvrJWsobqOGbjfDNAbMP8qUbGKBNoi_1t3NmbtL0eUjzG-VAHOMsaHAhTKvH-OK6NaPCIMcqEYVX9MOW5T5K0U3JqcHhZb3XRDcvTz2K9y7DMzY4T_1zlHPyq8RO5gapnHPgLZkVEk92fKXQv_1oTkzruH_1X2yd1ZcEgmy5TfuwpGOo0iQlcbNist-TUSAQIC7W_1LNhoy3PzVhAUSXJyNozjSPfG02acmg&safe=active&hl=en&biw=1173&bih=716&site=search&sa=X&ved=0ahUKEwiylNPGj_3XAhUSyKQKHQdlBeMQ9Q8IJCgA https://www.google.com/search?tbs=sbi:AMhZZis-EoFUya0lMH5oOq...
- supermdguy 9y agoThat might partially be because it's already indexed the original page, and noticed that its caption includes "Cat".
- GlenTheMachine 9y agoHad this actually been published in a Commodore magazine it would have changed my life - revealed a whole new area of computer science to the teenaged me, fifteen years before I actually encountered it. Damn.
- tomcam 9y agoWhich means that quite possibly papers are coming out this very second with concepts you will treasure years in the future unless you take quick action. You need to start reading the professional literature more, Glen!
- supermdguy 9y ago> If you walk up to a computer and ask it “what is the name of the famous bridge in the same state as Disneyland” you won't have much success, but most people will immediately answer, “The Golden Gate Bridge”. 30 years later: https://www.google.com/search?q=what+is+the+name+of+the+famous+bridge+in+the+same+state+as+Disneyland https://www.google.com/search?q=what+is+the+name+of+the+famo... Look at the first result.
- antoineMoPa 9y agoThe golden gate bridge is the third result here, with the same link. Seems like you can't rely on google search results to be the same from country to country and person to person.
- supermdguy 9y agoYeah, that's definitely true
- Gargoyle 9y agoChange "disneyland" to "empire state building" and it works decently. Change it to "wall street" and it fails. Still, not bad at all.