5 ms·
Probability Chip
- deleted 16y ago[deleted]
- RiderOfGiraffes 16y agoPrinter friendly, (almost) no ads, no pointless images: http://www.technologyreview.com/printer_friendly_article.aspx?id=26055&channel=computing§ion= http://www.technologyreview.com/printer_friendly_article.asp...
- perplexes 16y agoLooks like they check the referrer and redirect you to the original article :(
- RiderOfGiraffes 16y agoSneaky swine ...
- RiderOfGiraffes 16y agoSounds a lot like the ByNase protocol that Ward Cunningham (inventor of the wiki) came up with: http://c2.com/cybords/wiki.cgi?BynaseProtocol http://c2.com/cybords/wiki.cgi?BynaseProtocol
- snippyhollow 16y agoMy Ph.D advisor will go crazy, he had his European research project on a probability computer turned down a few months ago.
- andraz 16y agowouldn't starting just 6 months ago be a bit late in any case?
- xtacy 16y agoIs it likely (in the future) to see more domain specific chips? Something like what http://www.deshawresearch.com/ http://www.deshawresearch.com/ has created---a custom chip Anton, optimised for Molecular Dynamics simulations.
- wwalker3 16y agoI think it is likely we will see more of these. But this probability chip sounds more like an analog computer than what D. E. Shaw has done. The Lyric web site says that they "model relationships between probabilities natively in the device physics", where D. E. Shaw's Anton chip sounds like it uses traditional logic gates the same way a GPU does. P.S. Sorry, I downvoted you by accident -- I meant to upvote you.
- preview 16y agoYou're already seeing domain specific chips, but they're in the form of a FPGA rather than an ASIC. If it can be implementation with traditional gates, a FPGA is the way to go for low to medium volume. While Lyric may incorporate classic gates in their design, it also sounds like the heart of their technology uses something different from classic gates.
- gwern 16y agoDomain-specific chips is a cyclical trend. They come and go; at some times they have advantages, and at others they don't. (Remember Lisp machines? Good initially but vastly outperformed by the end of their lifespan.) See for example the classic 'wheel of reincarnation' paper on graphics: http://cva.stanford.edu/classes/cs99s/papers/myer-sutherland-design-of-display-processors.pdf http://cva.stanford.edu/classes/cs99s/papers/myer-sutherland... The fundamental problem as I see it is that any domain-specific chip will receive a tiny fraction of R&D and economies of scale and amortization that a general purpose one will, and so its advantage is only temporary. As long as Moore's law is operating, this will be true.
- gwern 16y agoTo quote the thesis on probabilistic chips: > In practice replacing digital computers with an alternative computing paradigm is a risky proposition. Alternative computing architectures, such as parallel digital computers have not tended to be commercially viable, because Moore’s Law has consistently enabled conventional von Neumann architectures to render alternatives unnecessary. Besides Moore’s Law, digital computing also benefits from mature tools and expertise for optimizing performance at all levels of the system: process technology, fundamental circuits, layout and algorithms. Many engineers are simultaneously working to improve every aspect of digital technology, while alternative technologies like analog computing do not have the same kind of industry juggernaut pushing them forward.
- perplexes 16y agoOne step closer. http://en.wikipedia.org/wiki/Technology_in_The_Hitchhiker%27s_Guide_to_the_Galaxy#Infinite_Improbability_Drive http://en.wikipedia.org/wiki/Technology_in_The_Hitchhiker%27...
- chime 16y agoThere's a single-quote missing in your link after Hitchhiker and before the letter s: http://en.wikipedia.org/wiki/Technology_in_The_Hitchhiker http://en.wikipedia.org/wiki/Technology_in_The_Hitchhiker + ' + s_Guide_to_the_Galaxy (looks like HN comment filters it out)
- perplexes 16y agoThanks!
- tricky 16y agoThe thesis on which this is based: http://phm.cba.mit.edu/theses/03.07.vigoda.pdf http://phm.cba.mit.edu/theses/03.07.vigoda.pdf edit: p 135 is where he starts talking about implementation in silicon
- moultano 16y agoI'm curious how they deal with probabilities very close to 1 or 0. Usually when people are doing bayesian things with probabilities they work in logistic space so that the precision of values close to 1 or 0 is effectively unbounded. That seems like a hard thing to do with an analog circuit.
- wwalker3 16y agoThe founder's thesis mentions that they use a linearizer in their analog circuit, but all that does is give the same precision over the entire logical value range from 0 to 1 (by that I mean the same amount of voltage swing equals the same amount of "logic value change" anywhere in the range). I suppose they could use a "non-linearizer" to put more of the precision near 0 and 1, but it would come at the expense of precision in the middle. The less voltage swing is involved, the more susceptible you are to noise from various sources.
- siavosh 16y agosimilar to the fuzzy-logic chips of the 90's?
- jon_hendry 16y agoBut how do you connect it to the cup of no tea?
- deleted 16y ago[deleted]
- api 16y agoIsn't this just the revenge of the analog computer? Not saying it's a bad idea... I'm really for the idea of revisiting assumptions in computer design.
- copper 16y agoSure, if you can represent your problem using probabilities :) That said, I'm more excited about the use of Lyric's technology in ECC memory. I'm skimming through Vigoda's thesis, and it seems that another very interesting application ought to be making even lower-power mobile backend chips.
- frisco 16y agoHow does this compare to what Navia Systems is working on?
- ajb 16y agoI thought I'd heard something like this before. From 2004: http://www.eetasia.com/ART_8800354714_499488_NT_92255b4a.HTM http://www.eetasia.com/ART_8800354714_499488_NT_92255b4a.HTM That's a turbo decoder rather than a generic probability calculator, but it's doing probability calculations in the analog domain. This sort of thing may make sense for error correction, but I don't think people will run general probability calculations on it. Too difficult to debug :-) Though, I do wonder if they can simulate a neuron more efficiently than digital logic.