2 ms·
When I was an undergrad, one of my professors was exploring “approximate” computation (forget what it was technically called). The gist was that you build mathe
by vlovich123 4y ago
When I was an undergrad, one of my professors was exploring “approximate” computation (forget what it was technically called). The gist was that you build mathematical circuitry that approximates an answer instead of giving you a concrete answer (kinda like floating point but also applied to Boolean algebra, integer math etc). The reasoning was that the approximation could let you reduce the power. I wonder where that line of research has gone.
- cplusplusfellow 4y agoWhat if all the text in your comment was approximately the correct set of letters in each word?
- NegativeLatency 4y agoAs long as the first and last are good you can kinda figure it out
- gpm 4y agoYis, wjat eef al teh tekst inn mie coment waz aproximetly tha corekt sett ove letres iyn eech worud? For many things, like neural networks, it's probably good enough.
- kube-system 4y agoLossy text compression has been done http://compression.ru/download/articles/text/witten_1994cj_lossy_text_compression.pdf http://compression.ru/download/articles/text/witten_1994cj_l...
- anonymouskimmer 4y agoThis line was worth reading! > dig the life that both are scary and jamming lore whose biased top must be recoverable.
- myself248 4y ago"Fuzzy logic" was the "AI" hype buzzword of the 90s.
- marcosdumay 4y agoFuzzy logic is not approximate, and definitely not high performance.
- kube-system 4y agoAnalog computing?
- mmebane 4y agonVidia's DLSS works somewhat like that: the game engine generates a low-res/noisy/low framerate image, and the GPU refines it with an ML model.
- Fordec 4y agoIt's used inside Google's TPUs[0]. Useless for regular logic programming (You've wouldn't want a nuclear power plant, or your payment processor to approximately work), but has found a use case in scaling ML pipelines where the accuracy of individual values is less important compared to billions of parameters in aggregate. [0] https://ieeexplore.ieee.org/document/9264836 https://ieeexplore.ieee.org/document/9264836
- vlovich123 4y agoI don’t know that it’s “useless” for logic programming. I agree it’s less likely to be used for normal everyday stuff but it could see more proliferation (eg video decoding). I think TPUs are an interesting first step but the holy grail (which indeed may be impossible) is to be able to reduce large scale programs to run on approximate circuitry. For example, if chrome used a fraction of the memory, CPU, and power, that would be significant even though no one would notice that the page renders slightly imperfectly if executed well. As the paper notes TPUs are the first application although I think what we’re doing there is probably quite primitive be what the researchers in the area are working on long term.
- bjourne 4y agoApproximate computing approximately means using 16 or 8 bit floats instead of standard 32 bit floats.