6 ms·
An History of Nvidia Stream Multiprocessor
- villgax 7y agoOne of the things I had a fit of laughter was after reading that Jensen used to work at AMD before!!
- ver_ture 7y agoI wish I understood more of this, what a cool field of engineering.
- twic 7y agoThe SVG doesn't render at all right in Firefox, for me.
- fabiensanglard 7y agoThanks for telling me, I had no idea. It looks like Firefox and Edge don't render in the same way Inkscape/Chrome do. It seems converting the whole SVG from "Object to Path" fixed the issue everywhere.
- twic 7y agoI know next to nothing about SVG; do you think this was a mistake in the SVG, or is it a bug in Firefox's rendering? If the latter, ideally, we would file a bug report, although i don't actually know how you do that for Firefox these days.
- fabiensanglard 7y agoIt think it is a bug in Firefox rendering since Inkscape and Chrome render it properly. If I remove the "writing-mode:tb-rl" firefox renders it properly. It seems FF does not support that attribute. I have kept both versions of the SVG and intended to fill a bug report. http://fabiensanglard.net/cuda/g71.svg http://fabiensanglard.net/cuda/g71.svg http://fabiensanglard.net/cuda/g71_org.svg http://fabiensanglard.net/cuda/g71_org.svg I have this weird guts feeling it will be closed as "we know. we don't support it yet. Come back later". So I abandoned the idea.
- twic 7y agoInterestingly, a documentation overview says that tb-rl is an allowed value: https://developer.mozilla.org/en-US/docs/Web/SVG/Attribute/Presentation#attr-writing-mode https://developer.mozilla.org/en-US/docs/Web/SVG/Attribute/P... But the detailed documentation it links to does not: https://developer.mozilla.org/en-US/docs/Web/SVG/Attribute/writing-mode https://developer.mozilla.org/en-US/docs/Web/SVG/Attribute/w... I had a look in Bugzilla and couldn't find anything specific to tb-rl, but did find an ancient meta bug for writing-mode which links to millions of other bugs: https://bugzilla.mozilla.org/show_bug.cgi?id=writing-mode https://bugzilla.mozilla.org/show_bug.cgi?id=writing-mode
- Scene_Cast2 7y agoI'm curious about the addition of Tensor Cores. It sounds like both the regular Shader Units and Tensor Cores can carry out GEMM, just that the latter are more efficient at it. I'm guessing that for ML applications, both the Tensor Cores and Shader Units are used. Are tensor cores idle during 3D gaming? How do they differ from the regular Shader Units? Why are they more efficient?
- frogblast 7y agoThe tensor cores are basically more efficient because they don't implement a 'read from register file; execute one instruction; write to register file'-style architecture: They are basically a big array of ALUs hard-wired in a grid to do a matrix multiply: The connectivity between ALUs is baked into silicon: no general purpose register file to hold the intermediate results, just wires directly from the output of one ALU into the input of the next (well, and registers for pipelining). No overhead for register files, instruction decoding, instruction scheduling, load/store units, cache, etc. (load/store is handled by the usual SM instruction set). This is basically the same concept you find in any "AI acceleration" hardware (Google's TPUs, various neural-thingys you find in Phones, etc). As for using in games, this hardware is generally idle, except for a few cases (typically because Nvidia did the work to light them up): - upscaling from lower resolution rendered products to higher resolution (Nvidia markets this under the name "Deep Learning Super Sampling"), which is basically taking a derivation Temporal Anti-aliasing and mapping it onto the tensor cores to exploit that hardware - Doing CNN-like denoising and reconstruction of a noisy ray traced image.
- hesk 7y ago> Are tensor cores idle during 3D gaming? The tensor cores are used for real-time raytracing, ML-based anti-aliasing during gaming, and other features. The Turing whitepaper has a lot of information on that. https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/technologies/turing-architecture/NVIDIA-Turing-Architecture-Whitepaper.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/design-vi... A more generic answer to this question is that everything NVIDIA puts in their GPUs is for the gaming market. Other use cases are incidental.
- captainbland 7y agoNice comparison. If I could offer one bit of feedback: I think that graph at the end should be TFLOPS rather than GFLOPS.
- fabiensanglard 7y agoGood catch! Fixed.
- tyingq 7y agoThe title led me down this somewhat interesting rabbit trail of "why an?": https://www.merriam-webster.com/words-at-play/everything-youve-ever-wanted-to-know-about-historic-and-historical https://www.merriam-webster.com/words-at-play/everything-you...
- kinleyd 7y agoThe same here. Been meaning to sort it out for myself for some years now. Finally done that: "A history ..." is how I was taught, and it shall remain that way.
- deleted 7y ago[deleted]
- fabiensanglard 7y agoFixed. Thank you!
- tyingq 7y agoOh, sorry, wasn't saying it was wrong. People seem split on it. Just curious.
- mshockwave 7y ago> This fragmented design reminds of the Pre-Tesla layered architecture, proving once again that history likes to repeat itself. So true.
- corysama 7y agoOn the Hardware Wheel of Reincarnation [1] we are definitely swinging back into the realm of special-purpose processors and processor extensions all over the place. The gigahertz scaling free lunch has been dead for over a decade. We're still adding more transistors, but finding it harder to speed up day-to-day serial code. So, instead we're adding dedicated hardware for the common, hard stuff and throwing special-purpose chips into every nook and cranny of everything around the periphery of the main thread on the main CPU. [1] https://www.computerhope.com/jargon/w/wor.htm https://www.computerhope.com/jargon/w/wor.htm
- TaylorAlexander 7y agoWe are also inventing new ways to do computation. Massive deep neural nets require different hardware, and it seems there’s plenty of room to improve and experiment there.
- szatkus 7y ago> Since Intel proved that there is still room for miniaturization with the 7nm of Ice Lake, there is little doubt Nvidia will leverage it to shrink its SM even more and double performance again. Intel calls their process 10nm and it's weird to mention it since it was a total disaster.
- boulos 7y agoFabien, how come you skipped Volta? (Presumably because it wasn’t interesting for Display, but it’s a huge step up from Pascal) The most interesting thing to me in the progression of NVIDIA’s compute offerings is that until Volta, the “SIMT” claims were just a programming model and the hardware was actually just like any other SIMD hardware (though with automatic mask stacks). In Volta, they finally added “we can run different ops at different program counters”. For the casual reader, the hot chips 2017 presentation is probably the easiest skim: https://www.hotchips.org/wp-content/uploads/hc_archives/hc29/HC29.21-Monday-Pub/HC29.21.10-GPU-Gaming-Pub/HC29.21.132-Volta-Choquette-NVIDIA-Final3.pdf https://www.hotchips.org/wp-content/uploads/hc_archives/hc29...
- georgianar 7y agoThis kind Man brought my Lover back In less than 3 days, i saw wonders, my Lover came back to me and my life got back just like a completed puzzle… am so happy.. thanks to Robinsonbucler@ { gmail }. com for saving my life. Mr Robinson is the best I’ve ever met! Thanks, thanks thanks_____________