7 ms·
While I think CUDA has very little competition and seems to be de facto standard in the ML industry, judging from the comment on CUDA 11 post[1] Nvidia still ha
by ksec 6y ago
While I think CUDA has very little competition and seems to be de facto standard in the ML industry, judging from the comment on CUDA 11 post[1] Nvidia still have some low hanging fruit to fix.
I am still waiting for Nvidia to make their play in CPU Market. May be a move in ARM Server CPU space. They have AI/ML with GPGPU, High performance networking with Mellanox. Surely the next logical step should be HPC CPU? Or at least reselling ARM's N1 blueprint solution.
Nvidia has a Forward Earning Ratio of about 41. Which seems reasonable ( Comparatively Speaking in today's market ).
Meanwhile Intel has limited upside. On the Client Computing Side Around 7% of revenue will vanished due to Apple switching to their own Silicon. And for the first time ever they have real competition in Notebook market ( AMD was never really in the Notebook market segment in its entire history ). In DataCenter they will be facing threats from Zen 3 and ARM. And I am very skeptical of their GPU moves. The market is still expanding so there is the possibility for them to sustain their revenue, I just dont see how they could grow its current record revenue in the next few years.
[1] https://news.ycombinator.com/item?id=23772245 https://news.ycombinator.com/item?id=23772245
- pjmlp 6y agoThing is, the competition is even worse regarding the fruit to fix.
- klelatti 6y agoVery succinct summary - with the contrast (from an investor perspective) magnified by the fact that Nvidia has stable management that has delivered over a number of years, compared to Intel's untested CEO and recent history of significant mis-steps.
- mmmBacon 6y agoAgreed on the management. Regarding Intel’s CEO, Bob Swan is a finance guy with no history or background in semiconductors. It remains to be seen whether someone with no real background in technology or in the semiconductor industry can turn things around at Intel.
- dyingkneepad 6y agoApparently his current strategy is to just cut costs like craz-, I mean, like every CEO who was once a CFO. I know driver developers who work there and are stuck with old broken laptops of previous generations because there's no budget (they call it BTI) to upgrade. No dogfoodin for them. Even the previously free fruits are now just one per day per employee. Source: I know people who work there.
- epmaybe 6y agoAnyone know how the AMD workplace is? Learning about work life at different companies is really interesting to me
- entropicdrifter 6y agoI've always personally envisioned AMD's graphics driver team as a bunch of underdogs pulling off serious wizardry on a shoestring budget and still being criticized by the public for having any bugs at all.
- paulie_a 6y agoMeanwhile the cost of monitoring the free fruit situation will cost more than the couple of crates of apple savings
- awill 6y agoperks are very very hard to take away. THe lower morale, and in many cases cause the best employees to leave, not because of the actual perk, but because of what that means - That the company doesn't value its employees. I agree, I've seen many companies cut perks and yet not save any money, they just reduce morale.
- yjftsjthsd-h 6y ago> not because of the actual perk, but because of what that means - That the company doesn't value its employees. and/or that money is tight and things are likely to get worse
- TuringNYC 6y ago>> Nvidia has stable management I'd expand this further to say Nvidia has an enthusiastic, highly-charismatic CEO who literally has groupies (e.g., when you see him at conferences.) For a big-time CEO, he is also surprisingly nice and approachable -- I've now interacted with him on three separate occasions. It makes me like him, his company, what he does. I realize that is touchy-feely but I wonder how common this sentiment is.
- klelatti 6y agoI realise I did Nvidia a dis-service as Jen-Hsun and team are obviously much, much more than just 'stable'. Never met him, but seems very impressive and approachable - how many CEOs would give a talk to students sitting on the steps of a university entrance? [1] Just to add though that having groupies is not necessarily a positive for investors! [1] https://www.youtube.com/watch?v=hqiBzmuqPNY https://www.youtube.com/watch?v=hqiBzmuqPNY
- obmelvin 6y agoHe definitely seems approachable. Someone I knew from school interned at nvidia and supposedly he hosted a party at his house for the interns (possibly just PhD interns) and let people rev one of his fancy cars
- deleted 6y ago[deleted]
- sushshshsh 6y agoOracle also threw us a party as new hires at Mark Hurd's "house" (party villa) in Atherton. HR and all of the top dogs were there except for Larry and the Board of course. It was a nice gesture but he had a lot of security combing the house at all times and we weren't allowed to bring our phones even. Definitely a well intentioned gesture but as always in SV corporate world, just becomes weirder by the minute :)
- dbancajas 6y agowas an intern at nvidia. He's very approachable and all interns are invited to his huge ass california house. I saw came out of a meeting and just said hi to him. He's pretty much an engineer just like everyone except he's a CEO and he doesn't have that douchebag vibe like most tech CEOs are.
- als0 6y agoPersonally I think servers are hard to get into because you rely on scoring big deals against Intel/AMD and the shipment volume is rather small compared to other markets. However, being able to provide decent ML to cars, cell towers, buildings etc at a reasonable price/power budget has the potential for much larger volume albeit at a smaller profit margin. NVIDIA is largely uncontested in ML acceleration so they have a unique selling point in an embedded market that's waiting for big disruption.
- staycoolboy 6y agoIt's no secret that NVIDIA is involved with RISC V. And don't forget Intel v Ampere (the company, not the NVIDIA chip). Intel is facing incredible competition. Once a crack appears in the server market and Arm rushes in, Intel will be in a very, very bad situation. Especially with 100,000+ employees compared to NVIDIA's 13,000. EDIT: Downvotes? Really?
- gnulinux 6y agoIf they produce competitive CPU on RISC-V that'd be very interesting. I'd like to see a competition between ARM and RISC-V chips, so that ARM is not the monopoly in that niche market (high-end non-x86 chips). I think it's very unlikely though, if not impossible. Seems more logical to produce ARM.
- zozbot234 6y agoRISC-V chips have tended to run a bit cooler than ARM given comparable performance class, microarchitecture and fabrication device node. However it remains to be seen if this advantage will be preserved, especially as more RISC-V instruction extensions get standardized (vector instructions, packed SIMD, bit-level ops are all on schedule, plus a grab-bag extension for JIT hardware acceleration) and as ARM64 implementations improve.
- klelatti 6y agoCitation?
- lmeyerov 6y agoTheir gain in risc-v may be more about making life hard for Intel (anti-competitive) and avoiding patents etc in gpu, than not actually wanting to go head to head on CPU revenue. Similar but weaker to why Google did Android (Apple phone monopoly might hurt selling ads).
- CountSessine 6y agoA typical GPU has a bunch of small microcontrollers on it, usually Cortex-M’s. Those need to be licensed. I wonder if Nvidia’s interest in RISC-V is just to replace those microcontrollers?
- saati 6y ago> AMD was never really in the Notebook market segment in its history AM386 SX was a fully static cpu with a much lower power consumption, way better for laptops that Intel offerings at the time.
- fortran77 6y agoIt would be interesting to put a few dozen ARM cores on a high end GPU card. Why not just run your complete application directly on the card?
- znpy 6y agoIntel tried that with Intel Xeon Phi, basically.
- fortran77 6y agoThat was just a lot of Intel cores. I'm talking about an NVIDIA GPU that happens to have some ARM cores along with the CUDA cores.
- kkielhofner 6y agoYou're essentially talking about a Jetson: https://elinux.org/Jetson_AGX_Xavier https://elinux.org/Jetson_AGX_Xavier Eight Nvidia ARMv8 cores, 512 Volta cores, 64 tensor cores, and 2 DLAs - all connected to 32 GB of shared RAM. It was announced over two years ago and the price has fallen to $800. For another $200 you can add a USB-C to DP cable (for a second display) and 1TB of NVMe storage. If I had a $1,000 compute budget it's what I'd get. You'd have a more than functional dual 4K daily driver for dev work, browsing, etc plus the ability to run ML workloads. Oh yeah, and it tops out at less than 50 watts from the wall with all but the heaviest tasks coming in at 25-50% of that.
- fortran77 6y agoI love the Jetson -- we have a bunch of them here -- but that's a SBC. What I want is an NVIDIA 2080Ti or 3080Ti card with some ARM cores that I can run apps that use CUDA+ARM directly on!
- kkielhofner 6y agoI love my Jetsons too! One has to wonder if at some point Nvidia will produce a PCIe carrier board or something for souped up Jetson modules or some variant. I have no idea how the connectivity (PCIe device?) would work out but it's definitely within the realm of possibility.
- lazyjones 6y ago> I am still waiting for Nvidia to make their play in CPU Market. May be a move in ARM Server CPU space. What makes you think they are better prepared for this than, say, Qualcomm... or even Intel? Despite Apple's decision to switch to ARM, I'm still not convinced it's the right architecture for the servers of the future. It more likely indicates Apple's convergence to a single platform, away from the classic desktop.
- byefruit 6y agoWhat makes you think it's not the right architecture for servers? If anything AWS' Graviton2s are competitive on multithreaded workloads and it looks like the Neoverse cores are only going to improve there.
- mochomocha 6y agoCUDA is nowhere near the de facto in the ML industry. Beyond some specific application domains like CV where DL makes sense, most ML still runs on commodity hardware, and I happen to believe this will be the case for a long time once the Gartner Cycle of Hype settles on the Deep Learning craze and everyone runs out of VC money. Despite what cloud providers and NVIDIA want you to believe, no you most likely don't need a lot of compute power for your industry problem. Basic knowledge of statistics would help though.
- Voloskaya 6y agoOP was likely talking about training where NVIDIA has virtually no competition apart from Google's TPUs. In inferencing a lot more models are deployed on GPUs than before and this trend is likely to continue. NVIDIA is alone there.
- mochomocha 6y agoHa I see - I've been training ML models with millions of data points and millions of features on CPUs for a decade now, I didn't know I needed a GPU - I guess I've been doing it all wrong all this time!
- RcouF1uZ4gsC 6y ago>I've been training ML models with millions of data points and millions of features on CPUs for a decade now That is why it is taking a decade to train your models. If you upgraded to a GPU, you could train them much faster :)
- ebalit 6y agoI would be very surprised if a ML pipeline didn't benefit from some GPU acceleration. What kind of algorithms are you using?
- Voloskaya 6y ago> didn't know I needed a GPU - I guess I've been doing it all wrong all this time No, not the whole time, just these last couple of years :)
- tengbretson 6y agoI keep waiting for Intel's FPGA investments to bear fruit, but so far it seems like it ain't happening.
- billsnow 6y agoWell that entirely depended on Intel's so-called process advantages, didn't it?
- lnsru 6y agoI am on Xilinx camp, but I am worried what happens with the Altera’s remains. People aren’t crazy about FPGAs paired with Xeon.
- ksec 6y agoI am not surprised and pretty much expected. I would love to be wrong and corrected but there is absolutely nothing that suggest Intel's FPGA ( Altera ) are doing any better than before they were acquired, and no signs to suggest future growth either. If anything they are actually doing worst all while Xilinx is storming past them. As a matter of fact I have yet to see a single Intel Acquisition in its history that has created synergy or additional value.
- HumblyTossed 6y ago> ... I just dont see how they could grow its current record revenue in the next few years. They'll move into shadier tactics like subscriptions to unlock cores/overclocking, etc.
- kkielhofner 6y agoNvidia has been producing their own ARM cores since at least 2014: https://en.wikipedia.org/wiki/Project_Denver https://en.wikipedia.org/wiki/Project_Denver The ARM core performance hasn't been spectacular vs the latest and greatest from Samsung and Apple but combined with CUDA and tensor cores it can provide pretty incredible results considering the cost, form factor, and power consumption. Carmel is also at least two years old at this point... Their project Denver announcement from 2011 discusses plans for server and HPC applications: https://blogs.nvidia.com/blog/2011/01/05/project-denver-processor-to-usher-in-new-era-of-computing/ https://blogs.nvidia.com/blog/2011/01/05/project-denver-proc...
- 013a 6y agoYes, its worth saying for context: The Nintendo Switch runs on an Nvidia ARM core. They're capable of pretty great performance in the right contexts, and the industry definitely needs more consumer-accessible HPC-focused ARM competition what with Apple leading the charge on "everything to ARM". Microsoft has also shown interest, with the SPX, but we need processors more capable than what Qualcomm is producing; I'm hopeful Nvidia can help fill that gap in the next five years.