atty

13 ms·

91.
by atty 4y ago
In each library, their operations need to be implemented for each backend separately (CPU, GPU, TPU, etc). All of these libraries support CUDA as their default GPU implementation because it’s by far the largest in terms of market share. But
92.
by atty 4y ago
Complete speculation on my part, but I think the biggest appeal is supply side, that people can be Internet personalities with an avatar without sharing their real identity. That helps a lot of people who would like to start sharing content
93.
by atty 4y ago
Strongly agree. Bandwidth and latency are the two big limiting factors always though, and unfortunately they tend to improve slower than compute. I think right now the fastest infiniband you can achieve is 3-400 GB/s, and compare that
94.
by atty 4y ago
I think for inference, analogue makes a ton of sense, and within a pretty short timeline (10 years maybe?) we’ll see it deployed for those workloads. For training, I’m certainly interested but not at all convinced that it will dominate. I w
95.
by atty 4y ago
Beyond the comparison to the brain that the other replier gave, you also have to consider that some problems are just big. Really big. Not every AI problem is NLP or CV. For instance, in physical simulations, the representation of the syste
96.
by atty 4y ago
I’ve had the chance to test a few of the up-and-coming dedicated AI accelerators, and except for the TPU, none of them gave a speed up or perf/watt improvement that was worth the additional complexity of using something that didn’t nat
97.
by atty 4y ago
Very cool to see the rundowns like this. As someone in the ML space, I’m a little concerned that they may be ceding the AI accelerator market to Nvidia. The fact it’s exposed as two separate GPUs, the focus on fp64, etc, all point to them a
98.
by atty 4y ago
Current architecture, no - this big+little architecture just started with the last generation, like a year ago I think? However, if you mean process node, then yes, I think this is on the same one they’ve been using for awhile. But they hav
99.
by atty 4y ago
This is… amazing misinformed. I am assuming you’ve never done scientific simulation work if you think that. Physical simulations in many fields get better due to increases in compute, memory, and bandwidth faster than they do from algorithm
100.
by atty 4y ago
The person you were replying to agreed with you, that it seems like Nvidia is doing a great job in the data center.
101.
by atty 4y ago
I’d be interested in what you mean by that - VC investment has slowed down, but investment by large firms (tech or otherwise) is only increasing. And with large language models, generative models, diffusion models, etc becoming more and mor
102.
by atty 4y ago
It clashes with the AI code writing tool of the same name.
103.
by atty 4y ago
I don’t see how it’s any different for EU long term, even if they haven’t caught up to the US/other markets yet. Automatic ICE vehicles are more fuel efficient, since they can have significantly more gears. And electric cars (usually)
104.
by atty 4y ago
I think there are two reasons. First, most people might be mildly annoyed by the ads at most, and certainly wouldn’t make a buying decision based on them. Second, it’s almost impossible for new companies to compete on both quality and price
105.
by atty 4y ago
American here, have not seen this in my many corners of the web.
106.
by atty 4y ago
Many of the top rated comments in here are kind of missing the point. “No touch screens” isn’t the optimal configuration. Instead, you want buttons on the dash or wheel for commonly used actions, and you want less common actions on a nice l
107.
by atty 4y ago
Honestly I’ve never considered an analog computer, and I’m a physicist but not a lattice expert. While an analog computer would let you use real numbers, you’d still need a way to store state at every point in space, which would lead to the
108.
by atty 4y ago
I apologize I am actually running out the door at this point, so I can’t reply in a ton of detail (I’ll try to remember to do so later) But the point to remember is that these aren’t normal algebraic equations, they’re based on the quantum
109.
by atty 4y ago
The point is that it can’t be simulated on any lattice of any density. It doesn’t matter how fine the lattice is compared to the sensitivity of the measurement. For your case you showed, it would be like if x^2 simply didn’t exist on a latt
110.
by atty 4y ago
“Fudge factor” massively undersells it. For instance, measurements from the bullet cluster are quite compelling that there is significant mass in a galaxy that we don’t directly measure. That’s the definition of dark matter.
111.
by atty 4y ago
You can think of it, at a very high level, being the difference between a force mediator that has no self interaction (photon) and a force mediator that does have self-interaction (gluon). Gluons interact with each other, whereas photons do
112.
by atty 4y ago
What? If you think a government can’t enforce crypto bans, then you haven’t thought about it very much. MITM certs to snoop all internet traffic, tying all devices to real identities as a prerequisite for internet access, making it a crime
113.
by atty 4y ago
In the long term, complete displacement of hydrocarbons from the economy is probably the end goal. However, we are nowhere near being able to do that right now. Obviously for the billions of vehicles on the road and the current grid power g
114.
by atty 4y ago
Yes, your explanation is essentially correct. There is work done in the areas you’re talking about - essentially forcing models to more explicitly learn “concepts” - and in very large language models that seems to be emerging naturally. But
115.
by atty 4y ago
Learning in this sense means it’s able to extrapolate to unseen data (I.e., it’s learned correlations that are inherent to the problem, not just inherent in the training data). Memorizing, on the other hand, implies that it will do very wel
116.
by atty 4y ago
I’d be fine if every vehicle had the hardware in it and it was activated via an upsell at the dealership. I think the truly insidious thing here is the subscription aspect, for all the various reasons other people in the responses have stat
117.
by atty 4y ago
You can have what I would consider deep knowledge of a system without the ability to manufacture it or modify it. For instance, we have pretty deep knowledge of how the sun or other stars work, but we can’t even begin to dream about creatin
118.
by atty 4y ago
The overview didn’t give too many details so hopefully I’m not arguing against too much of a straw man, but I don’t find the idea that certain physical processes mean we are fundamentally different is sound. By their very nature, those are
119.
by atty 4y ago
The OP said the service adds no value to the customer and I was specifically refuting that claim. Everyone knows that most addictive things are ok in moderation (I say most because I would argue things like cigarettes and certain other drug
120.
by atty 4y ago
There is nothing wrong with food delivery when used in moderation. I use DoorDash once a week to get a lunch delivered on a day where I have meetings running through lunchtime. It saves me time and hassle, and is a fun change of pace. It al

More ›