Salgat

36 ms·

661.
by Salgat 3y ago
It really is that simple. Yes, there's many different approaches to this (which can become quite clever and complex, which is true of training in general), but it all really boils down to adding or averaging the gradients in most cases
662.
by Salgat 3y ago
Believe it or not, it's a simple as averaging or adding the gradients of each training result before adding it to the model weights. The same thing happens when you train a model using batches of inputs.
663.
by Salgat 3y ago
When you train a transformer, you're training what the next expected token is. You can train all positions of the sequence each in parallel rather than having to sequentially build up the memory state as you generate the sequence with
664.
by Salgat 3y ago
Hey as long as it can hallucinate a big return and carry the liability, I'm down.
665.
by Salgat 3y ago
> Feel free to create your own data interchange file format. This is such a lazy argument to make. We are both allowed to criticize flaws in data exchange formats. As far as what JSON is trying to solve, it's far beyond that, and th
666.
by Salgat 3y ago
I always hated this logic, the "I know better than you". You can still add pragmas trivially in JSON, this doesn't prevent that problem, it just makes it more convoluted at the expense of a powerful documentation feature.
667.
by Salgat 3y ago
It's a shame because it's a rather trivial thing to filter out. Personally I wish they would have left out the "//" single-line commenting to avoid the whitespace dependency.
668.
by Salgat 3y ago
I wish. My wife and I both work at different big tech companies as developers and the only thing health insurance does is guarantee we won't go bankrupt in the event of an emergency. Last month on top of spending several hundred on the
669.
by Salgat 3y ago
Yeah I don't see Apple agreeing to this. They'll just hire scabs over this, even if it means paying the scabs a competitive wage.
670.
by Salgat 3y ago
Someone has to cover the cost of hundreds of thousands of cars that have this unused feature. That's the rub.
671.
by Salgat 3y ago
"They" refers to the people who support the current Republican party, not the people who were part of the (very different) party 150 years ago.
672.
by Salgat 3y ago
These are explanations that make sense to people who already know how deep learning works but don't really explain much to beginners beyond giving them a grossly oversimplified misrepresentation of what is being discussed (while not ac
673.
by Salgat 3y ago
An AI of that level would have mastery over game theory, and would only generate asynchronous copies that it knew it could compensate for. The main advantage though, is that as long as the primary identity is advanced enough, its exponentia
674.
by Salgat 3y ago
You would think there would be something more that reverses entropy, otherwise how do you explain the universe's existence? The big bang generated a whole lot of free energy from seemingly nothing. You can extrapolate this to some high
675.
by Salgat 3y ago
Requiring in-office means both a massive cost for office buildings and losing a large portion of the hiring pool, particularly those that can most afford to be picky (top talent). I don't understand what advantage this gives a company.
676.
by Salgat 3y ago
It's his learning platform. It's hardly surprising.
677.
by Salgat 4y ago
Can we stop with this nonsense myth? The US is the second largest manufacturer in the world. Does manufacturing make up as large a share of our economy as it did in the past? No, of course not, that's a normal progression to a service
678.
by Salgat 4y ago
One is a solution that fixes the issue now, the other is us hoping for shareholders to eventually do the morally right thing (which is a silly thing to expect).
679.
by Salgat 4y ago
It boils down to work culture. Everything you can do in person, you can do remotely, you just need to ensure the company enforces a culture that embraces the tools required to make that possible. Pair programming? With modern tools it'
680.
by Salgat 4y ago
But how much more data is required to make a big difference? Is doubling the dataset considered a dramatic improvement? Or is increasing the dataset by 10x needed?
681.
by Salgat 4y ago
You stated that it's because it's the company he founded and owns, which is the legal reason.
682.
by Salgat 4y ago
I'm not asking if it's legal, I'm asking why this system is what is best for society. Is having billionaires controlling our country a good thing?
683.
by Salgat 4y ago
I'd argue that no single person should have that much power and wealth in this country. Why is it okay that Zuckerberg has absolute power over one of the most influential companies in the world? How does that benefit society as a whole
684.
by Salgat 4y ago
He didn't build that company, him and thousands of talented professionals built that company to where it is now. I'm not saying his contributions weren't a major part of that, but lets not act like he alone made this happen a
685.
by Salgat 4y ago
All they say is "we acknowledge it uses Box2D and we'd be happy to discuss it with the creator later". There's no follow-up, which I'm curious about too since one of the questions raised was whether Rovio would cons
686.
by Salgat 4y ago
If most cars on the road are taxis, this means a few things. 1) It'll be much cheaper than owning a car. 2) There will always be a car within a minute or two to pick you up when you're ready. 3) There will be cars of every configu
687.
by Salgat 4y ago
Nothing, but self-fertilization is already an established term in biology which makes it confusing.
688.
by Salgat 4y ago
At the same time you'll have a dramatic drop in car ownership (since it'll be far cheaper to be taxied), meaning less waste overall as each car is fully utilized for potentially dozens of people a day, rather than sitting on a con
689.
by Salgat 4y ago
This isn't even necessary; between fuel and wear & tear on the vehicle, you'll be paying a small fortune for those daily 8 hour commutes.
690.
by Salgat 4y ago
What will really happen is that ownership of vehicles will dramatically drop, as it's cheaper to simply rent an automated vehicle to get to your destination. This means a lot less waste, as you have far less vehicles sitting around bei

More ›