williamtrask

11 ms·

91.
by williamtrask 3y ago
So this is a good idea because it can create vastly more training data for a model to learn from. However, it seems likely that these models are going to hallucinate like crazy. As featured in the documentary, the AlphaGo program struggled
92.
by williamtrask 3y ago
> “Just because mistake is common” A good example of why having a language that is squishy to common errors is valuable. I still understood your point even though it’s grammar wouldn’t compile.
93.
by williamtrask 3y ago
Machine learning is a massive counter example to this trend. Specialised deep learning hardware is just supporting an even more general GPT.
94.
by williamtrask 3y ago
Devils advocate, if the post was about building an open source non-profit with that level of financial success I don’t think there would be so much salt.
95.
by williamtrask 3y ago
Fwiw I don’t think those are “the great entrepreneurs”. They’re rich and famous, yes, but “THE great entrepreneurs”?. I’d prefer Tesla, Jobs, and even JCR Licklider over them.
96.
by williamtrask 3y ago
To be fair. The title of the post only focuses on money and completely ignores whether the work has any real value to themself or society. Kindof implies pretty strongly “their identity”.
97.
by williamtrask 3y ago
Care to comment on the idea that $ is over celebrated as a metric of success? That seemed like a bigger point.
98.
by williamtrask 3y ago
There’s quite a few “if”s here that imply those at the bottom are able to partake in the financial maneuverings of those at the top.
99.
by williamtrask 3y ago
Then they should upgrade their grid? What’s your point?
100.
by williamtrask 3y ago
I don’t know why but that’s the funniest HN comment I’ve ever seen. I’m still chuckling. Took me a minute to figure it out. xD
101.
by williamtrask 3y ago
More or less the same experience here. I also think it prepared me pretty well for WFH (which I now absolutely love).
102.
by williamtrask 3y ago
> people have completely given up on society and said fuck it, we'll make our own. Fwiw, this type of thinking played a pretty strong role in how America began (and in other social/moral movements). It's not always a bad t
103.
by williamtrask 3y ago
...huh... there's an idea Would just routing the data via starlink be good enough? (if you could hide the original location)
104.
by williamtrask 3y ago
For a price…
105.
by williamtrask 3y ago
We might not be able to force a cure, but I can think of a multi trillion dollar industry (or two) that’s undoubtedly pushing the opposite. Maybe we should start there.
106.
by williamtrask 3y ago
True in the limit yet democracy and free markets both imply popularity has something to it.
107.
by williamtrask 3y ago
Anyone reproduced that output? Seems a little bit picturesque given this paper.
108.
by williamtrask 3y ago
> Less waste is almost always more profitable …something something 3M …something something oil industry …something something tobacco industry, pesticides, fast fashion, disposable products, and factory pollution
109.
by williamtrask 3y ago
The cost of fake reviews on society is subtle but may be high. And it’s too large of a scale for FTC to realistically pursue everyone. I suspect it needs to sound big and scary to work.
110.
by williamtrask 3y ago
But they don’t work very well at temp 0. Better to seed your random numbers.
111.
by williamtrask 3y ago
Food for thought: randomness is in the eye of the beholder. It’s only random to you if you don’t know how to predict it. So can a mind ever truly be stochastic? Perhaps to the minds of others, but never to itself.
112.
by williamtrask 3y ago
Fake isn’t the right word here. The synthetic images contain real structure useful for learning.
113.
by williamtrask 3y ago
Lol. Probably worried it would reproduce and become a paperclip maximiser.
114.
by williamtrask 3y ago
> there are no physical or info-theoretical limits that superhuman intelligence must require a megawatt-sized compute cluster and all the data on the internet (which obviously no human could ever see). Much of your "intelligence&qu
115.
by williamtrask 3y ago
> “Motivated by this limit, we investigate scaling language models in data-constrained regimes. Specifically, we run a large set of experiments varying the extent of data repetition and compute budget, ranging up to 900 billion training
116.
by williamtrask 3y ago
Which goes to show you one of the best strategies in ML isn’t necessarily thinking about learning theory, it’s thinking about what our fastest computers are most capable of doing. But this does run out of steam (or rather…data) eventually.
117.
by williamtrask 3y ago
Paper you’re looking for is called “Attention is all you need”
118.
by williamtrask 3y ago
One more step towards digital ID
119.
by williamtrask 3y ago
I believe so - Narrow AI. It seems to be much easier to build than generalist models. Think all the protein folding, game playing, image classifying, machine translating, image captioning, super-intelligent AIs of the last decade. It’s not
120.
by williamtrask 3y ago
Fun fact - a good percentage of YouTube and Spotify views are fake.

More ›