sendtown_expwy

6 ms·

1.
by sendtown_expwy 16d ago
This post would be more effective if Mustafa treated it like what it is: a position paper, saying that for our benefit, it’s better we interpret LLMs as such. But it sounds like he just doesn’t understand it’s a non-falsifiable claim, and h
2.
by sendtown_expwy 4y ago
Meta offering the highest salary could be because people actually do care about this, and so Meta needs to pay more for people to think it’s worthwhile working there.
3.
by sendtown_expwy 5y ago
That's the point. 100 parameters is sufficient to overfit, and it's a number that's independent of the input size. Do you have a reference for your statement?
4.
by sendtown_expwy 5y ago
You are incorrect about the input dimensionality mattering. Let's say you have 100 high-res images with yes/no labels. If you hash the images and put their labels in a hashmap, you can say this is a "learned" function of
5.
by sendtown_expwy 5y ago
"Fortnite will be blacklisted from the Apple ecosystem until the exhaustion of all court appeals" It's not about sticking it to them. It's to increase the cost of their appeals and pressure them to drop the case.
6.
by sendtown_expwy 5y ago
What, you want people to host services for you for free?
7.
Ask HN: Should Airbnb be responsible if their emails are routed to spam?
1 points by sendtown_expwy 5y ago|2 comments
8.
by sendtown_expwy 6y ago
This is a really great piece. While it's unfortunate this phenomenon occurs, in a way it's also an opportunity for the many talented female VCs in the industry. I hope they capitalize on it!
9.
by sendtown_expwy 6y ago
I would guess that an average FAANG ML engineer could code up and successfully execute a forward/backward pass on a GPT-1 or GPT-2 model with a day of effort or less. (GPT-3 a little harder, but not significantly). But is that model ac
10.
Ask HN: How does Stripe Press make their books?
2 points by sendtown_expwy 6y ago|1 comments
11.
by sendtown_expwy 6y ago
I like this idea, but is the technical implementation of a progressive social policy (whether it be a tax on equity versus something else) actually the hard part? Alternative take: the hard part is that the US is heterogeneous and people ju
12.
by sendtown_expwy 6y ago
I am unfamiliar with the term mathematical engineering. What does it even mean?
13.
by sendtown_expwy 6y ago
If its deep in the network, though, couldn't you interpret it as a single neuron responsible for the substring "spider" in the caption? That seems less surprising. But, I see your point.
14.
by sendtown_expwy 6y ago
If the text encoder's representation of "spiderman" and "spider" are close together, then the image encoder is penalized if it makes the image representations far apart from each other. So what we are witnessing her
15.
by sendtown_expwy 6y ago
The model was trained to match an image with its caption. So its unsurprising to find a neuron that fires across spider man the character and a spider: those are both instances of valid captions. Same with the "iPod" example. Seem
16.
by sendtown_expwy 6y ago
This is a wonderful post -- reminds me of how important the hiring processes in the tech community are, and how exciting and amazing it can be for the joy of programming to spread to more places in the world!
17.
by sendtown_expwy 6y ago
It seems like Robinhood, when it stopped trading on GME, decided to literally transfer money from the WSB retail traders to the funds who were short on the stock. But if Robinhood needed to halt trading in order to just survive as a brokera
18.
by sendtown_expwy 6y ago
It seems unlikely the model has seen "baby daikon radishes in tutus walking dogs," or cubes made out of porcupine textures, or any other number of examples the post gives.