4 ms·
I've got bad news for you, but the current state of rabid hiring means that this was very likely written by people that airbnb calls "data scientists" or "machi
by baron_harkonnen 7y ago
I've got bad news for you, but the current state of rabid hiring means that this was very likely written by people that airbnb calls "data scientists" or "machine learning engineers", I'm sure half of these people have a phd in some arbitrarily "quantitative" field.
The state of all large companies that I've seen that are not FAANG is that they are rushing to build teams of "data scientists" that slap together keras models and "ship" them, meaning the outputs are stuffed in a db only to be consumed by other keras models.
My favorite gem from the original paper, which shows the sad, sad state of deep learning in industry is this line:
>Out of sheer habit, we started our first model by
initializing all weights and embeddings to zero, only to discover that is the worst way to start training a neural network.
I can't imagine anyone who has even a mild understanding of how neural networks are implemented and trained making this mistake.