5 ms·
Had a bit of a chuckle at the very-2024 definition of the Stein shrinkage estimator: \hat{mu} = ReLU(…)
by hyperbovine 2y ago
Had a bit of a chuckle at the very-2024 definition of the Stein shrinkage estimator:
\hat{mu} = ReLU(…)
- toth 2y agoDitto. I think that ship has sailed, but I think it's unfortunate that "ReLU(x)" became a popular notation for "max(0,x)". And using the name "rectified linear unit" for basically "positive part" seems like a parody, like insisting on calling water "dihydrogen monoxide".
- BlueTemplar 2y agoIt hasn't "sailed" as long as they want to communicate with non-machine-learning people.