raibosome

8 ms·

31.
9 handy Bash aliases for Mac/Linux(medium.com)
4 points by raibosome 8y ago|0 comments
32.
by raibosome 8y ago
I did think about doing that but it seems a little unfeasible. You might want to check out my repo https://github.com/raibosome/raibosome.github.io/tree/master... It's a little messy oops.
33.
by raibosome 8y ago
Explore how (stochastic) gradient descent works on a simple linear regression. I built this demo to help me better understand backpropagation, by keeping an eye on the values of the weights as they get updated. I've also added step-by-
34.
Interactive Backpropagation Demo for Simple Linear Regression(raiboso.me)
2 points by raibosome 8y ago|3 comments
35.
by raibosome 8y ago
Thank you for pointing these out! I have made the necessary edits to the citations for (1) and (2) and republished the article. For (1), the paper by Sutskever et al., 2013 ( http://proceedings.mlr.press/v28/sutskever13.
36.
by raibosome 8y ago
Sweet! Another intuition for gradient descent: Regularly updating your parameters using an educated guess. This educated guess is the gradient value.
37.
by raibosome 8y ago
If I may, I had also built a simple demo of linear regression using gradient descent before writing this post. https://raiboso.me/backpropagation-demo/ This demo allows you to choose between four optimisers, and lets y
38.
by raibosome 8y ago
This is great! I'd love to do something similar in JavaScript.
39.
by raibosome 8y ago
At the end of this post you will get a cheat sheet of the 10 common gradient descent optimisation algorithms. Using more readable notations, I will walk you through how the vanilla stochastic gradient descent slowly evolved into the popular
40.
Gradient Descent Optimisation Algorithms(towardsdatascience.com)
83 points by raibosome 8y ago|15 comments