What BinRoo called "parameters" are usually known as "hyperparameters" (parameters are the settings that are learned through gradient descent). There are method

What BinRoo called "parameters" are usually known as "hyperparameters" (parameters are the settings that are learned through gradient descent). There are methods to learn hyperparameters automatically [1], but they're extremely computationally intensive. Even with a single set of hyperparameters, it can take hours to days for training to converge. Now imagine having to run hundreds of experiments to find the best setting. [1] https://papers.nips.cc/paper/4443-algorithms-for-hyper-parameter-optimization.pdf https://papers.nips.cc/paper/4443-algorithms-for-hyper-param...