2 ms·
> My assumption was that you were referring to results of training machine learning models. Is this correct? I would set my hyper params in a spreadsheet, whic
by breck 6y ago
> My assumption was that you were referring to results of training machine learning models. Is this correct?
I would set my hyper params in a spreadsheet, which would kick off training runs on a cluster, and report the results back in the spreadsheet hours/days later(really TSVs, but my UI was a spreadsheet). And repeat.
This was primitive stuff, and haven't done DL in a while, so not even sure if hyperparam tuning is still a thing or if that is all automated now.
- Jugurtha 6y agoHow did you do that? Were you using some kind of hooks or polling for the spreadsheet state and triggering training jobs whenever it had changed? Also, how did you deal with changing which hyperparameters you used or which algorithms you used? Did you make a spreadsheet per project per model?
- breck 6y agoI forget the exact details, but my guess is I made my own DSLs and then "executed" them. Something like: https://jtree.treenotation.org/designer/#grammar%0A%20inferredLanguageNode%0A%20%20root%0A%20%20inScope%20jobNode%20resultsNode%0A%20keywordCell%0A%20anyCell%0A%20intCell%0A%20jobNode%0A%20%20inScope%20nicknameNode%20someIdeaNode%20otherIdeaNode%20_46_46_46Node%0A%20%20crux%20job%0A%20%20cells%20keywordCell%0A%20nicknameNode%0A%20%20crux%20nickname%0A%20%20cells%20keywordCell%20anyCell%20anyCell%20anyCell%20anyCell%0A%20someIdeaNode%0A%20%20crux%20someIdea%0A%20%20cells%20keywordCell%20intCell%20anyCell%20intCell%0A%20otherIdeaNode%0A%20%20crux%20otherIdea%0A%20%20cells%20keywordCell%20intCell%20anyCell%20intCell%0A%20_46_46_46Node%0A%20%20crux%20...%0A%20%20cells%20keywordCell%0A%20resultsNode%0A%20%20inScope%20scoreNode%20_4681Node%20_4682Node%20_46_46_46Node%0A%20%20crux%20results%0A%20%20cells%20keywordCell%0A%20scoreNode%0A%20%20crux%20score%0A%20%20cells%20keywordCell%20anyCell%20anyCell%20anyCell%20anyCell%20anyCell%20anyCell%20anyCell%20anyCell%0A%20_4681Node%0A%20%20crux%20.81%0A%20%20cells%20keywordCell%20anyCell%20anyCell%20anyCell%20anyCell%20intCell%20anyCell%20intCell%0A%20_4682Node%0A%20%20crux%20.82%0A%20%20cells%20keywordCell%20anyCell%20anyCell%20anyCell%20anyCell%20intCell%20anyCell%20intCell%0Asample%0A%20job%0A%20%20nickname%20batchSize%20cluster%20seed%20...%0A%20%20someIdea%2030%20rc1%202%0A%20%20otherIdea%2030%20rc1%202%0A%20%20...%0A%20results%0A%20%20score%20started%20finished%20elapsed%20nickname%20batchSize%20cluster%20seed%20...%0A%20%20.81%202-22-2018.17%3A32%202-22-2018.20%3A32%203hr%20someIdea%2030%20rc1%202%0A%20%20.82%202-22-2018.17%3A33%202-22-2018.20%3A33%203hr%20otherIdea%2030%20rc1%202%0A%20%20 https://jtree.treenotation.org/designer/#grammar%0A%20inferr......