3 ms·
Cool. Do you mind me asking what do you mean by “trained”? Fine-tuned on your data?
by saliagato 3y ago
Cool. Do you mind me asking what do you mean by “trained”? Fine-tuned on your data?
- PaulHoule 3y agoI think the specificity of data is general, but I have a number of models that predict preferences and engagement for myself and communities. The production models either use classical ML with bag-of-words and other features or classical ML on BERT-like embeddings. The data is a set of judgements about individual documents. I tried fancier “fine-tuning” methods and the noisy nature of the data means they won’t perform vastly better than my current models and have training times more like 30 minutes instead of 30 seconds but it is worse than that because if I want good results I might need to fine-tune 8 models and pick the best. So I stick with my system because I can retrain as much as I like, run thousands of experiments a day if I want, etc.