3 ms·
This is (weirdly) common in production ML codebases written by software engineers. Like you, I have no idea why unless it's a memory optimisation (where you cou
by disgruntledphd2 4y ago
This is (weirdly) common in production ML codebases written by software engineers. Like you, I have no idea why unless it's a memory optimisation (where you count 4+ as many).
- ladon86 4y agoHaving every column as a boolean (0/1) means you can treat it as a bitmap. As an (entirely fictional) example, imagine if you wanted to get the features of a thread instead of a single tweet. You could do it as a union of all the tweets: threadFeatures = tweet1 | tweet2 | tweet2
- disgruntledphd2 4y agoOk that makes lots of sense from an engineering perspective. It's pretty insane from a statistical perspective though, which I think was the original point.
- nomel 4y ago> It's pretty insane from a statistical perspective though Efficiency is way more of a concern, at this scale, than the more trivial was of trying to find a competent person that wouldn't misuse the values.