3 ms·
When it comes to ML scalability is a constraint not a goal. The goal is to minimize some loss function and it turns out simple dot product can be outperformed b
by toto444 4y ago
When it comes to ML scalability is a constraint not a goal. The goal is to minimize some loss function and it turns out simple dot product can be outperformed by more complex algorithms.
I remember reading a few years ago that most search engines use some tree based model. If that's the case, that means the idea of monotonic linear weights is not relevant.
- h0l0cube 4y agoCan you be more specific? Dot product is about as performant as it gets with linear memory access and SIMD multiply accumulate. Throw random memory access and flow control in there and it’s a struggle to do it faster. Unless the factors are sparse, in which case just elide the zero values.
- ethbr0 4y ago> scalability is a constraint not a goal. The goal is to minimize some loss function
- h0l0cube 4y agoMy bad. I was under the impression that most search engines are compute bound, but if anything there’s probably a glut of compute for such applications and a market appetite for better results.
- ethbr0 4y agoAlso, I'd assume it's highly time-agnostic (i.e. content change timespan : compute availability timespan). So you can run your bulk-recomputing whenever you have spare capacity. Stale rankings aren't great, but don't hurt that much. As long as your liveness is more frequently updated, so you don't send people to dead sites.
- h0l0cube 4y agoCertainly caching is important, especially for Word2Vec or other NLP which you'd want to happen in a separate stage after crawl, but as someone mentioned in a sibling comment, there are some factors that are calculated per-query, which can have a lot of cache misses for novel queries.
- ethbr0 4y agoIf so, I'd highly suspect Google varies the compute/cache permitted for novel queries. By this point, I can't imagine they haven't automatically balanced {revenueFromQuery} to {costOfQuery}. No sense delivering hyperoptimized results if you lose money on generating them.
- h0l0cube 4y agoI’d suspect you’re right