Besides the technical answer already given, this is a pretty standard architecture for search ranking and other problems where your fine grained decisions are t

Besides the technical answer already given, this is a pretty standard architecture for search ranking and other problems where your fine grained decisions are too expensive to run on everything.