Are you familiar with a paper called Synergy of Monotonic Rules? http://jmlr.csail.mit.edu/papers/volume17/16-137/16-137.pdf http://jmlr.csail.mit.edu/papers/v

Are you familiar with a paper called Synergy of Monotonic Rules? http://jmlr.csail.mit.edu/papers/volume17/16-137/16-137.pdf http://jmlr.csail.mit.edu/papers/volume17/16-137/16-137.pdf The math there is above my paygrade, but it describes a way to structurally combine a certain class of ML models for very significant performance gains. More importantly, it describes why it works.