That's exactly what I mean; the simple sanity check case is easy, but once you start layering on things like complex geometry and surface models and volume data

That's exactly what I mean; the simple sanity check case is easy, but once you start layering on things like complex geometry and surface models and volume data, the problem grows in difficulty absurdly quickly.