I've seen succesful projects that add a constraint solver as a layer in a neural network, so it's potentially something that could be integrated at an even deep

I've seen succesful projects that add a constraint solver as a layer in a neural network, so it's potentially something that could be integrated at an even deeper level than our current finetuning for tool use. It's not a priority for the current big model architecture, but there's a bunch of stuff we could be doing with network architecture.