I think in order for something to properly be a tool it needs to behave deterministically. I don't need to understand every particular of how it works internall

I think in order for something to properly be a tool it needs to behave deterministically. I don't need to understand every particular of how it works internally, but as the user I need to be able to rely on consistent, predictable results. Otherwise it's worse than useless. Hand tools, machine tools, programming languages, vehicles, CAD/CAM/CAE tools are all like this. You may have to do some learning to become proficient in the tool, but once you're proficient in its use it's very unlikely to ever truly surprise you. Generally those "surprising" experiences are pretty traumatic--hopefully only emotionally (if you've ever experienced a chainsaw kick back you know what I mean). So I'm not sure how I could use an LLM as a tool, but maybe I'm just not a sufficiently proficient user? It seems like they're just too full of "surprises".