This is why I am leaning towards making the llm generate code that calls operates on took calls instead of having everything in JSON. Huggingfaces's smolagents

This is why I am leaning towards making the llm generate code that calls operates on took calls instead of having everything in JSON. Huggingfaces's smolagents library makes the llm generate python code where tools are just normal python functions. If you want parallel tools calls just prompt the llm to do so. It should take care of synchronizing everything. Ofcourse there is the whole issue around executing llm generated code but we have a few solutions for that