The conversation itself is sent to the LLM in regular text, and in addition it sees the feature tree (also text) and often a screenshot of whatever the current

The conversation itself is sent to the LLM in regular text, and in addition it sees the feature tree (also text) and often a screenshot of whatever the current model looks like. This is usually enough for the model to know what's going on. Yes - we're likely looking into other 3D systems in the future.