That’s an interesting observation. Usually we try to control that, but with LLMs the non-determinism is fine. It seems like that would make it hard to unit tes

That’s an interesting observation. Usually we try to control that, but with LLMs the non-determinism is fine. It seems like that would make it hard to unit test LLM code, but they seem to be managing.