I experienced this in my automated GPT-4 programmer project. This was 1.5 ago back when prompt size was very limited. I couldn't put a large programs entire sou

I experienced this in my automated GPT-4 programmer project. This was 1.5 ago back when prompt size was very limited. I couldn't put a large programs entire source code in the prompt so I auto-converted it to stubs. I noticed that letting GPT-4 write more of the code had the advantage that it understood it better and less context was necessary. Now when I design systems for GPT-4 itself to use, I just let GPT-4 design them. Ask it to use an imaginary system, and what it comes up with (consistently) should be the API.