4 ms·
In my testing, that often causes the model to 'drift' and ramble wildly compared to just getting one long output from the very start. The issue is probably tha
by dotnet00 2y ago
In my testing, that often causes the model to 'drift' and ramble wildly compared to just getting one long output from the very start.
The issue is probably that when you split it by just asking for the next section, you're asking it to figure out how to continue from a block that wasn't written with the awareness that it'd have to add on to it.
From the diagram on the repo, I guess this first plans out the structure for each block, and generates the blocks based on the plan.