4 ms·
The challenge with fan out is constructing a linear conversation that makes sense that captures previous history. In any context where the LLM needs that infor
by TimPC 1y ago
The challenge with fan out is constructing a linear conversation that makes sense that captures previous history. In any context where the LLM needs that information linear loops often perform better than trying to splice together conversations from multiple parallel processes.