5 ms·
Is your usage of GPT3 user facing in realtime? When you implement prompt chains, doesn't the UX become really slow?
by alooPotato 4y ago
Is your usage of GPT3 user facing in realtime? When you implement prompt chains, doesn't the UX become really slow?
- LASR 4y agoIt works well if you continously provide progress to the user. In my specific use case, the data generated is progressively displayed to the user, and refined in many further chain steps. They see the evolution of this. So it feels like it's fast, but also that a bunch of work is happening.
- dandiep 4y agoYes.