2 ms·
By the time you run enough iteration loops to chunk things up and summarize + context size it's neither cheap nor fast when you account for the effort it takes
by moonchrome 3y ago
By the time you run enough iteration loops to chunk things up and summarize + context size it's neither cheap nor fast when you account for the effort it takes to get it there. I could see tech support eventually being profitable but in my experience even GPT4 is just so randomly unreliable - it's not there yet.