4 ms·
Cool.. Thanks for your answer I have to say, in my quick tests completions do arrive slightly but noticeably faster than Copilot's.. Which is enough to make th
by Micoloth 4y ago
Cool.. Thanks for your answer
I have to say, in my quick tests completions do arrive slightly but noticeably faster than Copilot's.. Which is enough to make this interesting!
Unless you are using a much smaller model, in which case it's too easy ahah.
Thanks and good luck for your further plans, I'll keep trying this
- varunkmohan 4y agoThanks! We've made a lot of optimizations internally for latency. We've gotten a lot of feedback that it is faster than Copilot but obviously they operate at much larger scale.