4 ms·
Why? The very nature of next token prediction means it's entirely capable of having that. It's not multiple passes, it's just one pass. You making multiple call
by IanCal 2y ago
Why? The very nature of next token prediction means it's entirely capable of having that. It's not multiple passes, it's just one pass. You making multiple calls is just inserting fixed tokens then asking it to carry on completing.