3 ms·
So much for code migrations! Although most examples are about summarization or needle in a haystack search, applications whose output should be the size of inpu
by antman 2y ago
So much for code migrations! Although most examples are about summarization or needle in a haystack search, applications whose output should be the size of input are probably more important although less advertised.
Curious if that is a business decision or a technical decision aka if optimizations for cheap and fast 128k gpt4o work only for small outputs