4 ms·

Thanks for your work on this; excited to try it out! The Google API models support 1M+ tokens, but these are just 8K. Is there a fundamental architecture diffe

by causal 2y ago

Thanks for your work on this; excited to try it out! The Google API models support 1M+ tokens, but these are just 8K. Is there a fundamental architecture difference, training set, something else?