3 ms·
also costs are always based on context token, you dont want to put in 10m of context for every request (its just nice to have that option when you want to do bi
by swyx 3y ago
also costs are always based on context token, you dont want to put in 10m of context for every request (its just nice to have that option when you want to do big things that dont scale)
- 1024core 3y agoHow much would a lawyer charge to review your 10M-token legal document?
- hereonout2 3y ago10M tokens is something like 14 copies of war and peace, or maybe the entire harry potter series seven times over. That'd be some legal document!
- xp84 3y agoHmm I don’t know but I feel like the U.S. Congress has bills that would push that limit.