3 ms·
Yeah that's a scary thing! Hopefully the price cap doesn't get hit. Also the way its built, you can chat with a 5 hour video without breaking the bank because
by yoeven 3y ago
Yeah that's a scary thing! Hopefully the price cap doesn't get hit.
Also the way its built, you can chat with a 5 hour video without breaking the bank because only relavant chunks of that video will be passed as context based on the question
- social_quotient 3y agoHow did you decide the chunking size? I’m working on a similar project and it seems our sweet spot was around 800 . But would really love to hear what others are doing here for RAG chunk sizes.