I made something similar in my project. My more difficult task has been choice the right approach to chunking long documents. I used both structural and semanti

I made something similar in my project. My more difficult task has been choice the right approach to chunking long documents. I used both structural and semantic chunking approach. The semantic one helped to better store vectors in vectorial DB. I used QDrant and openAi embedding model.