Building a Study Companion App with STT, TTS

Hi everyone, I'm exploring the possibility of building a study companion app that utilizes large language models (LLMs) like Mixtral, Claude, or LLAMA. The idea is to provide users with a standalone tool that can: Adapt to slight changes in the PDF content in the future (presumably through RAG). Offer Text-to-Speech (TTS) functionality for reading the material aloud. Integrate Speech-to-Text (STT) capability to allow users to interact with the LLM through voice commands or questions. I would love to hear from the community: -Has anyone attempted or seen a similar project using LLMs and large PDFs for educational purposes? - Are there specific challenges I should be aware of regarding RAG, TTS, and STT integration? - Any general advice or recommendations for building such a study companion app?