4 ms·
I'm learning LLM at the moment, RAG particularly. [1] I ended up built InkChatGPT as my learning project and it was huge fun. It is an AI Agent that could help
by vinhnx 3y ago
I'm learning LLM at the moment, RAG particularly. [1]
I ended up built InkChatGPT as my learning project and it was huge fun. It is an AI Agent that could help learning from multiple documents and you can chat with it, thank Chat PDF GPT.
I use LangChain as LLM framework to simplify the backend, and using Streamlit as front end UI and deployment. Using OpenAI `gpt-3.5-turbo` model, Use HuggingFace embeddings to generate embeddings for the document chunks with `all-MiniLM-L6-v2` model.
To be honest, coming from Mobile development background, learning about ML and reading about LLM models, prompt tuning and various techniques really opens my mind, but the vast information and knowing how to start is difficult.
[1] InkChatGPT: https://github.com/vinhnx/InkChatGPT https://github.com/vinhnx/InkChatGPT
- orsenthil 3y agoVery interesting project. I thought something along the lines for learning this field too. This is a great introduction. Thank you.
- vinhnx 3y agoThank you for your compliment, I just wandering and tinkering all weekend. I am picking to update the app UI and learn more about improving the app recently. I plan to pickup more on LLMs topic and will start experimenting with different models.