3 ms·
I see many of my friends building some kind of RAG system with chat interface. I have been building some stuff on top of the OpenAi interface (to use their sto
by lysecret 3y ago
I see many of my friends building some kind of RAG system with chat interface.
I have been building some stuff on top of the OpenAi interface (to use their store) but find myself wanting to implement some simple UI elements (like a date selected or a simple dashboard).
So I feel like these types of apps have a few re occurring elements:
1. A chat interface „frontend“ (with threads, interfaces to popular APIs or local models) nice Ui ideally extensibility to some custom UI elements authentication etc.
2. API calls. (E.g. like OpenAI actions) Simplest case just reading and writing to a db (simple crud).
3. Local data + RAG. With a custom retrieval/search logic could be embeddings or simpler search methods.
Do you know open source software for all three elements? Of course you can piece it together and maybe this is the best approach. But maybe you could build something integrated.
- dluc 3y agoabout #3 I’ll recommend https://github.com/microsoft/kernel-memory https://github.com/microsoft/kernel-memory :)
- d7y 3y agoI love the idea of allowing anyone to build apps or experiences on top of some of these common elements. We have briefly discussed an approach where we make some of these common elements available as abstractions and let people build "apps" on top of it. It would operate kind of similar to how Google's app store does in that the head use cases (email, photos, camera, etc) are first-party apps, but then anyone can build and publish a third-party app using the Android SDK.