3 ms·
Develop locally, git push, ssh into VM, git pull. Works fine for small scale FastAPI RAG setup with proprietary, mostly static data. Gateway handles the retrie
by intalentive 3y ago
Develop locally, git push, ssh into VM, git pull.
Works fine for small scale FastAPI RAG setup with proprietary, mostly static data. Gateway handles the retrieval and routes to one of a handful of LLM servers. Nimble and kind of fun, honestly.