I wanted something that works natively with llama-cpp and langchain that is also small and easy to hack on. And I also wanted everything to be seamlessly cached

I wanted something that works natively with llama-cpp and langchain that is also small and easy to hack on. And I also wanted everything to be seamlessly cached in SQlite. And also something that had built in semantic search with FAISS. And string similarity using multiple different similarity measures beyond just cosine similarity. And token-level embedding support. There is much more flexibility when you do it yourself to add whatever functionality you want quickly.