I’m adding some technical details! Haystack runs entirely client sided in the browser, so it has a unique tech-stack: Storage using IndexDB, haystack stores

I’m adding some technical details! Haystack runs entirely client sided in the browser, so it has a unique tech-stack: Storage using IndexDB, haystack stores user indexes locally, + a compressed 90mb NLP model (t5-small) is stored. Indexing Locally in the browser, using a t5-small bi-encoder, and some parsing of documents happens in wasm. Search Query converted to embedding, then searched over index, atlast results are reranked with a t5-small based cross encoder, and top results go through a seq-to-seq transformer to produce a nice consise textual answer.