4 ms·
I am a bit confused. Solr is the search engine. An LLM model is loaded. What does the LLM model add to the solution?
by ThinkBeat 2y ago
I am a bit confused.
Solr is the search engine.
An LLM model is loaded.
What does the LLM model add to the solution?
- m-i-l 2y agoThe LLM was for an experiment in retrieval augmented generation, i.e. "a chat with your website" style interface, using Apache Solr as the vector store. Results (on a small self-hosted LLM to keep costs manageable) weren't good enough for the functionality to be fully rolled out, so the LLM has been disabled and is likely to be fully removed.