2 ms·
Were using retrieval-based system for Q&A for a complex product. Feeding in user guides, release notes even transcribed some tutorial videos. Its quick to creat
by monkeydust 3y ago
Were using retrieval-based system for Q&A for a complex product. Feeding in user guides, release notes even transcribed some tutorial videos. Its quick to create a 'wow' style demo but putting into production is challenge with hallucinations and testing/benchmarks hard to do given the stochastic nature of the output each time your run with same input (temp>0). Curious on pointers if anyone is doing something similar.
- sharemywin 3y agoI'm curious what LLM your using. I would think some of the open source ones could be trained to use the facts given with much more accuracy.
- monkeydust 3y agoOpenai Gpt4. retrieval works best given the data source although debating if we should explore tuning as a next step