3 ms·
I chunk the documents and use Elasticsearch to store the vectors. On a laptop with 8GB of GPU I can have a pretty large context window and not hallucinate.
by kbrisso 1y ago
I chunk the documents and use Elasticsearch to store the vectors. On a laptop with 8GB of GPU I can have a pretty large context window and not hallucinate.
- unstatusthequo 1y agoNice! Will have to give it a go, looks interesting. Thanks for sharing.