4 ms·
Also matryoshka and the ability to guide matches by using prefix instructions on the query. I have ~50 million sentences from english project gutenberg novels
by SteveJS 10mo ago
Also matryoshka and the ability to guide matches by using prefix instructions on the query.
I have ~50 million sentences from english project gutenberg novels embedded with this.
- dleeftink 10mo agoWhy would you do that and I'd love to know more
- SteveJS 10mo agoThe larger project is to allow analyzing stories for developmental editing. Back in June and August i wrote some llm assisted blog posts about a few of the experiments. They are here: sjsteiner.substack.com
- Tostino 10mo agoWhat are you using those embeddings for, If you don't mind me asking? I'd love to know more about the workflow and what the prefix instructions are like.