5 ms·
I've been playing with using documents as OpenAI embeddings for the past weeks and, at least for my use case, the results are meh. It seems sometimes just using
by pid-1 3y ago
I've been playing with using documents as
OpenAI embeddings for the past weeks and, at least for my use case, the results are meh. It seems sometimes just using context is not enough.
My next step is to play with fine tunning, but I have no results to report yet.
- santiagobasulto 3y agoI'd be very interested in knowing the outcome. Do you blog anywhere (or post on social)?
- deforciant 3y agohave you tried other models to generate embeddings? I am going to that direction too to create an additional layer of helpers for search. Also, thinking if the document is not too big, it might fit into the initial context with the prompt
- akiselev 3y agoTry using InstructXL for embeddings. It’s got a more complex prompt structure for generating embeddings which might be more useful
- potatoman22 3y agoIf the documents are large, try embedding smaller portions. If there's a heavy domain vocabulary, you might need a custom model.