2 ms·
Shameless plug: If you want to experiment with semantic search for the pages you visit: https://github.com/mlang/llm-embed-proxy https://github.com/mlang/llm-em
by lynx97 1y ago
Shameless plug: If you want to experiment with semantic search for the pages you visit: https://github.com/mlang/llm-embed-proxy https://github.com/mlang/llm-embed-proxy -- a intercepting proxy as a `llm` plugin.
- mdaniel 1y agoI was going to suggest removing the extraneous network hop to pure.md but based on the notice I presume this is actually a consumer of it, so driving traffic there is a feature? https://github.com/mlang/llm-embed-proxy/blob/master/llm_embed_proxy/script.py#L184 https://github.com/mlang/llm-embed-proxy/blob/master/llm_emb...
- lynx97 1y agoThis is really just a PoC. pure.md is a pragmatic solution, since it gives good results. I was looking at markitdown but didn't find a way to disable href targets (noisy) nor did my tests of youtube transcripts work with markitdown. Keeping it on my list to monitor. Whatever works best is going to be used.