3 ms·
OP's cofounder here. Thanks for pointing out this test case. Surfaced that we weren't handling symlinks properly. With this fix, I was able to successfully embe
by CuriousJ 2y ago
OP's cofounder here. Thanks for pointing out this test case. Surfaced that we weren't handling symlinks properly. With this fix, I was able to successfully embed and index most of the repo (though I stopped at 100 embedding jobs so that we don't burn through OpenAI credits).
P.S. You'll see a bunch of warnings for e.g. binary files that are ignored.
https://github.com/Storia-AI/repo2vec/commit/1864102949e7203205c3ab855cc9a3918494a265 https://github.com/Storia-AI/repo2vec/commit/1864102949e7203...