3 ms·
I wonder if it will work on https://github.com/organicmaps/organicmaps https://github.com/organicmaps/organicmaps So far two similar solutions I tested crapped
by RicoElectrico 2y ago
I wonder if it will work on https://github.com/organicmaps/organicmaps https://github.com/organicmaps/organicmaps
So far two similar solutions I tested crapped out on non-ASCII characters. Because Python's UTF-8 decoder is quite strict about it.
- nutellalover 2y agoOP here! I love this stress test. Will index and get back to you!
- CuriousJ 2y agoOP's cofounder here. Thanks for pointing out this test case. Surfaced that we weren't handling symlinks properly. With this fix, I was able to successfully embed and index most of the repo (though I stopped at 100 embedding jobs so that we don't burn through OpenAI credits). P.S. You'll see a bunch of warnings for e.g. binary files that are ignored. https://github.com/Storia-AI/repo2vec/commit/1864102949e7203205c3ab855cc9a3918494a265 https://github.com/Storia-AI/repo2vec/commit/1864102949e7203...