3 ms·
There are none that run on the edge, yet. Few more miles to go before we "peak".
by vishnumohandas 3y ago
There are none that run on the edge, yet. Few more miles to go before we "peak".
- 0x6c6f6c 3y agoHmmm. Does pgvector count? That's supported by NeonDB, serverless compute on PostgreSQL. https://neon.tech/docs/extensions/pgvector https://neon.tech/docs/extensions/pgvector
- nikita 3y ago(Neon CEO) It’s about to get a lot better too. Pgvector now supports multi-threaded build https://github.com/pgvector/pgvector/issues/409#issuecomment-1905594721 https://github.com/pgvector/pgvector/issues/409#issuecomment...
- vishnumohandas 3y agoBy "edge", I was talking about mobile / IOT devices. The closest I can see is the VSS extension[1] for Sqlite. [1]: https://github.com/asg017/sqlite-vss https://github.com/asg017/sqlite-vss
- janalsncm 3y agoWhat is the use case for this?
- vishnumohandas 3y agoRunning machine learning on device. Context: I'm working on an e2ee alternative to Google Photos[1] where we have to cluster embeddings (for face recognition) and run similarity searches (for semantic search[2]) on device. [1]: https://ente.io https://ente.io [2]: https://openai.com/research/clip https://openai.com/research/clip
- ipsum2 3y agoIncorrect, most of the libraries can run on edge, they're just C++.
- marginalia_nu 3y agohnswlib?
- vishnumohandas 3y agoFrom a cursory glance, usearch[1] seems more portable. [1]: https://github.com/unum-cloud/usearch https://github.com/unum-cloud/usearch
- marginalia_nu 3y agoNeat!