3 ms·
sort of, there was the original bigann and then they followed up with a couple more specialized contests the following year, i think it's over now ~300M modern
by jbellis 1y ago
sort of, there was the original bigann and then they followed up with a couple more specialized contests the following year, i think it's over now
~300M modern-sized vectors is pretty close to jvector's limit in a single index (the Cassandra layer can shard more) https://foojay.io/today/indexing-all-of-wikipedia-on-a-laptop/ https://foojay.io/today/indexing-all-of-wikipedia-on-a-lapto...
that said I think Mariano (new jvector maintainer) is working on ways to handle larger datasets in a single index but I'm not sure where that is on his priority list