3 ms·
The metrics presented in the blog post are those of our production model. When designing Boomerang, we tried to balance latency and search relevance in a manner
by svcrunch 3y ago
The metrics presented in the blog post are those of our production model. When designing Boomerang, we tried to balance latency and search relevance in a manner that strikes the right balance for most use cases.
On the other hand, GTR-XXL is an example of a research model that biases in favor of search relevance, at the expense of latency. It's not really practical to deploy in production environments as a result.