4 ms·

[stub for offtopicness]

by tomhow 3mo ago

iustinai 3mo ago
man this could save me so much money lol
- jack1689 3mo ago
  Would love to hear your feedback if you can try it. We initially rolled out BM25 for tool search as it worked best for us internally. Recently rolled out also embeddings and an hybrid option that is being tested in production as we speak
KristianLentino 3mo ago
Benchmarks looks very promising! I’ll try to test this new tool in the next few days thanks for sharing!
- rstagi 3mo ago
  Thank you mate! Please share your feedback :)
atenareply 3mo ago
This looks so nice!
- atenareply 3mo ago
  I see you built the core in Rust with bindings to TS/Python. y?
  - jack1689 3mo ago
    Yes! I should have mentioned in the original post. It was actually built in Typescript at first, but then the performance were not good enough for production use cases. With Rust the footprint was way lower, and we managed tear the latency down from 200ms to 20ms for a single search
missmoss 3mo ago
This is neat! It tackles a boring but real problem with agents. When you have too many tools, the model gets confused. This is a good search box for its tools instead of dumping everything into the prompt. Benchmarks is amazing!
- jack1689 3mo ago
  Thank you! Let us know how it works if you try it out :) of course real world is another story, but we agree benchmarks are amazing indeed!
flaviobernoni 3mo ago
really cool, first time I've seen anyone treat "which tools does my agent even get to see" as its own problem. Is the roadmap more about pushing deeper on the retrieval side over time, or mostly about covering more frameworks/languages?
- jack1689 3mo ago
  Thank you! Right now we're adding some frameworks adapters to lower the adoption friction, and pushing deeper on new algorithms on the retrieval side. More languages support is not on the radar yet, but we accept contributions! :)
kenlo 3mo ago
[flagged]
bbg2401 3mo ago
Anyone else suspect this is an entirely astroturfed comment section?
- tortilla 3mo ago
  Yes. The comments read like positive ai vibes and their profiles seem empty and low karma.
  - jack1689 3mo ago
    Hey guys, fair callout, but no AI involved, promise! You're right that some comments look off and someone's farming karma for sure. We see genuine traffic to the repo anyway, so people is checking it out! Critical feedback is what we're here for, so fire away if you have anything :)
    - tomhow 3mo ago
      This comment was detected by our software as AI generated. It could always be a false positive, but if you're using AI at all to write your comments, please stop. It's against the guidelines and only harms your reputation in the eyes of the community.
panpot 3mo ago
[dead]

[stub for offtopicness]

by tomhow 3mo ago

[stub for offtopicness]

iustinai 3mo ago

man this could save me so much money lol

jack1689 3mo ago
Would love to hear your feedback if you can try it. We initially rolled out BM25 for tool search as it worked best for us internally. Recently rolled out also embeddings and an hybrid option that is being tested in production as we speak

KristianLentino 3mo ago

Benchmarks looks very promising! I’ll try to test this new tool in the next few days thanks for sharing!

rstagi 3mo ago
Thank you mate! Please share your feedback :)

atenareply 3mo ago

This looks so nice!

atenareply 3mo ago
I see you built the core in Rust with bindings to TS/Python. y?
- jack1689 3mo ago
  Yes! I should have mentioned in the original post. It was actually built in Typescript at first, but then the performance were not good enough for production use cases. With Rust the footprint was way lower, and we managed tear the latency down from 200ms to 20ms for a single search

missmoss 3mo ago

This is neat! It tackles a boring but real problem with agents. When you have too many tools, the model gets confused. This is a good search box for its tools instead of dumping everything into the prompt. Benchmarks is amazing!

jack1689 3mo ago
Thank you! Let us know how it works if you try it out :) of course real world is another story, but we agree benchmarks are amazing indeed!

flaviobernoni 3mo ago

really cool, first time I've seen anyone treat "which tools does my agent even get to see" as its own problem. Is the roadmap more about pushing deeper on the retrieval side over time, or mostly about covering more frameworks/languages?

jack1689 3mo ago
Thank you! Right now we're adding some frameworks adapters to lower the adoption friction, and pushing deeper on new algorithms on the retrieval side. More languages support is not on the radar yet, but we accept contributions! :)

kenlo 3mo ago

[flagged]

bbg2401 3mo ago

Anyone else suspect this is an entirely astroturfed comment section?

tortilla 3mo ago
Yes. The comments read like positive ai vibes and their profiles seem empty and low karma.
- jack1689 3mo ago
  Hey guys, fair callout, but no AI involved, promise! You're right that some comments look off and someone's farming karma for sure. We see genuine traffic to the repo anyway, so people is checking it out! Critical feedback is what we're here for, so fire away if you have anything :)
  - tomhow 3mo ago
    This comment was detected by our software as AI generated. It could always be a false positive, but if you're using AI at all to write your comments, please stop. It's against the guidelines and only harms your reputation in the eyes of the community.

panpot 3mo ago

[dead]