pablomendes

4 ms·

1.
UpBench: Dynamically Evolving Real-World Labor-Market Agentic Benchmark [pdf](upwork.com)
2 points by pablomendes 11mo ago|1 comments
2.
by pablomendes 11mo ago
As large language model (LLM) agents increasingly undertake digital work, reliable frameworks are needed to evaluate their real-world competence, adaptability, and capacity for human collaboration. Existing benchmarks remain largely static,
3.
by pablomendes 1y ago
In what kinds of workloads or usage patterns do you see the biggest performance gains vs traditional FaaS + storage stacks?
4.
by pablomendes 2y ago
What does the tech stack look like?
5.
by pablomendes 2y ago
Is the course focused on LLMs used to generate text or does it also talk about other kinds of testing like search, images, etc?
6.
by pablomendes 2y ago
Cool! What's next in the roadmap?
7.
by pablomendes 2y ago
Congrats on the launch! I'm an inveterate search nerd so I can't help but ask how did you implement search?
8.
Show HN: Anton the Search Relevance Evaluator(objective.inc)
13 points by pablomendes 2y ago|1 comments
9.
by pablomendes 2y ago
What are you using for the search tech?
10.
by pablomendes 2y ago
That statement is both kind of true and, well, revisionist. Originally there was a strong focus on logics, clean comprehensive modeling of the world through large complicated ontologies, and the adoption of super impractical representation
11.
by pablomendes 2y ago
One thing that works well for me is going working-to-working. Get a simple, de-scoped, incomplete, probably crappy version done end-to-end. Now it's not about finishing, it's about improving. And if it was worth building in the fi
12.
by pablomendes 4y ago
Hey @afandian, can I interview you about the tech stack you all used to build search at Crossref.org?
13.
by pablomendes 4y ago
Are you planning to implement search and filter tags?
14.
by pablomendes 4y ago
How did you implement snippet search?
15.
by pablomendes 4y ago
Happy to exchange notes with you on our learnings building https://podsearch.page
16.
by pablomendes 4y ago
You might want to try semantic search instead of fiddling with keywords. Disclaimer: I'm building a plug-and-play semantic search API at https://kailualabs.com