mfkhalil

7 ms·

31.
by mfkhalil 1y ago
Thanks, we have noticed that it can tend to "give up" early on certain sources. Ideally the critic agent would guide it back to the correct path of continuing to go deeper, but if that doesn't work usually just adding somethi
32.
by mfkhalil 1y ago
Good point. Our main differentiation is the shared workspace - users can step in and guide the agent mid-task, kind of like Cursor vs Claude (which can technically generate the same code that Cursor does). Firecrawl (or any crawler we may u
33.
by mfkhalil 1y ago
Thanks for the feedback! From what we've seen it's actually the other way around - once it gets a sense of where this information lives the latter stages of data collection go quicker, especially since it's able to deploy sea
34.
by mfkhalil 1y ago
Thanks a lot regarding UI and good point on the schema editing. We've been having similar thoughts about pricing and offering unlimited, but since it is feasible for us in the short term due to credits we enjoy offering that option to
35.
by mfkhalil 1y ago
Yep, you can paste the list as text, or we also accept file uploads. Then, you can prompt it to enrich with certain attributes and it will do that for you.
36.
by mfkhalil 1y ago
We maintain a constant browser state that gets fed into the system prompt which shows the most recent results, current page, where you are in the content, what actions are available, etc. It's markdown by default but can switch to HTML
37.
by mfkhalil 1y ago
We currently use Firecrawl for our crawling infrastructure. Looking at their documentation, they claim to respect robots.txt, but based on user reports in their GitHub issues, the implementation seems inconsistent - particularly for one-off
38.
by mfkhalil 1y ago
Right now it can do that via URL params if that is how the website handles pagination, although we are pushing a feature in the next couple of days which allows it to take action on the DOM. If it isn't doing that in your session, you
39.
by mfkhalil 1y ago
Thanks! Unlike a lot of our competitors who use search-inspired UX, we went with an agentic approach inspired by tools like Cursor - basically iterative user control. Instead of just search query → final result (though you can do that too),
40.
by mfkhalil 1y ago
Thanks, glad to hear you had a good experience. We were heavily inspired by tools like Cursor - basically tried to prioritize user control and visibility above everything else. What we discovered during iteration was that our users are usua
41.
Launch HN: Webhound (YC S23) – Research agent that builds datasets from the web
112 points by mfkhalil 1y ago|80 comments
42.
Seeking beta users for Webhound, an AI agent that builds datasets from the web
1 points by mfkhalil 1y ago|0 comments
43.
by mfkhalil 1y ago
This is cool. Love how well it fits in with the site. Will probably keep it on.
44.
by mfkhalil 2y ago
Hey, we’re working on MatterRank which is pretty similar to this but currently works on web search. (e.g. I want to prioritize results that talk about X and have Y bias and I want to deprioritize those that are trying to sell me something).
45.
by mfkhalil 2y ago
I think in a lot of cases that's because the meta with LLMs right now is to "have them do things for you", which generally means that obfuscating what's actually happening behind the scenes can make them seem "smart
46.
by mfkhalil 2y ago
Yeah LLMs were the easiest way to get a proof of context running, but replacing it with a specialized distilled model/classifier should hopefully make it way quicker. As for the results, it's tough because we've made the deli
47.
by mfkhalil 2y ago
Credit to @ziftface — I should’ve included more examples in the original post. MatterRank is useful when you want results with specific qualitative traits that go beyond keyword matching. You can ask for stuff like “written by a woman,” “me
48.
by mfkhalil 2y ago
You don't have to create an account
49.
by mfkhalil 2y ago
Yeah that's fair, "doesn't know what we want" might have been oversimplifying. Better phrasing would have been that there is a very hard limit on the context you're able to give when using a search engine. It's
50.
by mfkhalil 2y ago
> Do you think you're getting more value than 4 iterations on the initial search term? Definitely not for all cases, but in some cases yes. Where it really makes a difference is when you're looking for qualitative attributes of
51.
by mfkhalil 2y ago
Because LLMs understand language, we can start building algorithms that respond to what users say they want. Instead of reverse-engineering user intent from behavior, you can just tell a system “more of X, less of Y” and it listens. Way mor
52.
by mfkhalil 2y ago
Actually the tutorial was breaking the homepage so took it down while it was being fixed. Should be back up now.
53.
by mfkhalil 2y ago
Fair point, I probably should have provided more context in the post. MatterRank uses LLMs to rank pages based on criteria you provide it with, not SEO tricks. It’s not meant to replace Google, but helps when you're looking for somethi
54.
by mfkhalil 2y ago
MatterRank is pretty slow still since it runs LLM evaluations on each webpage as markdown content. Wouldn't really consider it a Kagi alternative (which I haven't used but have heard great things about!), as that's more of a
55.
by mfkhalil 2y ago
If you're referring to sponsored content, then you can actually use MatterRank to configure an engine to devalue content that's trying to sell you something or is sponsored. If you mean pop-ups, MatterRank can't handle that a
56.
by mfkhalil 2y ago
I actually completely agree with this. Search is a good example, but in general it seems that general consensus has become that consumers don't know what they want, which is pretty frustrating, and probably a product of the success of
57.
Search could be so much better. And I don't mean chatbots with web access(matterrank.ai)
61 points by mfkhalil 2y ago|61 comments
58.
Show HN: MatterRank – Build search engines that rank results by your criteria(matterrank.ai)
3 points by mfkhalil 2y ago|0 comments
59.
Show HN: Remy – A Video Answer Engine(useremy.com)
2 points by mfkhalil 2y ago|0 comments
60.
by mfkhalil 2y ago
This is awesome!

More ›