Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
mfrye0
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
7 ms
·
31.
▲
by
mfrye0
1y ago
This hits home. We're building business intelligence APIs around entity resolution, and the buyer/user split gets messy when you have engineering, product, and data science teams all involved. Engineers immediately understand why
32.
▲
by
mfrye0
1y ago
Interesting. Was that a MDM focused product for healthcare or something more general infra wise like Informatica? I don't have much context in the healthcare space and the challenges that exist there. We've been mainly talking to
33.
▲
by
mfrye0
1y ago
Nice! Yeah, a typeahead works to a degree. I imagine that's searching their own instance vs calling out to a standardized DB you manage? Raw materials is definitely a different animal, so auto-generating definitely works. I know a comp
34.
▲
by
mfrye0
1y ago
Congrats on the launch! Love seeing modern manufacturing systems. Do you handle supplier master data management? We're seeing procurement teams struggle with duplicate vendors in their ERPs - same supplier gets entered 5 different ways
35.
▲
by
mfrye0
1y ago
I'll check that one out. The copy aspect was the main value prop for the app I chose: Voice Type. You can do ctrl-v to start recording, again to stop, and it pastes it in the active text box anywhere on your computer.
36.
▲
by
mfrye0
1y ago
I know what you mean. This new generation of speech recognition is different though. It's able to understand fairly technical terms, specialized product names and other stuff that previously would have been garbled text. Even if it get
37.
▲
by
mfrye0
1y ago
Haha yeah, it does feel a bit weird. I often work on large, complicated projects that span the whole codebase and multiple micro services. So it's often a blend of engineering, architectural, and product priorities. I can end up talkin
38.
▲
by
mfrye0
1y ago
I checked that one out. The one that Reddit recommended was Voice Type. It's completely offline and a one-time charge: https://apps.apple.com/us/app/voice-type-local-dictation/id6... The developer is pre
39.
▲
by
mfrye0
1y ago
My optimization hack is that I'm using speech recognition now with Claude Code. I can just talk to it like a person and explain the full context / history of things. Way faster than typing it all out.
40.
▲
by
mfrye0
1y ago
Yes, none of the top LLMs can do entity resolution well yet. I constantly see them conflate entities with similar names - they'll confidently cite 3 sources about what appears to be one company, but the sources are actually about 3 dif
41.
▲
by
mfrye0
1y ago
Very cool. I read through those links - really sophisticated setup. We're experimenting with something similar on the embeddings side. Having dealt with this challenge at my last 3 companies, it's easy to hack together something t
42.
▲
by
mfrye0
1y ago
We're working with an enterprise customer on exactly this problem. The hardest part is entity resolution - figuring out who "Acme Inc" actually is from messy transaction data and what they do. We built an AI agent specificall
43.
▲
by
mfrye0
1y ago
I was thinking the same. Forward thinking sites might add this, but the vast majority of website owners probably wouldn't be able to figure this out. Some middle ground where an agent reverse engineers the api as a starting point would
44.
▲
by
mfrye0
1y ago
Checking it out and I see you're using CDP. It's been a bit, but I'm pretty sure use of CDP can be detected. Has anything changed on that front, or are you aware and you're just bypassing with automated captcha handling?
45.
▲
by
mfrye0
1y ago
Thanks for the info. That makes sense. Looking forward to trying out the product more when I have a moment.
46.
▲
by
mfrye0
1y ago
Right, I saw that. ChatGPT does the same. My question is how you can confirm the entity you're referencing in each source is actually the entity you're looking for? An example I ran into recently is Vast ( https://www.va
47.
▲
by
mfrye0
1y ago
Congrats on the launch! How do you dedupe entities, like companies and people? I've noticed ChatGPT tends to provide "great" results when asking about different entities, but in reality it just groups similar sounding entitie
48.
▲
by
mfrye0
2y ago
I see the example for running a distributed task queue. The docs aren't so clear though for running a distributed workflow, apart from the comment about using a vm id and the admin API. We use spot instances for most things to keep cos
49.
▲
by
mfrye0
2y ago
As others have mentioned, converting html to markdown works pretty well. With that said, we've noticed that for some sites that have nested lists or tables, we get better results by reducing those elements to a simplified html instead
50.
▲
by
mfrye0
3y ago
Congrats on the launch. This looks awesome. I'm actually working with a number of companies who are exploring this space. Many of them are in the current YC batch. We're helping to provide the core business data, then we're e
51.
▲
by
mfrye0
3y ago
Perfect. Yeah, we're using both, but mainly TS. We'll test that out.
52.
▲
by
mfrye0
3y ago
I've been looking for this exact thing for awhile now. I'm just starting to dig into the docs and examples, and I have a question on workflows. I have an existing pipeline that runs tasks across two K8 clusters and share a DB. Is
53.
▲
by
mfrye0
3y ago
My thought here is that Google is still haunted by their previous AI that was classifying black people as gorillas. So they overcompensated this time. https://www.wsj.com/articles/BL-DGB-42522
54.
▲
by
mfrye0
3y ago
I think it depends on what you're trying to do. For any given project, what's the goal? Who are you building it for? Are you trying to build a business around it? There's a big difference in working on a project for fun, and
55.
▲
by
mfrye0
3y ago
Pretty small still at 500gb. It only stores hot data right now and a subset of what's important. Most of our data is in S3.
56.
▲
by
mfrye0
3y ago
If you're already on AWS, I recommend switching to postgres for now. For context, I have 3 RDS instances, each multi zone, with the biggest instance storing several billion records. My total bill for all 3 last month was $661. Postgres
57.
▲
by
mfrye0
3y ago
I know a guy that built his whole product out on Hubspot using their free CRM and APIs. I believe he said he's storing a few hundred million records there and there's been no issues so far.
58.
▲
by
mfrye0
3y ago
I used to work for a division of State Farm insurance which ran into some similar issues with addresses on or close to state lines. Insurance is also one of those businesses that's very particular about location, as we were only approv
59.
▲
by
mfrye0
3y ago
Yes. This was because HiQ was creating fake accounts to scrape member profiles, which was deemed to be in violation of the TOS. Legal has reviewed our approach in comparison, and we're good.
60.
▲
by
mfrye0
3y ago
Awesome, thanks. We're due to update the whole marketing site.
More ›