kbyatnal

13 ms·

31.
by kbyatnal 1y ago
"PDF to Text" is a bit simplified IMO. There's actually a few class of problems within this category: 1. reliable OCR from documents (to index for search, feed into a vector DB, etc) 2. structured data extraction (pull out ta
32.
Extend (YC W23) is hiring engineers to build LLM document processing(jobs.ashbyhq.com)
1 points by kbyatnal 1y ago
33.
Extend (YC W23) is hiring engineers to build LLM document processing(jobs.ashbyhq.com)
1 points by kbyatnal 2y ago
34.
Extend (YC W23) is hiring engineers to build LLM document processing(jobs.ashbyhq.com)
1 points by kbyatnal 2y ago
35.
by kbyatnal 2y ago
yeah that's a fun challenge — what we've seen work well is a system that forces the LLM to generate citations for all extracted data, map that back to the original OCR content, and then generate bounding boxes that way. Tons of ed
36.
by kbyatnal 2y ago
Yup definitely, and this is exactly why I built my startup. I've heard this a bunch across startups & large enterprises that we work with. 100% automation is an impossible target, because even humans are not 100% perfect. So how we
37.
by kbyatnal 2y ago
re: real world implications, LLMs and VLMs aren't magi, and anyone who goes in expecting 100% automation is in for a surprise (especially in domains like medical or legal). IMO there's still a large gap for businesses in going fro
38.
by kbyatnal 2y ago
We're approaching the point where OCR becomes "solved" — very exciting! Any legacy vendors providing pure OCR are going to get steamrolled by these VLMs. However IMO, there's still a large gap for businesses in going fro
39.
by kbyatnal 2y ago
Extend | Senior/Staff Software Engineer | NYC | Full-time | $175k-$250k | 0.50% - 1% Equity Extend is building a LLM-native document processing platform (massive market w/ low NPS existing solutions) ( https://extend.app
40.
Extend (YC W23) is hiring engineers to build LLM document processing(jobs.ashbyhq.com)
1 points by kbyatnal 2y ago
41.
by kbyatnal 2y ago
We work with fortune 500s in sensitive industries (healthcare, fintech, etc). Our policies are: - data is never shared between customers - data never gets used for training - we also configure data retention policies to auto-purge after a t
42.
by kbyatnal 2y ago
This is spot on, any legacy vendor focusing on a specific type of PDF is going to get obliterated by LLMs. The problem with using an off-the-shelf provider like this is, you get stuck with their data schema. With an LLM, you have full contr
43.
by kbyatnal 2y ago
It's clear that OCR & document parsing are going to be swallowed up by these multimodal models. The best representation of a document at the end of the day is an image. I founded a doc processing company [1] and in our experience,
44.
by kbyatnal 2y ago
Extend | Senior/Staff Software Engineer | NYC | Full-time | | $175k-$250k | 0.50% - 1% Equity Extend is building a next generation document processing platform (massive market w/ low NPS existing solutions) ( https://ext
45.
Extend (YC W23) is hiring engineers to build LLM document processing(jobs.ashbyhq.com)
1 points by kbyatnal 2y ago
46.
Extend (YC W23) is hiring engineers to build LLM document processing(jobs.ashbyhq.com)
1 points by kbyatnal 2y ago
47.
Extend (YC W23) is hiring engineers to build LLM document processing(jobs.ashbyhq.com)
1 points by kbyatnal 2y ago
48.
by kbyatnal 2y ago
"real improvements came from adjusting the prompts to make things clearer for the model, and not asking the model to do too much in a single pass" This is spot on, and it's the same as how humans behave. If you give a human t
49.
by kbyatnal 4y ago
that among others! a lot of manual work + some automated scraping (there's about ~3000 forums in the index today)
50.
by kbyatnal 4y ago
thank you! results ranking is very primitive today, but a lot of users have commented that they would prefer ordering by date (latest first) so I've been looking into that
51.
by kbyatnal 4y ago
https://crowdview.ai - search engine for forums and discussion sites Like many of you, I find Google results to be full of SEO spam and have resorted to adding "site:reddit.com" or "site:news.ycombinator.com"
52.
Show HN: Search Engine for Forums(crowdview.ai)
30 points by kbyatnal 4y ago|7 comments
53.
by kbyatnal 4y ago
I saw something along these lines on Twitter and think it's very true: the right way to think about ChatGPT is not "what can I do if I had API access to an intelligent person?" which is how most are treating it (because it&#x
54.
by kbyatnal 4y ago
This is interesting! I wonder how different the results are from just indexing the contents of the page and semantically searching them (vs. trying to predict the next link). Have you tried anything like that?
55.
by kbyatnal 4y ago
yup totally agree, but I think it's nearly impossible to compete with Google and make something much better for certain types of queries (e.g. factual info, location queries, etc). They have too much data and too much of a head start.
56.
by kbyatnal 4y ago
IMO this article misses the biggest issue with search engines today. It's less about any ranking algorithm (like PageRank), but rather the root cause is with indexing. No matter how much you fine tune your ranking system, if your index
57.
by kbyatnal 4y ago
Not sure about the main site, but AskMetaFilter still has a high level of discussion content. I find myself checking it every so often.
58.
by kbyatnal 4y ago
Finding new forums and communities like this is one of the reasons I built CrowdView: https://crew-rho.vercel.app/ It's a search engine specifically for forums and discussion content (think message boards, Discords, Tw
59.
Show HN: CrowdView – Discussions Search Engine (stop adding “Reddit” on Google)(crew-rho.vercel.app)
24 points by kbyatnal 4y ago|5 comments
60.
by kbyatnal 4y ago
I was very excited by this and it's promising, but it needs a bit more work to be usable. I was hoping the RSS technique would help avoid the SEO and blogspam that Google is now filled with. Unfortunately, I still get quite a bit of th

More ›