3 ms·

This seems like a cool project. It would be awesome if it could also index a directory of PDFs, and if it could do OCR on those PDFs to support indexing scanne

This seems like a cool project. It would be awesome if it could also index a directory of PDFs, and if it could do OCR on those PDFs to support indexing scanned documents. Probably outside of the scope of the project for now, but just the other day I was just thinking how nice it would be to have a tool like this.

samstave 3y ago
Ive wanted a crawler on my machine for auto-categorizing and organizing, tagging and moving ALL my files around based on all my machines - so the ability to crawl PDFs, downloads, screenshots, pictures, etc and give me a logical tree of the org of the files - and allow me to modify it by saying "add all PDF related to [subject] here and the organize by source/author etc... and then move all my screenshots, ordered by date here etc... I've wanted a "COMPUTER.", uh... I say "COMPUTER!", 'sir, you have to use the keyboard', ah a Keyboard, how quaint.... forever.
- 110 3y ago
  That.would.be.awesome! Khoj isn't their yet, but that actually shouldn't be too far away if you give it a voice interface and terminal access. Of course, having it be stable enough to not `rm -rf /` soon after is definitely not part of the warranty
  - samstave 3y ago
    Copy first, move and delete after confirmation from user on big moves. - So aside from doing something such as this - whats the size of your current usecase - is it being able to search and org a large orge of devs through files and directories/repos/whatever? What if you had a global glob of data/code/files - and as an enterprise you can just give each new emp an employee role, and based on their job and purported skills, just throw them at the monolith, yet the AI will tailor the info they get out of the glob. "User10267A - you are chartered with working on projects XYZ, based on your skillset - here are a few assessments to see which sections of the codebase best suit you." [does work] "OK .U267A, here is your workspace with all auths to the libs and such youll need to work on [PROJECT FSPEZ]"
110 3y ago
Yeah being able to search and chat with PDF files is quite useful. Khoj can index directory of PDFs for search and chat. But it does not currently work with scanned PDF files (i.e not with ones without selectable text). Being able to work with those would be awesome. We just need to get to it. Hopefully soon
- adr1an 3y ago
  Check pdftotext it's a CLI tool (maybe a library too) that makes pdf text selectable. Oh sorry, I meant to say ocrmypdf. But hey, maybe it's worth checking both.

samstave 3y ago

Ive wanted a crawler on my machine for auto-categorizing and organizing, tagging and moving ALL my files around based on all my machines - so the ability to crawl PDFs, downloads, screenshots, pictures, etc and give me a logical tree of the org of the files - and allow me to modify it by saying "add all PDF related to [subject] here and the organize by source/author etc... and then move all my screenshots, ordered by date here etc... I've wanted a "COMPUTER.", uh... I say "COMPUTER!", 'sir, you have to use the keyboard', ah a Keyboard, how quaint.... forever.

110 3y ago
That.would.be.awesome! Khoj isn't their yet, but that actually shouldn't be too far away if you give it a voice interface and terminal access. Of course, having it be stable enough to not `rm -rf /` soon after is definitely not part of the warranty
- samstave 3y ago
  Copy first, move and delete after confirmation from user on big moves. - So aside from doing something such as this - whats the size of your current usecase - is it being able to search and org a large orge of devs through files and directories/repos/whatever? What if you had a global glob of data/code/files - and as an enterprise you can just give each new emp an employee role, and based on their job and purported skills, just throw them at the monolith, yet the AI will tailor the info they get out of the glob. "User10267A - you are chartered with working on projects XYZ, based on your skillset - here are a few assessments to see which sections of the codebase best suit you." [does work] "OK .U267A, here is your workspace with all auths to the libs and such youll need to work on [PROJECT FSPEZ]"

110 3y ago

Yeah being able to search and chat with PDF files is quite useful. Khoj can index directory of PDFs for search and chat. But it does not currently work with scanned PDF files (i.e not with ones without selectable text). Being able to work with those would be awesome. We just need to get to it. Hopefully soon

adr1an 3y ago
Check pdftotext it's a CLI tool (maybe a library too) that makes pdf text selectable. Oh sorry, I meant to say ocrmypdf. But hey, maybe it's worth checking both.