5 ms·

I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.

by girishso 3y ago

spiderfarmer 3y ago
Next version of MacOS will probably have that.
- tethys 3y ago
  As long as you use Safari for browsing, Notes for note taking, iCloud for mail …
Fnoord 3y ago
I use paperless-ngx for that.
xyc 3y ago
Yes it would be the next big focus on this. Personal data connectivity is what I see where local AI would excel - despite model power differences.
- chaostheory 3y ago
  Yeah, we’re getting closer to “Her”
- _boffin_ 3y ago
  Good to know there's a market for that. Currently building out something. Integrating from numerous sources, processing and then utilizing those. nice.
- ssnri 3y ago
  I would even let it have longer processing times for queries to apply against each document in my system, allow it to specialize/train itself on a daily basis… Use all the resources you want if you save me brainpower
  - xyc 3y ago
    Agree, there's a non real-time angle to this.
    - samstave 3y ago
      "give me a summary of the news around this topic each morning for my daily read" Help me plan for upcoming meetings whereby if I put something in calendar, it will build a little dossier for the event, and include relevant info based on the type of event or meeting, mostly scheduling reminders or prompting you with updates or changes to the event etc.
      - ssnri 3y ago
        “filter out baby pictures from my family text threads”
- Satam 3y ago
  I have doubts about that. Most personal data actually lives in the cloud these days. If you need your Gmail emails, you'll need to use their API which is guarded behind $50k certification fee or so. I think there is a simpler version for personal use, but you still need to get the API key. Who's going to teach their mom about API keys? So I think for a lot of these data sources you'll end up with enterprise AIs integrating them first for a seamless experience.
  - samstave 3y ago
    What? I manage both gmail and protonmail via thunderbird - where I have better search and sort using IMAP.
  - xyc 3y ago
    I think this is a good take. While there's big enough niche for personal data locally, I'd love if there's a way to solve for email/cloud data requiring API keys.
    - noduerme 3y ago
      Ideally, though, a sufficiently smart LLM shouldn't need API access. It could navigate to your social media login page, supply your credentials, and scrape what it sees. Better yet, it should just reverse-engineer the API ;)
  - coev 3y ago
    Why wouldn't you be able to use IMAP over the gmail api? IMAP returns the text and headers of all your emails, which is what you'd want the LLM to ingest anyway.
  - noduerme 3y ago
    Seconding a sibling question: What $50k API fee? To access your gmail? I've been using gmail since 2008 or so without ever touching their web/app interface or getting an API key. You just use it as an IMAP server.
    - 3y ago
chb 3y ago
This. There was a post in HN last week, iirc, referring to just such a solution called ZenFetch (?). I would have adopted it in a heartbeat but they don’t currently have a means of exporting the source data you feed to it (should you elect it as your sole means of bookmarking, etc)
- gabev 3y ago
  Hey there, This is Gabe, the founder of Zenfetch. Thanks for sharing. We're putting together an export option where you can download all your saved data as a CSV and should get that out by end of week.
  - samstave 3y ago
    Seems like this would be a good tool to build lessons on - if you could share a "class" and export a link for others to then copy the class, and expand on the lesson/class/topic into their own AI. but as a separate "class" and not fully integrated to my regular history blob? I want the ability to search all my downloaded files and organize them based on context within. Have it create a category table, and allow me to "put all pics of my cat in this folder, and upload them to a gallery on imgur."
    - gabev 3y ago
      We're working on the ability to share folders of your knowledge so that others can search/chat across them. We've been thinking of this as a "subscription" to the creator's folder. Similar to how you might subscribe to a Spotify playlist
      - samstave 3y ago
        Or aN RSS?
      - toomuchtodo 3y ago
        Consider using tar files for this. Lots of tooling (versioning, hashing, storage) around this already, and docker layers comes to mind.
jlund-molfese 3y ago
Sounds like https://www.rewind.ai/ https://www.rewind.ai/ ?
scottrblock 3y ago
plus one, I would love to configure a folder of markdown/txt(+ eventually images and pdfs) files that this can have access to. Ideally it could RAG over them in a sensible way. Would love to help support this!
- xyc 3y ago
  Thank you! I'd love to learn more about your use cases. Would you mind sending an email to feedback@recurse.chat or DM me on https://x.com/chxy https://x.com/chxy to get the conversation started?
toomuchtodo 3y ago
https://news.ycombinator.com/item?id=38787892 https://news.ycombinator.com/item?id=38787892 ("Show HN: Rem: Remember Everything (open source)") ? https://github.com/jasonjmcghee/rem https://github.com/jasonjmcghee/rem
vunderba 3y ago
There are already several RAG chat open source solutions available. Two that immediately come to mind are: Danswer https://github.com/danswer-ai/danswer https://github.com/danswer-ai/danswer Khoj https://github.com/khoj-ai/khoj https://github.com/khoj-ai/khoj
- wkat4242 3y ago
  Stupid question but what does RAG stand for?
  - onehp 3y ago
    Retrieval augmented generation. In short you use an LLM to classify your documents (or chunks from them) up front. Then when you want to ask the LLM a question you pull the most relevant ones back to feed it as additional context.
    - wkat4242 3y ago
      Ahh ok I see. It's basically what MS CoPilot 365 does too, with its "Grounding" step.
      - brianjking 3y ago
        Yes.
    - danielovichdk 3y ago
      I dont get it. To my understanding it takes huge amounts of data to build any any form of RAG. Simply because it enlarges the statistical model you later prompt. If the model is not big enough how would you expect it to answer you in a non qualifying matter ? It simply can't. So I don't really buy it and I have yet to see it work better than any rdbms search index. Tell me I am wrong, I would like to see a local model based on my own docs being able to answer me quality answers based on quality prompts.
      - 3y ago

I will totally pay for something like this if it answers from my local documents, bookmarks, browser history etc.

spiderfarmer 3y ago

Next version of MacOS will probably have that.

tethys 3y ago
As long as you use Safari for browsing, Notes for note taking, iCloud for mail …

Fnoord 3y ago

I use paperless-ngx for that.

xyc 3y ago

Yes it would be the next big focus on this. Personal data connectivity is what I see where local AI would excel - despite model power differences.

chaostheory 3y ago
Yeah, we’re getting closer to “Her”
_boffin_ 3y ago
Good to know there's a market for that. Currently building out something. Integrating from numerous sources, processing and then utilizing those. nice.
ssnri 3y ago
I would even let it have longer processing times for queries to apply against each document in my system, allow it to specialize/train itself on a daily basis… Use all the resources you want if you save me brainpower
- xyc 3y ago
  Agree, there's a non real-time angle to this.
  - samstave 3y ago
    "give me a summary of the news around this topic each morning for my daily read" Help me plan for upcoming meetings whereby if I put something in calendar, it will build a little dossier for the event, and include relevant info based on the type of event or meeting, mostly scheduling reminders or prompting you with updates or changes to the event etc.
    - ssnri 3y ago
      “filter out baby pictures from my family text threads”
Satam 3y ago
I have doubts about that. Most personal data actually lives in the cloud these days. If you need your Gmail emails, you'll need to use their API which is guarded behind $50k certification fee or so. I think there is a simpler version for personal use, but you still need to get the API key. Who's going to teach their mom about API keys? So I think for a lot of these data sources you'll end up with enterprise AIs integrating them first for a seamless experience.
- samstave 3y ago
  What? I manage both gmail and protonmail via thunderbird - where I have better search and sort using IMAP.
- xyc 3y ago
  I think this is a good take. While there's big enough niche for personal data locally, I'd love if there's a way to solve for email/cloud data requiring API keys.
  - noduerme 3y ago
    Ideally, though, a sufficiently smart LLM shouldn't need API access. It could navigate to your social media login page, supply your credentials, and scrape what it sees. Better yet, it should just reverse-engineer the API ;)
- coev 3y ago
  Why wouldn't you be able to use IMAP over the gmail api? IMAP returns the text and headers of all your emails, which is what you'd want the LLM to ingest anyway.
- noduerme 3y ago
  Seconding a sibling question: What $50k API fee? To access your gmail? I've been using gmail since 2008 or so without ever touching their web/app interface or getting an API key. You just use it as an IMAP server.
  - 3y ago

chb 3y ago

This. There was a post in HN last week, iirc, referring to just such a solution called ZenFetch (?). I would have adopted it in a heartbeat but they don’t currently have a means of exporting the source data you feed to it (should you elect it as your sole means of bookmarking, etc)

gabev 3y ago
Hey there, This is Gabe, the founder of Zenfetch. Thanks for sharing. We're putting together an export option where you can download all your saved data as a CSV and should get that out by end of week.
- samstave 3y ago
  Seems like this would be a good tool to build lessons on - if you could share a "class" and export a link for others to then copy the class, and expand on the lesson/class/topic into their own AI. but as a separate "class" and not fully integrated to my regular history blob? I want the ability to search all my downloaded files and organize them based on context within. Have it create a category table, and allow me to "put all pics of my cat in this folder, and upload them to a gallery on imgur."
  - gabev 3y ago
    We're working on the ability to share folders of your knowledge so that others can search/chat across them. We've been thinking of this as a "subscription" to the creator's folder. Similar to how you might subscribe to a Spotify playlist
    - samstave 3y ago
      Or aN RSS?
    - toomuchtodo 3y ago
      Consider using tar files for this. Lots of tooling (versioning, hashing, storage) around this already, and docker layers comes to mind.

jlund-molfese 3y ago

Sounds like https://www.rewind.ai/ https://www.rewind.ai/ ?

scottrblock 3y ago

plus one, I would love to configure a folder of markdown/txt(+ eventually images and pdfs) files that this can have access to. Ideally it could RAG over them in a sensible way. Would love to help support this!

xyc 3y ago
Thank you! I'd love to learn more about your use cases. Would you mind sending an email to feedback@recurse.chat or DM me on https://x.com/chxy https://x.com/chxy to get the conversation started?

toomuchtodo 3y ago

https://news.ycombinator.com/item?id=38787892 https://news.ycombinator.com/item?id=38787892 ("Show HN: Rem: Remember Everything (open source)") ? https://github.com/jasonjmcghee/rem https://github.com/jasonjmcghee/rem

vunderba 3y ago

There are already several RAG chat open source solutions available. Two that immediately come to mind are: Danswer https://github.com/danswer-ai/danswer https://github.com/danswer-ai/danswer Khoj https://github.com/khoj-ai/khoj https://github.com/khoj-ai/khoj

wkat4242 3y ago
Stupid question but what does RAG stand for?
- onehp 3y ago
  Retrieval augmented generation. In short you use an LLM to classify your documents (or chunks from them) up front. Then when you want to ask the LLM a question you pull the most relevant ones back to feed it as additional context.
  - wkat4242 3y ago
    Ahh ok I see. It's basically what MS CoPilot 365 does too, with its "Grounding" step.
    - brianjking 3y ago
      Yes.
  - danielovichdk 3y ago
    I dont get it. To my understanding it takes huge amounts of data to build any any form of RAG. Simply because it enlarges the statistical model you later prompt. If the model is not big enough how would you expect it to answer you in a non qualifying matter ? It simply can't. So I don't really buy it and I have yet to see it work better than any rdbms search index. Tell me I am wrong, I would like to see a local model based on my own docs being able to answer me quality answers based on quality prompts.
    - 3y ago