3 ms·

Man, imagine If you can run it locally and let it parse all of your documents, so you can ask it questions like when does my passport expires, or what is my Wif

Man, imagine If you can run it locally and let it parse all of your documents, so you can ask it questions like when does my passport expires, or what is my Wife's ID number and so on.

arlcode 4y ago
The future will most likely be "upload it to the cloud and ask the question there". Really sad but but it seems like most people seem to not care about privacy even for the most sensitive parts of their lives. Or even worse they mistrust "the government" but place great trust in "companies which are easily pressured or raided by more than one government". It doesn't make sense at all. (Edit: I don't think a well run government in a functioning democracy is inherently evil but pretending that companies are not collaborating because they are "private entities" is foolish)
- hackernewds 4y ago
  You merely need to see the Twitter example to see how risky monopoly-level tech is in the wrong hands. Imagine they have access to all politicians DMs now, ripe for blackmail and kompromat
- amrb 4y ago
  "Do you want megacorps? Because that's how you get megacorps" -Archer Control is why I want to see more "open source" version of machine learning models be it over data or auditing the output and if I can p2p download a model I know we're in a good place. Take the internet, I could see my path being very different if we had to pay per minute like a phone plan to get information, having open access was a big bootstrap here. Finally of course there are problems with the Linux project, but would servers dictated only by M$oft/0r@cle be a positive outcome, gonna say no.
aioprisan 4y ago
All you need is to 1. convert documents to embeddings (OpenAI or some other local library for this), 2. store all embeddings in an index like (SaaS like Pinecone or FAISS locally), 3. run query against embeddings. Just a document search is likely good enough, but if not you can use a completion algorithm in a simple LLM of the docs to generate answers.
amrb 4y ago
I've already built this and you can use this as a guide, being PII we just need to swap openai for a model on huggingface.co, this let's you do the question answering part run locally. https://dagster.io/blog/chatgpt-langchain https://dagster.io/blog/chatgpt-langchain
- jacooper 4y ago
  But it still requires uploading sensitive data to the cloud. I want it completely local, I ain't uploading things like my passport and birth certificate to OpenAI.
  - amrb 4y ago
    Bro you see the part where I talk about swapping out openai. You can download ML models from the site hugging face.co, if you read this link you should be well on your way to building something today https://github.com/huggingface/transformers#quick-tour https://github.com/huggingface/transformers#quick-tour
    - jacooper 4y ago
      Oh, I understood it as replacing it in the future, thanks!

Man, imagine If you can run it locally and let it parse all of your documents, so you can ask it questions like when does my passport expires, or what is my Wife's ID number and so on.

arlcode 4y ago

The future will most likely be "upload it to the cloud and ask the question there". Really sad but but it seems like most people seem to not care about privacy even for the most sensitive parts of their lives. Or even worse they mistrust "the government" but place great trust in "companies which are easily pressured or raided by more than one government". It doesn't make sense at all. (Edit: I don't think a well run government in a functioning democracy is inherently evil but pretending that companies are not collaborating because they are "private entities" is foolish)

hackernewds 4y ago
You merely need to see the Twitter example to see how risky monopoly-level tech is in the wrong hands. Imagine they have access to all politicians DMs now, ripe for blackmail and kompromat
amrb 4y ago
"Do you want megacorps? Because that's how you get megacorps" -Archer Control is why I want to see more "open source" version of machine learning models be it over data or auditing the output and if I can p2p download a model I know we're in a good place. Take the internet, I could see my path being very different if we had to pay per minute like a phone plan to get information, having open access was a big bootstrap here. Finally of course there are problems with the Linux project, but would servers dictated only by M$oft/0r@cle be a positive outcome, gonna say no.

aioprisan 4y ago

All you need is to 1. convert documents to embeddings (OpenAI or some other local library for this), 2. store all embeddings in an index like (SaaS like Pinecone or FAISS locally), 3. run query against embeddings. Just a document search is likely good enough, but if not you can use a completion algorithm in a simple LLM of the docs to generate answers.

amrb 4y ago

I've already built this and you can use this as a guide, being PII we just need to swap openai for a model on huggingface.co, this let's you do the question answering part run locally. https://dagster.io/blog/chatgpt-langchain https://dagster.io/blog/chatgpt-langchain

jacooper 4y ago
But it still requires uploading sensitive data to the cloud. I want it completely local, I ain't uploading things like my passport and birth certificate to OpenAI.
- amrb 4y ago
  Bro you see the part where I talk about swapping out openai. You can download ML models from the site hugging face.co, if you read this link you should be well on your way to building something today https://github.com/huggingface/transformers#quick-tour https://github.com/huggingface/transformers#quick-tour
  - jacooper 4y ago
    Oh, I understood it as replacing it in the future, thanks!