3 ms·

Keep your data private and don't leak it to third parties. Use something like privateGPT (32k stars). Not your keys, not your data. "Interact privately with yo

by hi 3y ago

Keep your data private and don't leak it to third parties. Use something like privateGPT (32k stars). Not your keys, not your data. "Interact privately with your documents using the power of GPT, 100% privately, no data leaks"[0] [0] https://github.com/imartinez/privateGPT https://github.com/imartinez/privateGPT

leach 3y ago
How does this run on an Intel Mac? I have a 6 core i9. Haven't been able to get an M series yet so Im wondering if it would be more worth it to run it in a cloud computing environment with a GPU.
- hi 3y ago
  >Mac Running Intel When running a Mac with Intel hardware (not M1), you may run into clang: error: the clang compiler does not support '-march=native' during pip install. If so set your archflags during pip install. eg: ARCHFLAGS="-arch x86_64" pip3 install -r requirements.txt https://github.com/imartinez/privateGPT#mac-running-intel https://github.com/imartinez/privateGPT#mac-running-intel
  - leach 3y ago
    I’m curious about the response times though, i imagine they will be quite slow on an intel Mac
3rdrodeo 3y ago
[flagged]
- EGreg 3y ago
  Oh, not this again. No, it's not a net negative in ALL forms. And if you really were concerned about downsides, AI has a ton more potential downsides than Web3 ever did, including human extinction, as many of its top proponents have come out and publicly said. Nothing even remotely close to that is the case for Web3 at all: https://www.nytimes.com/2023/05/30/technology/ai-threat-warning.html https://www.nytimes.com/2023/05/30/technology/ai-threat-warn... https://www.theguardian.com/technology/2023/may/10/ai-poses-existential-threat-and-risk-to-health-of-millions-experts-warn https://www.theguardian.com/technology/2023/may/10/ai-poses-... https://www.theguardian.com/technology/2023/may/30/risk-of-extinction-by-ai-should-be-global-priority-say-tech-experts https://www.theguardian.com/technology/2023/may/30/risk-of-e... https://www.theverge.com/2023/5/30/23742005/ai-risk-warning-22-word-statement-google-deepmind-openai https://www.theverge.com/2023/5/30/23742005/ai-risk-warning-...
  - 3rdrodeo 3y ago
    " many of its top proponents have come out and publicly said." You don't have to uncritically accept that, it's far more likely that they're just self aggrandizing in a "wow I'm so smart my inventions can destroy the world, better give me more money and write articles about me to make sure that doesn't happen".
    - EGreg 3y ago
      I see, so when it comes to the top experts in AI screaming “we made a mistake, please be careful” we should use nuance and actually conclude the opposite — that we should press ahead and they’re wrong. But with Web3, we should just listen to a bunch of random no-name haters say “there are NO GOOD APPLICATIONS, trust us, period, stop talking about it”, use no nuance or critical thinking of our own, and simply stop building on Web3. Do you happen to see the extreme double standard here you’re employing, while trying to get people to see things your way?
      - 3rdrodeo 3y ago
        The crypto group had a lot of time and even more money to make a compelling product that took off and so far they've failed. We've watched fraud after fraud as they've shown themselves to just be ignorant and arrogant ideologues who don't understand how the "modern" finance system came to be, what the average user wants out of financial or social products, or just outright scammers. We can keep sinking money into a bottomless pit or we can move on and learn from their mistakes. I didn't say to dismiss any concerns out of hand, but the whole idea of "x-risk" or "human extinction" from ai is laughable and isn't taken seriously by most people. Again if you think critically about the whole idea of "human extinction" from any of the technology being talked about you should see it as nonsense.
        junofan 3y ago
        I dunno, on the crypto side stablecoins are pretty compelling for hassle-free cross-border transfers—there’s $125bn in circulation, which to me means it’s taken off. On the AI side, I mean for example it’s not laughable to think anybody on the planet could just feed a bunch of synthetic biology papers to a model and start designing bioweapons. It’s not hard to get your hands on secondhand lab equipment…
unshavedyak 3y ago
Is this robust enough to feed all your emails and chat logs into it and have convos with it? Will it be able to extract context to figure out questions to recent logs, etc?
- qingcharles 3y ago
  In theory, yes. I've not got it to work yet though, it ends up hallucinating answers to all the questions about documents I feed it.
SecurityNoob 3y ago
100% private? Hmm. I think with the amount of paranoia that the folks in power have about local LLM’s, I wouldn’t be in the slightest surprised that the Windows telemetry will be reporting back what people are doing with them. And anyone who thinks otherwise is in my view just absolutely naive beyond hope.
- astrange 3y ago
  Don't have so much pride in yourself. Nobody actually cares what you're doing. Well, China might. And this is probably illegal in several countries besides that since queries might have medical information or other protected data.
Templa 3y ago
Having something that could be used with confluence would be so nice. Having documentation written and just asking questions about it.
woeirua 3y ago
It’s significantly worse than OpenAIs offerings, and I’m tired of people pretending as though these models are totally interchangeable yet. They are not.

by hi 3y ago

leach 3y ago

How does this run on an Intel Mac? I have a 6 core i9. Haven't been able to get an M series yet so Im wondering if it would be more worth it to run it in a cloud computing environment with a GPU.

hi 3y ago
>Mac Running Intel When running a Mac with Intel hardware (not M1), you may run into clang: error: the clang compiler does not support '-march=native' during pip install. If so set your archflags during pip install. eg: ARCHFLAGS="-arch x86_64" pip3 install -r requirements.txt https://github.com/imartinez/privateGPT#mac-running-intel https://github.com/imartinez/privateGPT#mac-running-intel
- leach 3y ago
  I’m curious about the response times though, i imagine they will be quite slow on an intel Mac

3rdrodeo 3y ago

[flagged]

EGreg 3y ago
Oh, not this again. No, it's not a net negative in ALL forms. And if you really were concerned about downsides, AI has a ton more potential downsides than Web3 ever did, including human extinction, as many of its top proponents have come out and publicly said. Nothing even remotely close to that is the case for Web3 at all: https://www.nytimes.com/2023/05/30/technology/ai-threat-warning.html https://www.nytimes.com/2023/05/30/technology/ai-threat-warn... https://www.theguardian.com/technology/2023/may/10/ai-poses-existential-threat-and-risk-to-health-of-millions-experts-warn https://www.theguardian.com/technology/2023/may/10/ai-poses-... https://www.theguardian.com/technology/2023/may/30/risk-of-extinction-by-ai-should-be-global-priority-say-tech-experts https://www.theguardian.com/technology/2023/may/30/risk-of-e... https://www.theverge.com/2023/5/30/23742005/ai-risk-warning-22-word-statement-google-deepmind-openai https://www.theverge.com/2023/5/30/23742005/ai-risk-warning-...
- 3rdrodeo 3y ago
  " many of its top proponents have come out and publicly said." You don't have to uncritically accept that, it's far more likely that they're just self aggrandizing in a "wow I'm so smart my inventions can destroy the world, better give me more money and write articles about me to make sure that doesn't happen".
  - EGreg 3y ago
    I see, so when it comes to the top experts in AI screaming “we made a mistake, please be careful” we should use nuance and actually conclude the opposite — that we should press ahead and they’re wrong. But with Web3, we should just listen to a bunch of random no-name haters say “there are NO GOOD APPLICATIONS, trust us, period, stop talking about it”, use no nuance or critical thinking of our own, and simply stop building on Web3. Do you happen to see the extreme double standard here you’re employing, while trying to get people to see things your way?
    - 3rdrodeo 3y ago
      The crypto group had a lot of time and even more money to make a compelling product that took off and so far they've failed. We've watched fraud after fraud as they've shown themselves to just be ignorant and arrogant ideologues who don't understand how the "modern" finance system came to be, what the average user wants out of financial or social products, or just outright scammers. We can keep sinking money into a bottomless pit or we can move on and learn from their mistakes. I didn't say to dismiss any concerns out of hand, but the whole idea of "x-risk" or "human extinction" from ai is laughable and isn't taken seriously by most people. Again if you think critically about the whole idea of "human extinction" from any of the technology being talked about you should see it as nonsense.
      - junofan 3y ago
        I dunno, on the crypto side stablecoins are pretty compelling for hassle-free cross-border transfers—there’s $125bn in circulation, which to me means it’s taken off. On the AI side, I mean for example it’s not laughable to think anybody on the planet could just feed a bunch of synthetic biology papers to a model and start designing bioweapons. It’s not hard to get your hands on secondhand lab equipment…

unshavedyak 3y ago

Is this robust enough to feed all your emails and chat logs into it and have convos with it? Will it be able to extract context to figure out questions to recent logs, etc?

qingcharles 3y ago
In theory, yes. I've not got it to work yet though, it ends up hallucinating answers to all the questions about documents I feed it.

SecurityNoob 3y ago

100% private? Hmm. I think with the amount of paranoia that the folks in power have about local LLM’s, I wouldn’t be in the slightest surprised that the Windows telemetry will be reporting back what people are doing with them. And anyone who thinks otherwise is in my view just absolutely naive beyond hope.

astrange 3y ago
Don't have so much pride in yourself. Nobody actually cares what you're doing. Well, China might. And this is probably illegal in several countries besides that since queries might have medical information or other protected data.

Templa 3y ago

Having something that could be used with confluence would be so nice. Having documentation written and just asking questions about it.

woeirua 3y ago

It’s significantly worse than OpenAIs offerings, and I’m tired of people pretending as though these models are totally interchangeable yet. They are not.