4 ms·

What choice do we have?

OutOfHere 2y ago
You have a choice, and it is simple. Earn money. Buy GPUs. Download llama3 or comparable open models. Run them. After you do, to the maximum extent possible, stop using the OpenAI LLMs. Stop willingly feeding the surveillance industrial complex.
- janalsncm 2y ago
  > Buy GPUs I don’t think this is practical advice for the vast majority of people
  - OutOfHere 2y ago
    It is for every reader on this site, coming as naturally as buying a computer.
    - johnisgood 2y ago
      GPU_s_, ideally high-end ones, though.
      - OutOfHere 2y ago
        High-end ones are needed more for large model training and unoptimized tuning, less so for inference alone. Most users would need just inference, at least in the beginning.
- deleted 2y ago
  [deleted]
- EVa5I7bHFq9mnYK 2y ago
  That's too expensive, quality of llama3 answers is way below ChatGPT 4o or Clause Opus, and consumer GPUs are not competitive with specialized chips. Need the ability to submit queries anonymously, with disposable accounts. How about an AI add-on for a VPN service?
  - OutOfHere 2y ago
    Anonymity is good, but a VPN doesn't really help for anonymity. It only prevents some MITM security. The moment you access an NSA data provider, e.g. Gmail, over the VPN, your IP address is immediately correlated in time with your chat activity, and your identity is revealed. I know you mentioned an AI-addon, but there are too many limitations there in terms of the number of models available, usage quota, and API access. Regarding llama3, it works for some applications, not for others demanding higer intelligence. Surely there will be a llama4 and a 5. They're coming fast.
    - johnisgood 2y ago
      So is Llama3 the best right now for programming-related inquiries? Say, making my Elixir code adhere to OTP principles.
      - OutOfHere 2y ago
        Llama3 still is worse than GPT4 for programming, but I expect this gap to be eliminated as newer versions of Llama keep coming. https://openlm.ai/coder-evalplus/ https://openlm.ai/coder-evalplus/ says that CodeQwen1.5-7B-Chat is the best open model for coding. https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_... lists davidkim205/Rhea-72b-v0.5 as the best open model overall. https://leaderboard.tabbyml.com/ https://leaderboard.tabbyml.com/ lists DeepSeekCoder-6.7B as the best for coding. The takeaway is that Llama 3 looks a lot better than Llama 2, and I expect this trend to continue to 4 and 5, to the point where 5 could overtake GPT4.
    - EVa5I7bHFq9mnYK 2y ago
      I mean anonymity not against NSA, but against OpenAI.
worksonmine 2y ago
How did you manage to live before GPT? Was it that bad? I still haven't used it and I'm doing fine.
- hammyhavoc 2y ago
  But it's tHe FuTuRe bro
- nashashmi 2y ago
  I’m not worried about losing chatgpt. Im worried that they will leverage gpt on nsa data. And open ai will be the agent.
lancesells 2y ago
Unless your job maybe mandates it why do you have to participate?
- rchaud 2y ago
  You cannot opt out of a panopticon.
r721 2y ago
>DuckDuckGo AI Chat: anonymous access to popular AI chatbots https://spreadprivacy.com/ai-chat/ https://spreadprivacy.com/ai-chat/
afpx 2y ago
Wait for yandex.ai or ccp.ai I guess? I hear mossad.ai is going to be pretty killer.
deleted 2y ago
[deleted]

You have a choice, and it is simple. Earn money. Buy GPUs. Download llama3 or comparable open models. Run them. After you do, to the maximum extent possible, stop using the OpenAI LLMs. Stop willingly feeding the surveillance industrial complex.

janalsncm 2y ago
> Buy GPUs I don’t think this is practical advice for the vast majority of people
- OutOfHere 2y ago
  It is for every reader on this site, coming as naturally as buying a computer.
  - johnisgood 2y ago
    GPU_s_, ideally high-end ones, though.
    - OutOfHere 2y ago
      High-end ones are needed more for large model training and unoptimized tuning, less so for inference alone. Most users would need just inference, at least in the beginning.
deleted 2y ago
[deleted]
EVa5I7bHFq9mnYK 2y ago
That's too expensive, quality of llama3 answers is way below ChatGPT 4o or Clause Opus, and consumer GPUs are not competitive with specialized chips. Need the ability to submit queries anonymously, with disposable accounts. How about an AI add-on for a VPN service?
- OutOfHere 2y ago
  Anonymity is good, but a VPN doesn't really help for anonymity. It only prevents some MITM security. The moment you access an NSA data provider, e.g. Gmail, over the VPN, your IP address is immediately correlated in time with your chat activity, and your identity is revealed. I know you mentioned an AI-addon, but there are too many limitations there in terms of the number of models available, usage quota, and API access. Regarding llama3, it works for some applications, not for others demanding higer intelligence. Surely there will be a llama4 and a 5. They're coming fast.
  - johnisgood 2y ago
    So is Llama3 the best right now for programming-related inquiries? Say, making my Elixir code adhere to OTP principles.
    - OutOfHere 2y ago
      Llama3 still is worse than GPT4 for programming, but I expect this gap to be eliminated as newer versions of Llama keep coming. https://openlm.ai/coder-evalplus/ https://openlm.ai/coder-evalplus/ says that CodeQwen1.5-7B-Chat is the best open model for coding. https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_... lists davidkim205/Rhea-72b-v0.5 as the best open model overall. https://leaderboard.tabbyml.com/ https://leaderboard.tabbyml.com/ lists DeepSeekCoder-6.7B as the best for coding. The takeaway is that Llama 3 looks a lot better than Llama 2, and I expect this trend to continue to 4 and 5, to the point where 5 could overtake GPT4.
  - EVa5I7bHFq9mnYK 2y ago
    I mean anonymity not against NSA, but against OpenAI.

worksonmine 2y ago

How did you manage to live before GPT? Was it that bad? I still haven't used it and I'm doing fine.

hammyhavoc 2y ago
But it's tHe FuTuRe bro
nashashmi 2y ago
I’m not worried about losing chatgpt. Im worried that they will leverage gpt on nsa data. And open ai will be the agent.

lancesells 2y ago

Unless your job maybe mandates it why do you have to participate?

rchaud 2y ago
You cannot opt out of a panopticon.

r721 2y ago

>DuckDuckGo AI Chat: anonymous access to popular AI chatbots https://spreadprivacy.com/ai-chat/ https://spreadprivacy.com/ai-chat/

afpx 2y ago

Wait for yandex.ai or ccp.ai I guess? I hear mossad.ai is going to be pretty killer.

deleted 2y ago

[deleted]