4 ms·

That's too expensive, quality of llama3 answers is way below ChatGPT 4o or Clause Opus, and consumer GPUs are not competitive with specialized chips. Need the

That's too expensive, quality of llama3 answers is way below ChatGPT 4o or Clause Opus, and consumer GPUs are not competitive with specialized chips. Need the ability to submit queries anonymously, with disposable accounts. How about an AI add-on for a VPN service?

OutOfHere 2y ago
Anonymity is good, but a VPN doesn't really help for anonymity. It only prevents some MITM security. The moment you access an NSA data provider, e.g. Gmail, over the VPN, your IP address is immediately correlated in time with your chat activity, and your identity is revealed. I know you mentioned an AI-addon, but there are too many limitations there in terms of the number of models available, usage quota, and API access. Regarding llama3, it works for some applications, not for others demanding higer intelligence. Surely there will be a llama4 and a 5. They're coming fast.
- johnisgood 2y ago
  So is Llama3 the best right now for programming-related inquiries? Say, making my Elixir code adhere to OTP principles.
  - OutOfHere 2y ago
    Llama3 still is worse than GPT4 for programming, but I expect this gap to be eliminated as newer versions of Llama keep coming. https://openlm.ai/coder-evalplus/ https://openlm.ai/coder-evalplus/ says that CodeQwen1.5-7B-Chat is the best open model for coding. https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_... lists davidkim205/Rhea-72b-v0.5 as the best open model overall. https://leaderboard.tabbyml.com/ https://leaderboard.tabbyml.com/ lists DeepSeekCoder-6.7B as the best for coding. The takeaway is that Llama 3 looks a lot better than Llama 2, and I expect this trend to continue to 4 and 5, to the point where 5 could overtake GPT4.
- EVa5I7bHFq9mnYK 2y ago
  I mean anonymity not against NSA, but against OpenAI.

OutOfHere 2y ago

Anonymity is good, but a VPN doesn't really help for anonymity. It only prevents some MITM security. The moment you access an NSA data provider, e.g. Gmail, over the VPN, your IP address is immediately correlated in time with your chat activity, and your identity is revealed. I know you mentioned an AI-addon, but there are too many limitations there in terms of the number of models available, usage quota, and API access. Regarding llama3, it works for some applications, not for others demanding higer intelligence. Surely there will be a llama4 and a 5. They're coming fast.

johnisgood 2y ago
So is Llama3 the best right now for programming-related inquiries? Say, making my Elixir code adhere to OTP principles.
- OutOfHere 2y ago
  Llama3 still is worse than GPT4 for programming, but I expect this gap to be eliminated as newer versions of Llama keep coming. https://openlm.ai/coder-evalplus/ https://openlm.ai/coder-evalplus/ says that CodeQwen1.5-7B-Chat is the best open model for coding. https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_... lists davidkim205/Rhea-72b-v0.5 as the best open model overall. https://leaderboard.tabbyml.com/ https://leaderboard.tabbyml.com/ lists DeepSeekCoder-6.7B as the best for coding. The takeaway is that Llama 3 looks a lot better than Llama 2, and I expect this trend to continue to 4 and 5, to the point where 5 could overtake GPT4.
EVa5I7bHFq9mnYK 2y ago
I mean anonymity not against NSA, but against OpenAI.