3 ms·

People are literally doing this for free. You said that there is no individuals, and no non-profits, that can do this. Which is laughable. They're doing it righ

People are literally doing this for free. You said that there is no individuals, and no non-profits, that can do this. Which is laughable. They're doing it right now: https://arxiv.org/abs/2305.11206 https://arxiv.org/abs/2305.11206 It may even be the case that all of that RLHF training that OpenAI does simply lessens the quality of generations, as suggested by one of their own papers and the paper above.

throwaway290 3y ago
65 billion parameters, and what hardware does this require to run fast enough to be usable?)
- srslack 3y ago
  https://lawrencecchen.com/llama-65b-m1-max https://lawrencecchen.com/llama-65b-m1-max Quantized, LLaMa can run on an Pixel 6: https://twitter.com/thiteanish/status/1635678053853536256 https://twitter.com/thiteanish/status/1635678053853536256 https://simonwillison.net/2023/Mar/13/alpaca/ https://simonwillison.net/2023/Mar/13/alpaca/
  - throwaway290 3y ago
    stop wasting time. Yes you can run this on any hardware. The matter is it is either too slow, requires outrageous hardware, or obviously bad (no tool required to see that it is generated).
    - srslack 3y ago
      >requires outrageous hardware Who is going to pay $20/mo other than professionals? You'd assume professionals have professional hardware. A mid-range GPU or a video editing laptop is not exactly breaking the bank. >no tool required to see that it is generated But again, that also applies to commercial generative images. They're easily discernible, if you just look. Midjourney is stable diffusion with a bunch of LoRA stacked on top. And it can't shed the "midjourney look" because of that. That's not in dispute by anyone.
      - deleted 3y ago
        [deleted]
      - throwaway290 3y ago
        > They're easily discernible, if you just look. 100%, although dall-e is getting better with hands specifically. Anyway, Microsoft can keep throwing compute on it until a point where it becomes impossible to distinguish fakes by sight and a mechanism like suggested will make sense. But with homegrown ones I don't see it happening soon. Only those who spend a lot of money on top of the line GPUs and keep desktop PCs may get to that point. Those GPUs will jump in price like they did at crypto mining peak or become impossible to buy if Microsoft gets the government to require "AI license" for them. > Who is going to pay $20/mo other than professionals Apple Music costs $10 and people easily spend ten times that on Patreon...

throwaway290 3y ago

65 billion parameters, and what hardware does this require to run fast enough to be usable?)

srslack 3y ago
https://lawrencecchen.com/llama-65b-m1-max https://lawrencecchen.com/llama-65b-m1-max Quantized, LLaMa can run on an Pixel 6: https://twitter.com/thiteanish/status/1635678053853536256 https://twitter.com/thiteanish/status/1635678053853536256 https://simonwillison.net/2023/Mar/13/alpaca/ https://simonwillison.net/2023/Mar/13/alpaca/
- throwaway290 3y ago
  stop wasting time. Yes you can run this on any hardware. The matter is it is either too slow, requires outrageous hardware, or obviously bad (no tool required to see that it is generated).
  - srslack 3y ago
    >requires outrageous hardware Who is going to pay $20/mo other than professionals? You'd assume professionals have professional hardware. A mid-range GPU or a video editing laptop is not exactly breaking the bank. >no tool required to see that it is generated But again, that also applies to commercial generative images. They're easily discernible, if you just look. Midjourney is stable diffusion with a bunch of LoRA stacked on top. And it can't shed the "midjourney look" because of that. That's not in dispute by anyone.
    - deleted 3y ago
      [deleted]
    - throwaway290 3y ago
      > They're easily discernible, if you just look. 100%, although dall-e is getting better with hands specifically. Anyway, Microsoft can keep throwing compute on it until a point where it becomes impossible to distinguish fakes by sight and a mechanism like suggested will make sense. But with homegrown ones I don't see it happening soon. Only those who spend a lot of money on top of the line GPUs and keep desktop PCs may get to that point. Those GPUs will jump in price like they did at crypto mining peak or become impossible to buy if Microsoft gets the government to require "AI license" for them. > Who is going to pay $20/mo other than professionals Apple Music costs $10 and people easily spend ten times that on Patreon...