6 ms·

Regulating open-source AI will only help giants like Google and OpenAI, stifling innovation. It creates barriers only they can afford, limiting competition and

Regulating open-source AI will only help giants like Google and OpenAI, stifling innovation. It creates barriers only they can afford, limiting competition and diversity. Open-source fosters transparency and rapid progress. We do not need government regulations, or we'll end up like Europe with China leading.

talldayo 2y ago
> It creates barriers only they can afford, limiting competition and diversity. I would argue this is inherent to the training and compute cost of all large language models.
- binary132 2y ago
  Quantized Llama 3.1 can run on an Amazon GPU instance for $32/hr now
  - talldayo 2y ago
    That's still prohibitively expensive for anyone that doesn't intend to make their money back. For training it's even more outrageous.
    - binary132 2y ago
      $64K isn’t even one developer’s salary.
      - talldayo 2y ago
        And how many people can afford to pay a developer's salary after utilities and mortgage?
        binary132 2y ago
        I think you’re missing my point: hiring someone is not that costly relative to training a billion-dollar model from scratch, so the barrier is definitely getting lower. An individual proprietor with a moderately successful business (or just business loans, let’s face it) can hire at least a couple of employees.
- anon373839 2y ago
  Small models can be fine-tuned to perform specific tasks with similar accuracy to large models. Small models can be served for internal use with a VERY modest hardware outlay. There are also providers now that will let you upload low-rank adapters you have trained in top of open foundational models, so that you can use their efficient serverless infrastructure with your fine-tuned models. This requires even less capital. None of this would exist had OpenAI’s vision of centralized, locked-down API access become the reality.
b112 2y ago
Comrade, open source is the wellspring of communism! (As Microsoft explained years ago)
splwjs 2y ago
that doesn't explain why the white house doesn't see the need to regulate it - if anything it gives them more reason to.
GauntletWizard 2y ago
The problem is that the OSI's definition of "Open Source" AI doesn't match their definition of "Open Source" software, or really anything.
- anon373839 2y ago
  I think all of the hand-wringing about open weights vs. open source, and which term to use, is an ideological point people are getting stuck on. I don’t think it’s a real problem.

talldayo 2y ago

> It creates barriers only they can afford, limiting competition and diversity. I would argue this is inherent to the training and compute cost of all large language models.

binary132 2y ago
Quantized Llama 3.1 can run on an Amazon GPU instance for $32/hr now
- talldayo 2y ago
  That's still prohibitively expensive for anyone that doesn't intend to make their money back. For training it's even more outrageous.
  - binary132 2y ago
    $64K isn’t even one developer’s salary.
    - talldayo 2y ago
      And how many people can afford to pay a developer's salary after utilities and mortgage?
      - binary132 2y ago
        I think you’re missing my point: hiring someone is not that costly relative to training a billion-dollar model from scratch, so the barrier is definitely getting lower. An individual proprietor with a moderately successful business (or just business loans, let’s face it) can hire at least a couple of employees.
anon373839 2y ago
Small models can be fine-tuned to perform specific tasks with similar accuracy to large models. Small models can be served for internal use with a VERY modest hardware outlay. There are also providers now that will let you upload low-rank adapters you have trained in top of open foundational models, so that you can use their efficient serverless infrastructure with your fine-tuned models. This requires even less capital. None of this would exist had OpenAI’s vision of centralized, locked-down API access become the reality.

b112 2y ago

Comrade, open source is the wellspring of communism! (As Microsoft explained years ago)

splwjs 2y ago

that doesn't explain why the white house doesn't see the need to regulate it - if anything it gives them more reason to.

GauntletWizard 2y ago

The problem is that the OSI's definition of "Open Source" AI doesn't match their definition of "Open Source" software, or really anything.

anon373839 2y ago
I think all of the hand-wringing about open weights vs. open source, and which term to use, is an ideological point people are getting stuck on. I don’t think it’s a real problem.