3 ms·

Quantized Llama 3.1 can run on an Amazon GPU instance for $32/hr now

• talldayo 2y ago
  That's still prohibitively expensive for anyone that doesn't intend to make their money back. For training it's even more outrageous.
  • binary132 2y ago
    $64K isn’t even one developer’s salary.
    • talldayo 2y ago
      And how many people can afford to pay a developer's salary after utilities and mortgage?
      • binary132 2y ago
        I think you’re missing my point: hiring someone is not that costly relative to training a billion-dollar model from scratch, so the barrier is definitely getting lower. An individual proprietor with a moderately successful business (or just business loans, let’s face it) can hire at least a couple of employees.