3 ms·
Large language models take months to train on thousands of GPUs (LLaMA trained for around 5 months on 2048 A100-80GB, consuming around 2,638 MWh), it's nowhere
by a2128 3y ago
Large language models take months to train on thousands of GPUs (LLaMA trained for around 5 months on 2048 A100-80GB, consuming around 2,638 MWh), it's nowhere near viable to re-train them from scratch to remove some training data
- blibble 3y agothat's fine if their business model isn't compatible with the law then they can wind up the company and return the remaining capital to their investors it's no different to companies complaining that the cost of legal disposal of toxic waste renders their business nonviable
- JohnFen 3y ago> it's nowhere near viable to re-train them from scratch to remove some training data Tough. If their business is only viable by ignoring the law, they shouldn't be in business.