15 ms·

ELI5 How is it too expensive? I know ChatGPT was expensive to train but Vicuna-13b is said to have cost $300 to train [https://lmsys.org/blog/2023-03-30-vicuna/

ELI5 How is it too expensive? I know ChatGPT was expensive to train but Vicuna-13b is said to have cost $300 to train [https://lmsys.org/blog/2023-03-30-vicuna/ https://lmsys.org/blog/2023-03-30-vicuna/]

harisec 3y ago
Vicuna-13b is based on LLAMA that was millions to train. $300 is just to finetuning.
- foobiekr 3y ago
  it drives me crazy that people are ignoring this