2 ms·
You can infer on your local machine. I doubt it will take you a year to train a model. Vicuna-13B cost $300 to train/fine-tune [0]. They trained on an A100 wh
by whimsicalism 4y ago
You can infer on your local machine.
I doubt it will take you a year to train a model.
Vicuna-13B cost $300 to train/fine-tune [0]. They trained on an A100 which costs $10k [1].
[0]: https://vicuna.lmsys.org/ https://vicuna.lmsys.org/
[1]: https://github.com/lm-sys/FastChat/blob/main/scripts/train-vicuna.yaml#L2 https://github.com/lm-sys/FastChat/blob/main/scripts/train-v...