4 ms·
High training times could be cost prohibitive. Currently, its over $100mil to train GPT4 from scratch (which possibly includes other costs related to RLHF and
by ugh123 3y ago
High training times could be cost prohibitive. Currently, its over $100mil to train GPT4 from scratch (which possibly includes other costs related to RLHF and data acquisition). Not sure how this model compares, but its likely not cheap.
- warkdarrior 3y agoThe claim in the paper was the ARIMA has high training times.
- cozzyd 3y agoMaybe they're using a pure Python implementation or something...