I dont know, there's been a load of progress in the 'run something like chatgpt on your own machine' dept in the last few months. Also Stanford trained Alpaca -

I dont know, there's been a load of progress in the 'run something like chatgpt on your own machine' dept in the last few months. Also Stanford trained Alpaca - fairly cheaply - using output from OpenAIs text-davinci-003, which somewhat suggests that the 'little guys' are are able to benefit from the expensive training done by the 'big guys' by using the big expensive models to train the small open-sources ones - https://crfm.stanford.edu/2023/03/13/alpaca.html https://crfm.stanford.edu/2023/03/13/alpaca.html