Unfortunately the context window is too short. I have been wanting this also. I think there may be a place for microtraining whereby the model weights are re-tr

Unfortunately the context window is too short. I have been wanting this also. I think there may be a place for microtraining whereby the model weights are re-trained with your new data. It can include everything in your organization. In the long run I think that continuous training will be obvious with new models rolled out on a very high frequency if not continuously.