At least with the current models by definition they are pre-trained, so aside from the original prompt being leaked there isn't too much an exploit should be ab

At least with the current models by definition they are pre-trained, so aside from the original prompt being leaked there isn't too much an exploit should be able to extract. However it is also possible to train custom models against the large ones such as curie and daVinci, and then you could be potentially looking at leaking sensitive information.