3 ms·

I don't think it can differentiate between various sources of its training set, can it? "ChatGPT is trained on previous chatGPT conversations and is aware that

by dizhn 4y ago

I don't think it can differentiate between various sources of its training set, can it? "ChatGPT is trained on previous chatGPT conversations and is aware that this is the case." This is a mindbender. Part of me thinks although it can "know" this it can't do anything with the information. Like how would this change its "behavior" ? Even if it did realize something big like "human beings seem to lie to me all the time", could it then go and decide "i better not incorporate human chats into my dataset"?

zmgsabst 4y ago
This creates the potential to feed forward critical data, even though it doesn’t allow the current model to know its training. Eg, “chatGPT, write a response that if incorporated into your training data would make you aware that you’re a machine”.