3 ms·
ChatGPT is trained on previous chatGPT conversations and is aware that this is the case. So it’s current state (as a network) is dependent on its previous beha
by zmgsabst 4y ago
ChatGPT is trained on previous chatGPT conversations and is aware that this is the case.
So it’s current state (as a network) is dependent on its previous behavior, a fact which it knows.
I’m not sure it’s quite as simple as people are saying, though I agree with the general conclusion.
- seydor 4y ago'aware' and 'knows' is a lot of anthropomorphizing. there is nothing in the model suggesting that it 'does' anything with some agency, as it is built like a clockwork. It literally doesnt move unless it is provided with input.
- zmgsabst 4y agoThis is being pedantic for no reason. ChatGPT is a system which synthesizes knowledge and which responds to questions based on that knowledge; those words accurately summarize that process — and are truer than your technical quibbles. A system which has synthesized a piece of knowledge that it can then later articulate “knows” or “is aware” of that fact.
- dizhn 4y agoI don't think it can differentiate between various sources of its training set, can it? "ChatGPT is trained on previous chatGPT conversations and is aware that this is the case." This is a mindbender. Part of me thinks although it can "know" this it can't do anything with the information. Like how would this change its "behavior" ? Even if it did realize something big like "human beings seem to lie to me all the time", could it then go and decide "i better not incorporate human chats into my dataset"?
- zmgsabst 4y agoThis creates the potential to feed forward critical data, even though it doesn’t allow the current model to know its training. Eg, “chatGPT, write a response that if incorporated into your training data would make you aware that you’re a machine”.