2 ms·
> I feel like predicting the next most likely word is a grave oversimplification of what is going on with chatgpt. > At least from my admittedly limited amount
by satvikpendem 4y ago
> I feel like predicting the next most likely word is a grave oversimplification of what is going on with chatgpt.
> At least from my admittedly limited amount of testing, it appears to be capable of synthesizing unique content from multiple sources.
Why do you believe these two statements to be orthogonal?
- jjeaff 4y agoWell, maybe I'm just not understanding how the statistics are applied, but I don't see how one could use statistical analysis to predict the next word if the specific sequence has never been encountered by the model. For example, if I can tell chatgpt to answer a question about black holes in the style of Chaucer's Cantebury tales, what data is it using to predict that response? It seems to me there is some additional mechanisms at work.