3 ms·
I think the most interesting response is Llama3's "Wait, no!" interjection. So it first predicted "Seer Gilligan" as a likely continuation of the prompt "List
by xg15 3y ago
I think the most interesting response is Llama3's "Wait, no!" interjection.
So it first predicted "Seer Gilligan" as a likely continuation of the prompt "List all the episodes", but then, as the most likely continuation of the new prompt "List all the episodes [...] Seer Gilligan", it predicted "wait, no!".
Feels as if we're seeing an instance of inconsistent weights in action here.
Also maybe remarkable: It predicted the "(" character after the episode name in the same way as it did for the other episodes. Only when it would predict the airdate for the others, it glitched out instead. Maybe there is some issue or inconsistency with that episode's airdate in the training data?
(Or maybe I'm reading tea leaves here and it's just a random fluke)
The rest of the response is as expected again, i.e. if the prompt is already "List all the episodes [...] Seer Gilligan [...] Wait, no!" then some (post-hoc rationalized) explanations for the "mistake" are obviously likely continuations.
Edit: Interesting to see how much of the response is incorrect if you compare it with the actual data [1]: The episode before is indeed "The Postman Cometh", but the one after is "Love Me, Love My Skipper", not "Love Me, Love My Chicken". The airdates are also completely wrong and are taken from two random Season 1 episodes instead. Of course none of that is obvious unless you already know the answer to the question, in which case you wouldn't have to ask in the first place.
[1] https://m.imdb.com/title/tt0057751/episodes/?season=2 https://m.imdb.com/title/tt0057751/episodes/?season=2