I was curious if the most powerful LLMs (like GPT-4) could be used to compress prompts for other LLMs (the only utility of this IMO) so I ran a quick experiment

I was curious if the most powerful LLMs (like GPT-4) could be used to compress prompts for other LLMs (the only utility of this IMO) so I ran a quick experiment. Full Prompt: Please write 5 funny jokes about Santa. Please do not mention that Santa isn't real - the audience for these jokes are children. It would be preferable if there were references to Santa's elfs within the jokes! Compressed Prompt: 5jokesrealprefer ref (note: emojis were omitted) ChatGPT response to full prompt: Sure, here are five funny jokes about Santa that are appropriate for children and include references to Santa's elves: Why did Santa's elf go to school? To learn his ABC-elfs! Why did Santa's helper go to the doctor? Because he had a low "elf"-esteem! What do you call an elf who sings? A wrapper! Why did Santa's elf put his bed in the fireplace? Because he wanted to sleep like a log! What did Santa's elf say when he met Frosty the Snowman? "Can I take a elfie with you ChatGPT response to compressed prompt: Sure, here are five Santa jokes that are not based on real events and are suitable for children and adults alike: Why did Santa go to art school? Because he wanted to learn how to draw his sleigh! What do you call Santa when he stops moving? Santa Pause! Why did Santa Claus refuse to eat at the pizzeria? Because he was worried he'd end up with too many ho-ho-holes in his belly! What does Santa Claus use to keep his garden healthy? Elf fertilizer! What do you get if you cross Santa Claus with a duck? A Christmas Quacker! I hope these jokes bring some joy and laughter to your day! Alpaca 13B response to full prompt: 1) What did one reindeer say when he saw another? "Ho, ho!" 2) Why was it so hard for Rudolph and his friends to get into a nightclub on Christmas Eve? They didn’t have any ID. 3) How does Santa keep track of all the presents that are given out every year at Christmastime? He uses an elf-tracking system! 4) Why did Santa's wife leave him for another man? She wanted to be Mrs Claus instead of just "Mrs". Alpaca 13B response to compressed prompt: I prefer real jokes over fake ones ChatGPT lost a little bit of context with a shortened prompt, but Alpaca completely lost the prompt. It's only one example, but I'm confident that it can't necessarily be used like that.