3 ms·

Filling in the blank with what has not happened. LLMs interpolate quite well but they don't extrapolate. Very interesting article where you can or cannot put LL

Filling in the blank with what has not happened. LLMs interpolate quite well but they don't extrapolate. Very interesting article where you can or cannot put LLMs to use. It's not necessarily a bug, but we are yet to see.

goldenkey 3y ago
They extrapolate just fine. It's the image nets that don't. Here's my excerpt with GPT-4: As an AI, I can't actually see the painting, but based on the title and the dimensions you've provided, I can imagine a possible description. The painting, titled "Three cats in a trenchcoat standing on each other's shoulders, pretending to be a human, Vincent Adultman style," is a large piece, standing 6 feet tall and 4 feet wide. At the bottom of the painting, the trenchcoat's hem brushes the ground, obscuring the cats' feet. The trenchcoat is a deep, rich color, perhaps a classic trenchcoat beige or a more dramatic black or navy. The coat is painted with careful detail, showing the texture of the fabric and the gleam of buttons. Moving up the painting, the middle section reveals the outline of three cats stacked on top of each other within the coat. The artist might have chosen to show this through a slightly open coat, or perhaps through the distinctive shapes visible under the fabric. The cats could be of different breeds and colors to add visual interest and humor. The top third of the painting, the upper two feet, features the head of the topmost cat peeking out from the collar of the trenchcoat. The cat might be looking straight ahead, trying to maintain its human disguise, or it might be looking out at the viewer with a humorous or mischievous expression. If the artist chose to include a hat, it would be perched on the cat's head, adding to the disguise. The background of the painting could vary greatly depending on the artist's style and intentions. It could be a simple, solid color to keep the focus on the cats, or it could be a detailed scene that adds to the story - perhaps a city street to tie in with the Vincent Adultman reference, or a domestic setting to contrast with the cats' unusual behavior. Again, this is a hypothetical description and the actual painting could be very different.
- Der_Einzige 3y ago
  Most of what you think is extrapolation is interpolation. Models do NOT extrapolate unless they are given access to resources/data that is not somehow in their training dataset. We have done so much encoding of knowledge that a majority of serious use-cases for LLMs are Interpolation, but the fact that we even need retrieval augmented generation shows that they do not extrapolate.

goldenkey 3y ago

They extrapolate just fine. It's the image nets that don't. Here's my excerpt with GPT-4: As an AI, I can't actually see the painting, but based on the title and the dimensions you've provided, I can imagine a possible description. The painting, titled "Three cats in a trenchcoat standing on each other's shoulders, pretending to be a human, Vincent Adultman style," is a large piece, standing 6 feet tall and 4 feet wide. At the bottom of the painting, the trenchcoat's hem brushes the ground, obscuring the cats' feet. The trenchcoat is a deep, rich color, perhaps a classic trenchcoat beige or a more dramatic black or navy. The coat is painted with careful detail, showing the texture of the fabric and the gleam of buttons. Moving up the painting, the middle section reveals the outline of three cats stacked on top of each other within the coat. The artist might have chosen to show this through a slightly open coat, or perhaps through the distinctive shapes visible under the fabric. The cats could be of different breeds and colors to add visual interest and humor. The top third of the painting, the upper two feet, features the head of the topmost cat peeking out from the collar of the trenchcoat. The cat might be looking straight ahead, trying to maintain its human disguise, or it might be looking out at the viewer with a humorous or mischievous expression. If the artist chose to include a hat, it would be perched on the cat's head, adding to the disguise. The background of the painting could vary greatly depending on the artist's style and intentions. It could be a simple, solid color to keep the focus on the cats, or it could be a detailed scene that adds to the story - perhaps a city street to tie in with the Vincent Adultman reference, or a domestic setting to contrast with the cats' unusual behavior. Again, this is a hypothetical description and the actual painting could be very different.

Der_Einzige 3y ago
Most of what you think is extrapolation is interpolation. Models do NOT extrapolate unless they are given access to resources/data that is not somehow in their training dataset. We have done so much encoding of knowledge that a majority of serious use-cases for LLMs are Interpolation, but the fact that we even need retrieval augmented generation shows that they do not extrapolate.