3 ms·
> How does GPT-4 achieve in-context learning without finetuning its parameters? GPT-4 can use its ability to encode problems in PDDL and in-context learning to
by kordlessagain 4y ago
> How does GPT-4 achieve in-context learning without finetuning its parameters?
GPT-4 can use its ability to encode problems in PDDL and in-context learning to infer the problem PDDL file corresponding to a given problem (P). This can be done by providing the model with a minimal example that demonstrates what a correct problem PDDL looks like for a simple problem in the domain, as well as a problem description in natural language and its corresponding problem PDDL. This allows the model to leverage its ability to perform unseen downstream tasks without having to finetune its parameters.