2 ms·
Misleading title, the first sentence of the Readme is... "promptbase is an evolving collection of resources, best practices, and example scripts for eliciting
by verdverm 3y ago
Misleading title, the first sentence of the Readme is...
"promptbase is an evolving collection of resources, best practices, and example scripts for eliciting the best performance from foundation models like GPT-4"
There happens to be one table in the Readme that compares the two foundational models on several benchmarks, but there is much more interesting content generally
The essence of Medpromt+ is summarized (by MS) as
In our Medprompt study, we focused on medical challenge problems, but found that the prompt strategy could have more general-purpose application and examined its performance on several out-of-domain benchmarks—despite the roots of the work on medical challenges. Today, we report that steering GPT-4 with a modified version of Medprompt achieves the highest score ever achieved on the complete MMLU.