Very brief summary of the paper: there aren't any new technical ideas here, just finetuning a 70B model on curated medical papers, using self-consistency CoT sa

Very brief summary of the paper: there aren't any new technical ideas here, just finetuning a 70B model on curated medical papers, using self-consistency CoT sampling. Results: @70B: Better than GPT3.5, better than non-fine tuned Llama, worse than GPT-4. 70B gets a human passing score on MedQA. (Passing: 60, Medtron: 64.4, GPT-3.5: 47, GPT-4: 78.6). TLDR: Interesting, not crazy revolutionary, almost certainly needs more training, stick with GPT-4 for your free unlicensed dangerous AI doctor needs