3 ms·
Have you looked at comparing to Google's foundation models or specialty medical models like MedGemma (https://developers.google.com/health-ai-developer-foundati
by xnx 1y ago
Have you looked at comparing to Google's foundation models or specialty medical models like MedGemma (https://developers.google.com/health-ai-developer-foundations/medgemma https://developers.google.com/health-ai-developer-foundation...)?
- fertrevino 1y agoThat would be an interesting extension. MedGemma isn't part of the original benchmark either [1]. Since Gemini 2.0 Flash is on 6th place, expectations are for MedGemma to achieve higher than that :) [1]https://crfm.stanford.edu/helm/medhelm/latest/#/leaderboard https://crfm.stanford.edu/helm/medhelm/latest/#/leaderboard