4 ms·
Could anyone recommend an open-source tool capable of simultaneously sending the same prompt to various language models like GPT-4, Gemini, and Claude, and disp
by rthnbgrredf 3y ago
Could anyone recommend an open-source tool capable of simultaneously sending the same prompt to various language models like GPT-4, Gemini, and Claude, and displaying their responses side by side for comparison? I tried chathub in the past, but they decided to not release any more source as of now.
- josh-sematic 3y agoNot open-source, but https://airtrain.ai https://airtrain.ai lets you do this. Disclaimer: I’m an engineer there. Edit: aiming to have Claude 3 support by tomorrow.
- hnenjoyer_93 3y agohttps://chat.lmsys.org/ https://chat.lmsys.org/ Choose Arena (side-by-side), it has Claude 3 Opus, Sonnet and GPT-4
- deleted 3y ago[deleted]
- r_hendricks 3y agoIf you're willing to use the CLI, Simon Willison's llm library[0] should do the trick. [0] https://github.com/simonw/llm https://github.com/simonw/llm
- rthnbgrredf 3y agoI already have a cli client, but how to talk to multiple different LLMs at the same time? I guess I can script something with tmux.
- r_hendricks 3y agoYes, I had in mind that you’d need a simple script for this
- barfingclouds 3y agoPoe. Poe has Claude 3 right now as well as Gemini pro (not ultra), gpt 4 and 3.5, mistral large, llama, others
- azebazenestor 3y agohttps://github.com/nat/openplayground https://github.com/nat/openplayground but seems it has not be updated from 6 months.