I just tested out using GPT-4o instead of gpt-4-turbo for a RAG solution that can reason on images. It works, with some changes to our token-counting logic to a

I just tested out using GPT-4o instead of gpt-4-turbo for a RAG solution that can reason on images. It works, with some changes to our token-counting logic to account for new model/encoding (update to latest tiktoken!). I ran some speed tests for a particular question/seed. Here are the times to first token: gpt-4-turbo: * avg 3.69 * min 2.96 * max 4.91 gpt-4o: * avg 2.80 * min 2.28 * max 3.39 That's for the messages in this gist: https://gist.githubusercontent.com/pamelafox/dc14b2188aaa38af121598c3d0b17696/raw/ad4f3139330b3bdd0c0a261839c2f9d27b15fbe1/gpt4o.json https://gist.githubusercontent.com/pamelafox/dc14b2188aaa38a... Quality seems good as well. It'll be great to have better multi-modal RAG!