4 ms·

Is the vision model directly reading the screen and therefore also reading the Vimeo tags? It might be more effective to export the DOM tags and the associated

by imranq 3y ago

Is the vision model directly reading the screen and therefore also reading the Vimeo tags? It might be more effective to export the DOM tags and the associated elements as a Json object that is fed into chatGPT without using the vision component

dymk 3y ago
> Currently the Vision API doesn't support JSON mode or function calling, so we have to rely on more primitive prompting methods.
- maccam912 3y ago
  I found that it works well to ask it to generate JSON the best it can, then pass it to gpt-3.5-turbo with the JSON response mode and instruct it to just clean up whatever input it received.
  - ishan0102 3y ago
    Perfect, I have this as a todo in my readme and I’ll implement this soon