3 ms·
Interesting. Is this relying on SAM to segment text to send to GPT? How does it perform compared to GPT-V?
by williamdelo32 3y ago
Interesting. Is this relying on SAM to segment text to send to GPT? How does it perform compared to GPT-V?
- abrichr 3y agoSAM is used to segment GUI elements, which are then sent to GPT4-V to be described. We then prompt GPT-4 with the user's actions and the descriptions of the GUI elements to generate new actions to accomplish different behaviors.