3 ms·
You could do most of that with some creative use of CLIP. 'Show more of the mountain' is trivial out of the box, and the 'kids aged 5-10' just needs a bit of lo
by gwern 5y ago
You could do most of that with some creative use of CLIP. 'Show more of the mountain' is trivial out of the box, and the 'kids aged 5-10' just needs a bit of logic: take a few photos of each kid at various ages 5-10 (perhaps already specified by the user?), embed, average along with the text prompt 'kids aged 5-10', and use those as the targets. 'Around that time' and 'in and around that house' can be done by metadata dates + GPS + image embedding of the 'house' (or just the text embedding of the word 'house'!) to filter photos by date+location, and then similarity to 'house'. And so on.
The question there is how to be able to create those queries automatically in response to transcribed user voice commands. But hey, given Codex/Copilot, who can doubt that programming such queries is out of reach of a contemporary NN either?