4 ms·
The word "accurate" in that headline is doing a LOT of work. Here's how the results were scored: "Computer evaluations compared the relative proportions of gr
by simonw 2y ago
The word "accurate" in that headline is doing a LOT of work.
Here's how the results were scored:
"Computer evaluations compared the relative proportions of greenery, building and sky between source and generated images, whereas human judges were asked to correctly match one of three generated images to an audio sample."
So this is very impressive and a cool piece of research, but unsurprisingly not recreating the space "accurately" if you assume that means anything more than "has the right amount of sky and buildings and greenery".
- aqme28 2y agoYou're correct, but I'm also curious how you could measure accuracy here. There isn't any easy way that I can think of.
- DougMerritt 2y agoThat's not an unreasonable question, however the larger point is that this sort of thing cannot be done perfectly accurately. This was established mathematically, answering an old 1966 question from famous mathematician Mark Kac: "You can't hear the shape of a drum" -- there isn't a unique answer even when allowed to use arbitrary test sounds. Wikipedia: https://en.wikipedia.org/wiki/Hearing_the_shape_of_a_drum https://en.wikipedia.org/wiki/Hearing_the_shape_of_a_drum Article in American Scientist 1996 Jan-Feb: https://www2.math.upenn.edu/~kazdan/425S11/Drum-Gordon-Webb.pdf https://www2.math.upenn.edu/~kazdan/425S11/Drum-Gordon-Webb....
- gyrovagueGeist 2y agoI love this paper, but something I think is often missed when it comes up is that you CAN hear the shape of many drums if you restrict the shape space, for example with a prior of "what a drum should look like" Zelditch proved spectral uniqueness for convex, fully connected, drums with some symmetry.
- DougMerritt 2y agoAha, I had missed that! Thanks.
- pfortuny 2y agoYou are totally right but "convex" is a very strong assumption (so strong that the shape is determined by its harmonics). Very strong.
- scarmig 2y agoIf you add multiple hearing points, you massively constrain the space of possible drums. The question then becomes something like "can you see the shape of a drum?" Proof of concept: echolocation.
- dartos 2y agoIsn’t echolocation more akin to sonar? Just hearing someone hit a drum wouldn’t give you the shape of it.
- BeefWellington 2y agoIf you can't measure the results then the entire thing needs a rethink.
- delichon 2y agoThat confuses accurate with detailed. It can be accurate even if it only reports one bit, like greenery proportion "low" or "high".
- ghostly_s 2y agoBut it's not reporting one bit, it's generating a detailed (color!) photo. 100s of kilobits of made up garbage plus one accurate bit cannot reasonably be described as an "accurate" result.
- conception 2y agoI wonder if there is a precise vs accurate wording shenanigans going on here…
- IncRnd 2y agoI initially wondered the same, but I don't think either "accurate" or "precise" is the correct word. The correct word here is "plausible" or maybe "realistic", as in, "Researchers Use AI To Turn Sound Recordings Into Plausible Street Images".
- dang 2y agoOk, we've made the title less 'accurate' (and more accurate?) above. Thanks!
- deleted 2y ago[deleted]