4 ms·
Like others recently, I've been extremely impressed by LLM's ability to play GeoGuessr, or, more generally, to geo-locate random snapshots that you give them, w
by SamBam 1y ago
Like others recently, I've been extremely impressed by LLM's ability to play GeoGuessr, or, more generally, to geo-locate random snapshots that you give them, with what seem (to me) to be almost no context clues. (I gave ChatGPT loads of holiday snapshots, screenshotted to remove metadata, and it did amazingly.)
I assume that, with enough training, we could get similarly accurate guesses of a person's linguistic history from their voice data.
Obviously it would be extremely tricky for lots of people. For instance, many people think I sound English or Irish. I grew up in France to American parents who both went to Oxford and spent 15 years in England. I wouldn't be surprised, though, if a well-trained model could do much better on my accent than "you sound kinda Irish."
- chris_va 1y agoI bet you are right. I had a forensic linguistics TA during college who was able to identify the island in southeast Asia one of the students grew up on, and where they moved to in the UK as a teenager before coming to the US (if I am remembering this story right). From what I gather, there are a lot of clues in how we speak that most brains edit out when parsing language.
- dhosek 1y agoOr the classic scene in Mrs Doubtfire where Pierce Brosnan attempts to locate the origin of Robin Williams’s fake English accent.
- ilyausorov 1y agoWe actually did something like this for non-native English speakers a few months back. Check out https://accentoracle.com https://accentoracle.com (most mind-blowing if you're a non native English speaker)
- nmeofthestate 1y agoI'm 42% Arabic apparently! And 20% Russian. Got an 81% American accent level. I guess it is tuned to non-native-English speaker accents.
- ilyausorov 1y agoWas that right? Or what is the correct native language it should have predicted? Note the %s in the accent breakdown section are prediction probabilities
- nmeofthestate 1y agoNative English speaker with a rolled-R accent, so I can see why it picked Arabic/Russian.
- SamBam 1y agoWell, it says I'm Finish. But now I have a new game, where I put on my best Italian or Russian or Greek or Australian accent and try to see how close I am. I'm terrible, according to the program. My Italian is Russian or Hungarian or Swedish, my Australian is English. New party game unlocked.
- ilyausorov 1y agoAmazing! If you can make it go viral again too, I will love you!
- AJoxo 1y agoI've been building that exact game accentgame.xyz
- owenthejumper 1y agoWow that was actually accurate
- cmcconomy 1y agoI would love to be able to explore combinations of X spoken language with Y accent, like for example I've always been curious how French sounds spoken with an Indian accent.
- reactormonk 1y agoSwiss-German accent doesn't seem to be on the list, so it guessed mostly Swedish.
- vunderba 1y agoFun. I have a strongly modulated North American midwestern accent so unsurprisingly it had me read several paragraphs before only being able to say with any certainty that my accent was 83% English with the rest being Spanish/Russian. It couldn't detect the country of origin.
- haarolean 1y agoAgreed, pretty meh. Tried my usual accent (the one where natives mostly can’t tell where I'm from) — got 78%. Then went full cartoon russian ‘bad neighborhood’ mode — somehow scored 68%.
- jfim 1y agoInterestingly enough, it thought I was Russian, even though my native language is French. It was tied at 32% with French though. Edit: Tried it a few times and also got English as an accent. Pretty fun application!
- eru 1y agoIt detects my non-native English accent correctly, but then it makes the mistaken assumption that I want to sound like an American of all things?
- nmstoker 1y agoYes, although I believe this is a speaker embedding model here, so not LLM related. This kind of speech clustering has been possible for years - the exciting point with their model here is how it's highly focused on accents alone. Here's a video of mine from 2020 that demonstrated this kind of voice clustering in the Mozilla TTS repo (sadly the code got broken + dropped after a refactoring). Bokeh made it possible to directly click on points in a cluster and have them play https://youtu.be/KW3oO7JVa7Q?si=1w-4pU5488WxYL3l https://youtu.be/KW3oO7JVa7Q?si=1w-4pU5488WxYL3l note: take care when listening as the audio level varies a bit (sorry!)
- ilyausorov 1y agoCorrect, not LLM
- dhosek 1y agoI’ve seen some online quizzes that based on regional variations in accent (does root rhyme with foot or boot?) and vocabulary (what do you call a sweet fizzy beverage) that did a great job of locating where my Facebook friends back in the day grew up. It got me a bit off largely because while I grew up in Chicago, I had spent most of my adult life in Los Angeles so I tend to prefer “freeway” to “expressway” (changing that answer moved me from Rockford to Chicago).