15 ms·

Apple's whitelist of the 250k auto-completable domains in iOS

373 points by varenc 5y ago

bwblabs 5y ago
250k is off by one, actually 249999 entries: $ curl -s https://cdn.smoot.apple.com/static/autofill_tld_whitelist_url | jq '.tlds|length' 249999
- varenc 5y ago
  Hah I appreciate your accuracy. I got 250k by running this: $ curl https://cdn.smoot.apple.com/static/autofill_tld_whitelist_url | jq | wc -l 250004 And then I naively assumed with the extra JSON brackets the total would be 250k but I wasn't thorough enough!
MrJagil 5y ago
How do you tell safari to ignore this list? When i want to go to discord safari insists on discoverykids.com. I (think) i have turned off all search-suggestions in settings.
lokimedes 5y ago
What is this for, and what should I do to get on, or off the list?
- vishnugupta 5y ago
  > What is this for Presumably to auto complete URLs, like "go" to "google.com", in Safari's address bar.
- jml7c5 5y ago
  I assume it's for pre-populating the address bar suggestions. Even on a fresh browser with no history, users probably want 'nyti' to complete to 'nytimes.com', for example.
  - mproud 5y ago
    https://nyt.com https://nyt.com
    - jml7c5 5y ago
      For some reason I thought the NY Times didn't own nyt.com. I chose a poor example, apparently!
- growt 5y ago
  It looks like something not on this list gets suggested in mobile Safari, but not autocompleted (so on top of the screen it will show as a clickable link, but you will not see the complete url in the address field and be able to just go to it by hitting "enter").
dangero 5y ago
Anyone know how this list was created or how often it gets updated?
- eyelidlessness 5y ago
  My hunch was that it originated well before iOS, and could be traced back to forking KHTML, but if that hunch was right I can’t find any way to validate it.
  - blowski 5y ago
    Agreed. Some of the domains there were popular 10-15 years ago, but are now relatively obscure. Meanwhile, high traffic domains that have emerged over the past few years are missing. Compare "pricerunner.com" and "tiktok.com" for example.
  - svenpeter 5y ago
    The list was at least updated after iOS: I've found wiibrew.org and hackmii.com in there which are both Wii homebrew sites that became popular around 2008/2009 and probably declined in popularity starting in ~2012/2013. Then there's also wiiu-developers.nintendo.com and wiiudaily.com which probably didn't exist before late 2012 or early 2013 when the WiiU was released.
- weinzierl 5y ago
  This an interesting question. Skimming the list it seems that - at least - it is not based solely on popularity (like the Alexa 1 million list for example). I see lots of websites for small German towns, which should only have a couple of visitors per week. Of the blogs and personal websites I read - some popular, some less so - only paulgraham.com is there. I suspect the list is biased to official and very old domains.
  - ultimoo 5y ago
    To add another data point: I couldn't find "substack" on there, and it's been around since 2017.
AraceliHarker 5y ago
- na85 5y ago
  Look I love to hate on Apple as much as the next guy but asking that question really doesn't seem like it's being done in good faith. Do you really think that Apple is subtly supporting an anti-Chinese, anti-Korean, pro-Japanese racist agenda through... an URL autocomplete list? Or is it more likely that it's a legacy list that has probably not been vetted by a human in quite some time if ever?
  - kebab 5y ago
    It's still worth interrogating even if it's an oversight.
- rvz 5y ago
  Try asking Apple Japan.
- rgj 5y ago
  This is not a “list of allowed websites”.
  - kebab 5y ago
    I don't think it makes a difference, if anything, it's worse that it's in their autocomplete list.
    - deleted 5y ago
      [deleted]
    - rgj 5y ago
      Yes, that does make a difference and no, it’s not. An autocomplete list is most likely generated based on statistics and contains sites that are being _used_, and an allow list is moderated and contains sites that are _condoned_.
drusepth 5y ago
Interesting side-note: there are only two *.ai domains on this entire list: 1. "tempo.ai", which doesn't actually resolve 2. "web.ai", an http-only site that looks kind of like a cross between a geocities website and a parked spam page, with the content allegedly last revised almost 20 years ago (2003) I wonder how old this list is.
- deleted 5y ago
  [deleted]
- ricardobeat 5y ago
  When I type “web.” it autocompletes to “web.archive.org”, I don’t think this list is up to date at all.
  - playpause 5y ago
    Probably stuff in your own history takes precedence?
    - vesrah 5y ago
      Looks like it, my device autocompletes web. to web.whatsapp.com
bjarneh 5y ago
zombo.com is there :-)
- mrtksn 5y ago
  Of course it is, you can do anything at zombo.com
nabaraz 5y ago
Assuming this is a list for Apple's autocomplete feature on Safari and other apps, what damage can a hacker do if they were to maliciously update this file?
- tcmb 5y ago
  Homoglyph Attacks come to mind. Replace legitimate domains like nytimes.com with ones that look identical but lead to phishing sites. (The hacker would have to build those convincing phishing sites as well, of course...)
- amenghra 5y ago
  Not much if you use a password manager that checks the domain before auto filling and/or use U2F tokens as your 2nd factor. The threat model isn’t too different from other things that can happen if a malicious user is on the same network as you. The scale would be different though.
jafingi 5y ago
Ha! This explains why I always get "cookieandkate.com" suggested when I want to visit another site that starts with "cookie". I was extremely frustrated that it suggested that site with higher priotity than the one I actually visit mostly every day. And I had never myself gone to that site. Now I know why...
- Bilal_io 5y ago
  That's very strange, you'd expect Apple to provide a good UX by suggesting a website from your bookmarks, history and then their list. I wonder whether that's an oversight or an intentional implementation.
  - dwighttk 5y ago
    Safari does use your bookmarks and your history, but at some point the history expires so some sites I go to rarely don’t autocomplete and I add bookmarks when I notice. Also it sometimes is too slow to pick up that I don’t want to go where it autocompleted, I hit go, then immediately hit back and typed more characters in to get the actual site I wanted. I could go and edit my history, but that process is a little clunky on my phone.
  - quitit 5y ago
    That's exactly the behaviour I have when using iOS.
    - Bilal_io 5y ago
      I see. OP replies saying their history somehow expired, and the page wasn't bookmarked to begin with. So I stand corrected. Thank you
  - ezfe 5y ago
    It does - some people always browse in Private Mode or have History off
i1856511 5y ago
"smoot" dot apple dot com?
- gilgoomesh 5y ago
  Doubtless named for The Smoot-Hawley Tariff Act which raised or lowered taxes? Anyone? Anyone?
  - vulcan01 5y ago
    Raised tariffs, not taxes. It's an important difference, doubly so with regards to Smoot-Hawley because the whole point was to protect American companies (and therefore jobs) from foreign competition (of course, it did not work...).
    - gilgoomesh 5y ago
      (It was a Ferris Bueller's Day Off reference. Blame Ben Stein.)
      - vulcan01 5y ago
        ... and I have not yet seen Ferris Bueller, so I didn't get the reference. Consider us even ;)
- xvector 5y ago
  I see tons of DNS requests for this domain blocked by AdGuard. I wonder what it's for.
- throwaway48375 5y ago
  https://apple.stackexchange.com/questions/157424/what-are-api-smoot-apple-com-and-other-hosts-my-iphone-is-secretly-talking-to https://apple.stackexchange.com/questions/157424/what-are-ap...
- blamazon 5y ago
  Could be further immortalization of Oliver Smoot, “a fraternity pledge to Lambda Chi Alpha, who in October 1958 lay down repeatedly on the Harvard Bridge (between Boston and Cambridge, Massachusetts) so that his fraternity brothers could use his height to measure the length of the bridge, which summed to "364.4 Smoots ± 1 ear" https://en.wikipedia.org/wiki/Smoot https://en.wikipedia.org/wiki/Smoot
spiderfarmer 5y ago
My competitor is in this list and I'm not, even though my site is more popular. There even are some small Dutch campings, municipalities and regional football clubs on this list. It's a strange list for sure.
- badestrand 5y ago
  My website is in there but with a typo (people often make that mistake) :( The website with typo doesn't exist.
  - brainlessdev 5y ago
    Can you buy the domain and redirect them?
    - autoexec 5y ago
      Periodically searching this list for purchasable domains seems like something scammers would be very very interested in. Honestly, apple should be making sure every one of these URLs goes to a live website and that the website is still exactly the website they intended it to be.
      - Wowfunhappy 5y ago
        > and that the website is still exactly the website they intended it to be. How could they realistically do that?
        dolni 5y ago
        I am sure they can find a way with tens of billions in quarterly revenue.
        Wowfunhappy 5y ago
        Billions in quarterly revenue doesn't allow Apple to solve the halting problem. I can't begin to imagine how they would do what you're suggesting. They need to detect when a website changes in kind, but ignore day-to-day changes or normal UI revamps.
saagarjha 5y ago
Related list: https://cdn.smoot.apple.com/static/autofill_corrections_url https://cdn.smoot.apple.com/static/autofill_corrections_url
- varenc 5y ago
  hah I see we both discovered the same lists! Did you get these from traffic interception too? I didn't find any hits for these on Google but not surprised you beat me to it of course. I'm a long time fan of your apple-hacking blog posts. For others, here's the other ones found: - "correction_dict_url": "https://cdn.smoot.apple.com/static/static_corrections_dict/20200930/static_corrections_dict.json https://cdn.smoot.apple.com/static/static_corrections_dict/2..." - "crowdsourcing_blacklist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_blacklist_url https://cdn.smoot.apple.com/static/crowdsourcing_blacklist_u..." - "crowdsourcing_whitelist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_whitelist_url https://cdn.smoot.apple.com/static/crowdsourcing_whitelist_u..." - "spotlight_model_resources": "https://cdn.smoot.apple.com/static/spotlight_model_resources/2/spotlight_ml.mpak?version=2 https://cdn.smoot.apple.com/static/spotlight_model_resources..." - "spotlight_stopword.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_stopwords/4/stopwords-en.map?version=4 https://cdn.smoot.apple.com/static/spotlight_suggestions_sto..." - "spotlight_phrase_dictionary.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_phrase_dictionary/4/phrase-dictionary-en-US.map?version=4 https://cdn.smoot.apple.com/static/spotlight_suggestions_phr..." - "silhouette_topic_mapping": "https://cdn.smoot.apple.com/static/silhouette_topic_mapping/5/silhouette_topic_mapping?version=5 https://cdn.smoot.apple.com/static/silhouette_topic_mapping/..." - "silhouette_whitelisted_topics": "https://cdn.smoot.apple.com/static/silhouette_whitelisted_topics/5/silhouette_whitelisted_topics?version=5 https://cdn.smoot.apple.com/static/silhouette_whitelisted_to..." - "silhouette_config": "https://cdn.smoot.apple.com/static/silhouette_config/5/silhouette_config?version=5 https://cdn.smoot.apple.com/static/silhouette_config/5/silho..." - "dictionary_resources_url": "https://cdn.smoot.apple.com/static/dictionary_resources_url https://cdn.smoot.apple.com/static/dictionary_resources_url" Also I just realized that the source of all these doesn't require auth either and you can just view it here: https://api.smoot.apple.com/bag https://api.smoot.apple.com/bag (but requires a spoofed user-agent if you use cURL)
thyrox 5y ago
- ravenstine 5y ago
  > 2. Crippled and never let PWAs fully work because security and battery. How are PWAs insecure?
  - colordrops 5y ago
    That one stuck out at me as well. The real reason is that it's a threat to their walled garden app store.
- kome 5y ago
  > The more I learn about open source the more i see their point.. Stallman is consistently mocked and diminished, but he is also consistently right.
  - bayindirh 5y ago
    ...and we see what happens when we do the things he warns about in a consistent manner, yet people still continue to mock and ignore him. Sad.
  - goodpoint 5y ago
    I never heard people mocking Stallman for his warnings about surveillance and curtailing user's freedoms. But his behavior in public and the way he communicates is a completely different topic and a can of worms...
- 2143 5y ago
  I can't tell if you're being serious or sarcastic.
  - IshKebab 5y ago
    Yeah, killing Flash at least was definitely a good thing. Not sure about the others! Strange comment.
genis 5y ago
rthtdhdh
harry8 5y ago
Wikileaks.org etc are in there. Leaving them out would be wrong IMHO. I'm not sure what to make of having them in there though.
- petesergeant 5y ago
  You should "make of" it that Apple consider it a popular domain people try and navigate to
  - harry8 5y ago
    You think apple are above censorship at the behest of politicians?
    - aaaaaaaaata 5y ago
      Considering most of us didn't know about this list either, there simply wasn't anyone to ask for the censorship.
      - harry8 5y ago
        Various politicians have made their feelings known beyond any doubt. Note the lack of, say, pornhub etc in this list. Someone has sanitized it somehow and didn't pre-emptively censor wikileaks. That's a good thing, I guess?
zhte415 5y ago
Instead of doing any thoughtful analysis of this list, I'm treating it as a random web ring and clicking through to an eclectic bunch of sites. Currently on websites starting with 'joe'. Because Internet entropy is fun. More fun than a recommendation engine.
- hyperdimension 5y ago
  You reminded me of StumbleUpon. I miss that service dearly, or maybe I just miss that general era of the Internet.
dalbasal 5y ago
This is an interesting little example of how "systemic" happens, or can happen. The list exists initially to support a feature, a utilitarian reason. Then, being in the list has SEO value or some such. The list becomes a legitimacy or authority test. It affects traffic, sales. Maybe other stuff piggybacks this list. Anyone who needs a list of important domain names uses it. Ordering search results, caching, testing, crawling... More dynamics unrelated to Apple's original purpose. Meanwhile, Apple continues to treat the list as a relatively unimportant thing... Just a clunky little hack that enables autocomplete. At some point, willfully ignorant of a whole industry of professional services out there promising to get you on list.
- nonrandomstring 5y ago
  Yes, nice to see we've come full circle at last from Karp, Mills and Postel maintaining the official HOSTS.TXT throgh the "free internet era" and back to a nice sanitised, official list of what's on the internet.
- blenderdt 5y ago
  Ok, maybe I am missing something here. The link points to a list Apple is hosting without any context. Does anyone know why this list is hosted and what it is used for? Is it even used? Edit: some 7 year old posts suggest it was used by Spotlight. I also am a little amazed it loaded and scrolls smooth on Firefox mobile...
  - jjoonathan 5y ago
    When I type "analog.com" into the search bar, I can imagine a way for autocomplete to go wrong. This list would prevent it from going wrong.
    - deleted 5y ago
      [deleted]
  - zymhan 5y ago
    Can't say the same for Firefox on Windows, on a powerful PC :/
black_puppydog 5y ago
Ugh, I guess that's why the iOS browsers all suck so hard with autocomplete? I always long for Firefox's url bar, it easily beats everything else since Firefox 2 came out or so. Nowadays you have to un-configure two layers of "let's put a search bar in your URL bar" but then it's still just amazing. Especially compared to google, which obviously doesn't have an incentive to have you skip searching on google.com... and apparently apple doesn't want to you complete just any old urls, but only apple approved ones?! This seems like such a useless kind of (soft, but still) gate-keeping...
- undefinedzero 5y ago
  It seems like a useful privacy feature to me. I don't want Apple or Firefox to pass every site I visit every time I visit it to Google, Apple or any other company under US law.
  - iggldiggl 5y ago
    Yes, although in principle this kind of list should only be necessary for fresh browsing profiles (plus people who don't keep a local browsing history). Once you've used the browser for a while, autocomplete should predominantly be powered by your local browsing history anyway. Firefox on Android e.g. used to (or still has – I'm not sure what the state is nowadays after the rewrite) have a similar (although somewhat smaller) list of popular domains which it would use for providing autocomplete results if it couldn't find anything in your history, but local history always had priority.
    - andybak 5y ago
      I switched to Firefox about a year ago but I'm really missing the autocomplete from Chrome. I guess sharing my entire digital life with Google had some upside after all. Joking aside - Firefox makes some strange choices and the I wish mobile and desktop could (optionally) share more of my browsing history. Maybe they do but the autocomplete doesn't behave the same across devices.
- JimDabell 5y ago
JimWestergren 5y ago
Thanks a lot for the tip. I am going to add this to domainstats.com
oxplot 5y ago
Even with `xz --best`, you can only compress this down to 25% of its original size. I guess a more specialized text compressor that can get this to less than 10% would allow 2-3x more domains to be included.
smileybarry 5y ago
Oddly enough, tier 1 cell carriers that have agreements with Apple aren't immune to being forgotten by Apple. The list has "orange.co.il" (now NXDOMAIN) but not "partner.co.il". Partner (one of 4 main cell networks in Israel) used to be called Orange but they terminated that agreement with Orange FR years ago (which I'm guessing is why they can't redirect "orange.co.il" either).
ckue 5y ago
Interesting that the list contains URLs to piracy torrent sites (thepiratebay, etc.) and the Silk Road darknet market (defunct since 2013).
- aaron695 5y ago
  The other .onions are Silk Road 3 (Created 2015) and the Hidden Wiki which Wikipedia eventually refused to link to. These addresses are Onions v2 and now disabled in Tor.
lizardactivist 5y ago
I'm curious if this control over auto-complete can help direct users to websites that are favored or approved by Apple, and eventually change people's opinion of which sites are "good". In a way it's a slight step towards allowing or disallowing visiting certain websites. Is the owner of the phone allowed some control here?
- vincnetas 5y ago
  And i assume there are no adult content providers in that list. Who will autocomplete that for me :(
  - lizardactivist 5y ago
    I agree! Typing on mobile with only one hand is the worst!
b215826 5y ago
> stallman.org, fsf.org, gnu.org Keep your friends close and your enemies closer. > breitbart.com, stormfront.org Lulz.
HellsMaddy 5y ago
I'm curious to see how this changes over time, so I threw together a quick repo with a GitHub action to watch the endpoint. https://github.com/b0o/apple-autofill-domains https://github.com/b0o/apple-autofill-domains
- nly 5y ago
  My bet is it's a manual update process once in a blue moon
- hiccuphippo 5y ago
  Interesting! Perhaps it could even post a comment to an issue so people can subscribe to it.
  - HellsMaddy 5y ago
    Good idea! I’ve created an issue[0] that can be subscribed to, I will implement the feature soon. [0]: https://github.com/b0o/apple-autofill-domains/issues/1 https://github.com/b0o/apple-autofill-domains/issues/1
    - asah 5y ago
      Random q: why fetch depth 20?
      - HellsMaddy 5y ago
        That’s actually a bug, thank you. It will break as soon as the last modification to the data file is more than 20 commits behind HEAD. I used 20 because it made the workflow function (it was working on my local machine but not when I pushed to GitHub because the default depth is 1). I need to update it to check for the last commit that modified the json file rather than searching through the entire commit history.
- jzelinskie 5y ago
  You should be careful with the cron intervals because GitHub eventually just disabled one of the actions that I wrote that worked exactly like this. I was generating a list of the YouTube's dynamic ad-serving domains.
baud147258 5y ago
funny, I checked the different forums I hang around and the only one in the list is the smallest (in terms of user counts). Though maybe it's the most well-known/infamous outside of its direct niche?
Tutanota 5y ago
It looks like the list is very old. Tutanota.de is on it, but we've switched to using tutanota.com years ago...
- digitalsin 5y ago
  Hey thanks for making a great email service!
nathan_f77 5y ago
I noticed that tiktok.com is missing, so this list might have been compiled sometime before 2019. I wonder if you could write a script that pinpoints the exact month or even day.
- nathan_f77 5y ago
  I wrote a script: https://github.com/ndbroadbent/autofill_tld_whitelist_url_age_calculator https://github.com/ndbroadbent/autofill_tld_whitelist_url_ag... This attempts to scan WHOIS records for random domains in the list and try to find the most recent "registered at" date for a domain. It's very unreliable. The whois-parser Ruby gem thought that giants.it was created on 2020-11-03 09:00:01, but I checked the record and it looks like it was actually created on 2009-09-28 11:00:43. It looks like nature-in-art.org.uk was first registered on 21-Jul-2019 I don't know if this would provide any useful information. It would take at least a year for a brand new domain to make it into this list. And I don't know if the "created at" date can be trusted, maybe it gets reset whenever a domain is transferred, or lapses and then gets renewed. In conclusion, I don't think this idea works at all.
jp0d 5y ago
How does one get access to the direct URL to such a file?
donohoe 5y ago
I am guessing that this list has not been updated in years - or at least properly validated. For example, search for “nytimes.com”. Many of the subdomains haven’t been used in years - and are to blogs that were retired 6 or so years ago.
bhobs 5y ago
My employer is in this list, along with their main competitor. However, said competitor's domain is incorrect and links to a much smaller unrelated page.
amichal 5y ago
I was at first guessing this this might have had as a (partial) data source the hsts static preload list[1]. But, a domain I know we never submitted to it was on there while one which was submitted (but has since aged out) is not. Also these lists are so absurdly large [1] https://cs.chromium.org/chromium/src/net/http/transport_security_state_static.json https://cs.chromium.org/chromium/src/net/http/transport_secu...
bamboozled 5y ago
Whitelist is a controversial / potentially offensive term, can it be changed please to allow list to make it inclusive please.
- truthwhisperer 5y ago
- frankincense 5y ago
  It's literally the name of the resource: https://cdn.smoot.apple.com/static/autofill_tld_whitelist_url https://cdn.smoot.apple.com/static/autofill_tld_whitelist_ur...
- numlock86 5y ago
  That's a hoax just like the "ok hand gesture" = "white power" debate. It started as a joke on 4ch, now everyone (even big tech) believes in it because of a few thousand (social) media reposts.
  - hjkl0 5y ago
    You’re saying that the debate about the terms “whitelist” and “blacklist”, and presumably also “master” and “slave”, is a hoax?
- digitalsin 5y ago
  Oh good grief.
- curt15 5y ago
  In the same way that "master recording" or "master branch" or "mastering" are somehow not inclusive?
  - numlock86 5y ago
    You'd be surprised how many people get offended (usually on behalf of others) by this these days ...
irrational 5y ago
Fascinating. I know of an organization that abandoned (other than redirects) their original domain name about 4 years ago and adopted a new domain name. The old domain name is in the list (with about 30 subdomains!), but the new domain is not in the list at all. This makes me wonder how (if) the list is updated.
varenc 5y ago
OP here. I found this URL by intercepting traffic on my older jailbroken iOS device. It's possible that a more recent version of iOS doesn't use it. This url, among others, was returned in some configuration-fetching call to https://api.smoot.apple.com/bag https://api.smoot.apple.com/bag (which requires auth) Here's some other ones: - "correction_dict_url": "https://cdn.smoot.apple.com/static/static_corrections_dict/20200930/static_corrections_dict.json?version=20200930 https://cdn.smoot.apple.com/static/static_corrections_dict/2..." - "crowdsourcing_blacklist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_blacklist_url?version=2ca06afd0850f1f42695f6b6928dc0f4 https://cdn.smoot.apple.com/static/crowdsourcing_blacklist_u..." - "crowdsourcing_whitelist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_whitelist_url?version=032857ed01170d11e723650d446758bd https://cdn.smoot.apple.com/static/crowdsourcing_whitelist_u..." - "spotlight_model_resources": "https://cdn.smoot.apple.com/static/spotlight_model_resources/2/spotlight_ml.mpak?version=2 https://cdn.smoot.apple.com/static/spotlight_model_resources..." - "spotlight_stopword.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_stopwords/4/stopwords-en.map?version=4 https://cdn.smoot.apple.com/static/spotlight_suggestions_sto..." - "spotlight_phrase_dictionary.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_phrase_dictionary/4/phrase-dictionary-en-US.map?version=4 https://cdn.smoot.apple.com/static/spotlight_suggestions_phr... - "silhouette_topic_mapping": "https://cdn.smoot.apple.com/static/silhouette_topic_mapping/5/silhouette_topic_mapping?version=5 https://cdn.smoot.apple.com/static/silhouette_topic_mapping/..." - "silhouette_whitelisted_topics": "https://cdn.smoot.apple.com/static/silhouette_whitelisted_topics/5/silhouette_whitelisted_topics?version=5 https://cdn.smoot.apple.com/static/silhouette_whitelisted_to..." - "silhouette_config": "https://cdn.smoot.apple.com/static/silhouette_config/5/silhouette_config?version=5 https://cdn.smoot.apple.com/static/silhouette_config/5/silho..." - "dictionary_resources_url": "https://cdn.smoot.apple.com/static/dictionary_resources_url?version=d4546b111e90a1d7005fa43d34bd2f7b https://cdn.smoot.apple.com/static/dictionary_resources_url?..."
jedberg 5y ago
Funny enough this website is on the list.
atum47 5y ago
Oh, my website is not in it... Bummer
fy70 5y ago
explaingarlic 5y ago
If you're here, you've made it big.
kayodelycaon 5y ago
Interesting. There are several furry art communities listed, but Fur Affinity is not. Fur Affinity is the largest and most popular of these by a fair margin. Unrelated to the furry websites the above, there are some nsfw websites listed but other, more popular ones are strangely missing. (The word "porn" does not appear in the list.) redditenhancementsuite.com is also listed... which I did not expect. I suspect this list is run through a keyword filter and a blacklist before anything is added.
- sodality2 5y ago
  There is however several sites that redirect to "erotic film" and blatant porn sites (the domain name also references porn, so it's not like someone scooped up another random domain here). So, probably not manually curated...
innagadadavida 5y ago
rip parsec
forgotmypw17 5y ago
This thread wouldn't be complete without the mention of AOL Keywords.
ramsundhar20 5y ago
How can I get my domain added to this list? I would be great visibility for a upcoming Product.
victorantos 5y ago
Here is the autocomplete in action using Typeahead.js https://victorantos.github.io/typeahead.js/examples/ https://victorantos.github.io/typeahead.js/examples/
b__d 5y ago
I have the very strong feeling that this is is powered by https://register.apple.com/placesonmaps/ https://register.apple.com/placesonmaps/ – at least as a hint. As soon as you have officially registered your Apple Maps entry (with an website URL) that website gets on the list. e: This is reinforced since we updated our domain/URLs from a ccTLD to a gTLD not long ago, also claiming the Maps entry, and the list reflects the gTLD domain!

373 points by varenc 5y ago

250k is off by one, actually 249999 entries: $ curl -s https://cdn.smoot.apple.com/static/autofill_tld_whitelist_url | jq '.tlds|length' 249999

varenc 5y ago
Hah I appreciate your accuracy. I got 250k by running this: $ curl https://cdn.smoot.apple.com/static/autofill_tld_whitelist_url | jq | wc -l 250004 And then I naively assumed with the extra JSON brackets the total would be 250k but I wasn't thorough enough!

MrJagil 5y ago

How do you tell safari to ignore this list? When i want to go to discord safari insists on discoverykids.com. I (think) i have turned off all search-suggestions in settings.

lokimedes 5y ago

What is this for, and what should I do to get on, or off the list?

vishnugupta 5y ago
> What is this for Presumably to auto complete URLs, like "go" to "google.com", in Safari's address bar.
jml7c5 5y ago
I assume it's for pre-populating the address bar suggestions. Even on a fresh browser with no history, users probably want 'nyti' to complete to 'nytimes.com', for example.
- mproud 5y ago
  https://nyt.com https://nyt.com
  - jml7c5 5y ago
    For some reason I thought the NY Times didn't own nyt.com. I chose a poor example, apparently!
growt 5y ago
It looks like something not on this list gets suggested in mobile Safari, but not autocompleted (so on top of the screen it will show as a clickable link, but you will not see the complete url in the address field and be able to just go to it by hitting "enter").

dangero 5y ago

Anyone know how this list was created or how often it gets updated?

eyelidlessness 5y ago
My hunch was that it originated well before iOS, and could be traced back to forking KHTML, but if that hunch was right I can’t find any way to validate it.
- blowski 5y ago
  Agreed. Some of the domains there were popular 10-15 years ago, but are now relatively obscure. Meanwhile, high traffic domains that have emerged over the past few years are missing. Compare "pricerunner.com" and "tiktok.com" for example.
- svenpeter 5y ago
  The list was at least updated after iOS: I've found wiibrew.org and hackmii.com in there which are both Wii homebrew sites that became popular around 2008/2009 and probably declined in popularity starting in ~2012/2013. Then there's also wiiu-developers.nintendo.com and wiiudaily.com which probably didn't exist before late 2012 or early 2013 when the WiiU was released.
weinzierl 5y ago
This an interesting question. Skimming the list it seems that - at least - it is not based solely on popularity (like the Alexa 1 million list for example). I see lots of websites for small German towns, which should only have a couple of visitors per week. Of the blogs and personal websites I read - some popular, some less so - only paulgraham.com is there. I suspect the list is biased to official and very old domains.
- ultimoo 5y ago
  To add another data point: I couldn't find "substack" on there, and it's been around since 2017.

AraceliHarker 5y ago

na85 5y ago
Look I love to hate on Apple as much as the next guy but asking that question really doesn't seem like it's being done in good faith. Do you really think that Apple is subtly supporting an anti-Chinese, anti-Korean, pro-Japanese racist agenda through... an URL autocomplete list? Or is it more likely that it's a legacy list that has probably not been vetted by a human in quite some time if ever?
- kebab 5y ago
  It's still worth interrogating even if it's an oversight.
rvz 5y ago
Try asking Apple Japan.
rgj 5y ago
This is not a “list of allowed websites”.
- kebab 5y ago
  I don't think it makes a difference, if anything, it's worse that it's in their autocomplete list.
  - deleted 5y ago
    [deleted]
  - rgj 5y ago
    Yes, that does make a difference and no, it’s not. An autocomplete list is most likely generated based on statistics and contains sites that are being _used_, and an allow list is moderated and contains sites that are _condoned_.

drusepth 5y ago

Interesting side-note: there are only two *.ai domains on this entire list: 1. "tempo.ai", which doesn't actually resolve 2. "web.ai", an http-only site that looks kind of like a cross between a geocities website and a parked spam page, with the content allegedly last revised almost 20 years ago (2003) I wonder how old this list is.

deleted 5y ago
[deleted]
ricardobeat 5y ago
When I type “web.” it autocompletes to “web.archive.org”, I don’t think this list is up to date at all.
- playpause 5y ago
  Probably stuff in your own history takes precedence?
  - vesrah 5y ago
    Looks like it, my device autocompletes web. to web.whatsapp.com

bjarneh 5y ago

zombo.com is there :-)

mrtksn 5y ago
Of course it is, you can do anything at zombo.com

nabaraz 5y ago

Assuming this is a list for Apple's autocomplete feature on Safari and other apps, what damage can a hacker do if they were to maliciously update this file?

tcmb 5y ago
Homoglyph Attacks come to mind. Replace legitimate domains like nytimes.com with ones that look identical but lead to phishing sites. (The hacker would have to build those convincing phishing sites as well, of course...)
amenghra 5y ago
Not much if you use a password manager that checks the domain before auto filling and/or use U2F tokens as your 2nd factor. The threat model isn’t too different from other things that can happen if a malicious user is on the same network as you. The scale would be different though.

jafingi 5y ago

Ha! This explains why I always get "cookieandkate.com" suggested when I want to visit another site that starts with "cookie". I was extremely frustrated that it suggested that site with higher priotity than the one I actually visit mostly every day. And I had never myself gone to that site. Now I know why...

Bilal_io 5y ago
That's very strange, you'd expect Apple to provide a good UX by suggesting a website from your bookmarks, history and then their list. I wonder whether that's an oversight or an intentional implementation.
- dwighttk 5y ago
  Safari does use your bookmarks and your history, but at some point the history expires so some sites I go to rarely don’t autocomplete and I add bookmarks when I notice. Also it sometimes is too slow to pick up that I don’t want to go where it autocompleted, I hit go, then immediately hit back and typed more characters in to get the actual site I wanted. I could go and edit my history, but that process is a little clunky on my phone.
- quitit 5y ago
  That's exactly the behaviour I have when using iOS.
  - Bilal_io 5y ago
    I see. OP replies saying their history somehow expired, and the page wasn't bookmarked to begin with. So I stand corrected. Thank you
- ezfe 5y ago
  It does - some people always browse in Private Mode or have History off

i1856511 5y ago

"smoot" dot apple dot com?

gilgoomesh 5y ago
Doubtless named for The Smoot-Hawley Tariff Act which raised or lowered taxes? Anyone? Anyone?
- vulcan01 5y ago
  Raised tariffs, not taxes. It's an important difference, doubly so with regards to Smoot-Hawley because the whole point was to protect American companies (and therefore jobs) from foreign competition (of course, it did not work...).
  - gilgoomesh 5y ago
    (It was a Ferris Bueller's Day Off reference. Blame Ben Stein.)
    - vulcan01 5y ago
      ... and I have not yet seen Ferris Bueller, so I didn't get the reference. Consider us even ;)
xvector 5y ago
I see tons of DNS requests for this domain blocked by AdGuard. I wonder what it's for.
throwaway48375 5y ago
https://apple.stackexchange.com/questions/157424/what-are-api-smoot-apple-com-and-other-hosts-my-iphone-is-secretly-talking-to https://apple.stackexchange.com/questions/157424/what-are-ap...
blamazon 5y ago
Could be further immortalization of Oliver Smoot, “a fraternity pledge to Lambda Chi Alpha, who in October 1958 lay down repeatedly on the Harvard Bridge (between Boston and Cambridge, Massachusetts) so that his fraternity brothers could use his height to measure the length of the bridge, which summed to "364.4 Smoots ± 1 ear" https://en.wikipedia.org/wiki/Smoot https://en.wikipedia.org/wiki/Smoot

spiderfarmer 5y ago

My competitor is in this list and I'm not, even though my site is more popular. There even are some small Dutch campings, municipalities and regional football clubs on this list. It's a strange list for sure.

badestrand 5y ago
My website is in there but with a typo (people often make that mistake) :( The website with typo doesn't exist.
- brainlessdev 5y ago
  Can you buy the domain and redirect them?
  - autoexec 5y ago
    Periodically searching this list for purchasable domains seems like something scammers would be very very interested in. Honestly, apple should be making sure every one of these URLs goes to a live website and that the website is still exactly the website they intended it to be.
    - Wowfunhappy 5y ago
      > and that the website is still exactly the website they intended it to be. How could they realistically do that?
      - dolni 5y ago
        I am sure they can find a way with tens of billions in quarterly revenue.
        Wowfunhappy 5y ago
        Billions in quarterly revenue doesn't allow Apple to solve the halting problem. I can't begin to imagine how they would do what you're suggesting. They need to detect when a website changes in kind, but ignore day-to-day changes or normal UI revamps.

saagarjha 5y ago

Related list: https://cdn.smoot.apple.com/static/autofill_corrections_url https://cdn.smoot.apple.com/static/autofill_corrections_url

varenc 5y ago
hah I see we both discovered the same lists! Did you get these from traffic interception too? I didn't find any hits for these on Google but not surprised you beat me to it of course. I'm a long time fan of your apple-hacking blog posts. For others, here's the other ones found: - "correction_dict_url": "https://cdn.smoot.apple.com/static/static_corrections_dict/20200930/static_corrections_dict.json https://cdn.smoot.apple.com/static/static_corrections_dict/2..." - "crowdsourcing_blacklist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_blacklist_url https://cdn.smoot.apple.com/static/crowdsourcing_blacklist_u..." - "crowdsourcing_whitelist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_whitelist_url https://cdn.smoot.apple.com/static/crowdsourcing_whitelist_u..." - "spotlight_model_resources": "https://cdn.smoot.apple.com/static/spotlight_model_resources/2/spotlight_ml.mpak?version=2 https://cdn.smoot.apple.com/static/spotlight_model_resources..." - "spotlight_stopword.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_stopwords/4/stopwords-en.map?version=4 https://cdn.smoot.apple.com/static/spotlight_suggestions_sto..." - "spotlight_phrase_dictionary.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_phrase_dictionary/4/phrase-dictionary-en-US.map?version=4 https://cdn.smoot.apple.com/static/spotlight_suggestions_phr..." - "silhouette_topic_mapping": "https://cdn.smoot.apple.com/static/silhouette_topic_mapping/5/silhouette_topic_mapping?version=5 https://cdn.smoot.apple.com/static/silhouette_topic_mapping/..." - "silhouette_whitelisted_topics": "https://cdn.smoot.apple.com/static/silhouette_whitelisted_topics/5/silhouette_whitelisted_topics?version=5 https://cdn.smoot.apple.com/static/silhouette_whitelisted_to..." - "silhouette_config": "https://cdn.smoot.apple.com/static/silhouette_config/5/silhouette_config?version=5 https://cdn.smoot.apple.com/static/silhouette_config/5/silho..." - "dictionary_resources_url": "https://cdn.smoot.apple.com/static/dictionary_resources_url https://cdn.smoot.apple.com/static/dictionary_resources_url" Also I just realized that the source of all these doesn't require auth either and you can just view it here: https://api.smoot.apple.com/bag https://api.smoot.apple.com/bag (but requires a spoofed user-agent if you use cURL)

thyrox 5y ago

ravenstine 5y ago
> 2. Crippled and never let PWAs fully work because security and battery. How are PWAs insecure?
- colordrops 5y ago
  That one stuck out at me as well. The real reason is that it's a threat to their walled garden app store.
kome 5y ago
> The more I learn about open source the more i see their point.. Stallman is consistently mocked and diminished, but he is also consistently right.
- bayindirh 5y ago
  ...and we see what happens when we do the things he warns about in a consistent manner, yet people still continue to mock and ignore him. Sad.
- goodpoint 5y ago
  I never heard people mocking Stallman for his warnings about surveillance and curtailing user's freedoms. But his behavior in public and the way he communicates is a completely different topic and a can of worms...
2143 5y ago
I can't tell if you're being serious or sarcastic.
- IshKebab 5y ago
  Yeah, killing Flash at least was definitely a good thing. Not sure about the others! Strange comment.

genis 5y ago

rthtdhdh

harry8 5y ago

Wikileaks.org etc are in there. Leaving them out would be wrong IMHO. I'm not sure what to make of having them in there though.

petesergeant 5y ago
You should "make of" it that Apple consider it a popular domain people try and navigate to
- harry8 5y ago
  You think apple are above censorship at the behest of politicians?
  - aaaaaaaaata 5y ago
    Considering most of us didn't know about this list either, there simply wasn't anyone to ask for the censorship.
    - harry8 5y ago
      Various politicians have made their feelings known beyond any doubt. Note the lack of, say, pornhub etc in this list. Someone has sanitized it somehow and didn't pre-emptively censor wikileaks. That's a good thing, I guess?

zhte415 5y ago

Instead of doing any thoughtful analysis of this list, I'm treating it as a random web ring and clicking through to an eclectic bunch of sites. Currently on websites starting with 'joe'. Because Internet entropy is fun. More fun than a recommendation engine.

hyperdimension 5y ago
You reminded me of StumbleUpon. I miss that service dearly, or maybe I just miss that general era of the Internet.

dalbasal 5y ago

This is an interesting little example of how "systemic" happens, or can happen. The list exists initially to support a feature, a utilitarian reason. Then, being in the list has SEO value or some such. The list becomes a legitimacy or authority test. It affects traffic, sales. Maybe other stuff piggybacks this list. Anyone who needs a list of important domain names uses it. Ordering search results, caching, testing, crawling... More dynamics unrelated to Apple's original purpose. Meanwhile, Apple continues to treat the list as a relatively unimportant thing... Just a clunky little hack that enables autocomplete. At some point, willfully ignorant of a whole industry of professional services out there promising to get you on list.

nonrandomstring 5y ago
Yes, nice to see we've come full circle at last from Karp, Mills and Postel maintaining the official HOSTS.TXT throgh the "free internet era" and back to a nice sanitised, official list of what's on the internet.
blenderdt 5y ago
Ok, maybe I am missing something here. The link points to a list Apple is hosting without any context. Does anyone know why this list is hosted and what it is used for? Is it even used? Edit: some 7 year old posts suggest it was used by Spotlight. I also am a little amazed it loaded and scrolls smooth on Firefox mobile...
- jjoonathan 5y ago
  When I type "analog.com" into the search bar, I can imagine a way for autocomplete to go wrong. This list would prevent it from going wrong.
  - deleted 5y ago
    [deleted]
- zymhan 5y ago
  Can't say the same for Firefox on Windows, on a powerful PC :/

black_puppydog 5y ago

Ugh, I guess that's why the iOS browsers all suck so hard with autocomplete? I always long for Firefox's url bar, it easily beats everything else since Firefox 2 came out or so. Nowadays you have to un-configure two layers of "let's put a search bar in your URL bar" but then it's still just amazing. Especially compared to google, which obviously doesn't have an incentive to have you skip searching on google.com... and apparently apple doesn't want to you complete just any old urls, but only apple approved ones?! This seems like such a useless kind of (soft, but still) gate-keeping...

undefinedzero 5y ago
It seems like a useful privacy feature to me. I don't want Apple or Firefox to pass every site I visit every time I visit it to Google, Apple or any other company under US law.
- iggldiggl 5y ago
  Yes, although in principle this kind of list should only be necessary for fresh browsing profiles (plus people who don't keep a local browsing history). Once you've used the browser for a while, autocomplete should predominantly be powered by your local browsing history anyway. Firefox on Android e.g. used to (or still has – I'm not sure what the state is nowadays after the rewrite) have a similar (although somewhat smaller) list of popular domains which it would use for providing autocomplete results if it couldn't find anything in your history, but local history always had priority.
  - andybak 5y ago
    I switched to Firefox about a year ago but I'm really missing the autocomplete from Chrome. I guess sharing my entire digital life with Google had some upside after all. Joking aside - Firefox makes some strange choices and the I wish mobile and desktop could (optionally) share more of my browsing history. Maybe they do but the autocomplete doesn't behave the same across devices.
JimDabell 5y ago

JimWestergren 5y ago

Thanks a lot for the tip. I am going to add this to domainstats.com

oxplot 5y ago

Even with `xz --best`, you can only compress this down to 25% of its original size. I guess a more specialized text compressor that can get this to less than 10% would allow 2-3x more domains to be included.

smileybarry 5y ago

Oddly enough, tier 1 cell carriers that have agreements with Apple aren't immune to being forgotten by Apple. The list has "orange.co.il" (now NXDOMAIN) but not "partner.co.il". Partner (one of 4 main cell networks in Israel) used to be called Orange but they terminated that agreement with Orange FR years ago (which I'm guessing is why they can't redirect "orange.co.il" either).

ckue 5y ago

Interesting that the list contains URLs to piracy torrent sites (thepiratebay, etc.) and the Silk Road darknet market (defunct since 2013).

aaron695 5y ago
The other .onions are Silk Road 3 (Created 2015) and the Hidden Wiki which Wikipedia eventually refused to link to. These addresses are Onions v2 and now disabled in Tor.

lizardactivist 5y ago

I'm curious if this control over auto-complete can help direct users to websites that are favored or approved by Apple, and eventually change people's opinion of which sites are "good". In a way it's a slight step towards allowing or disallowing visiting certain websites. Is the owner of the phone allowed some control here?

vincnetas 5y ago
And i assume there are no adult content providers in that list. Who will autocomplete that for me :(
- lizardactivist 5y ago
  I agree! Typing on mobile with only one hand is the worst!

b215826 5y ago

> stallman.org, fsf.org, gnu.org Keep your friends close and your enemies closer. > breitbart.com, stormfront.org Lulz.

HellsMaddy 5y ago

I'm curious to see how this changes over time, so I threw together a quick repo with a GitHub action to watch the endpoint. https://github.com/b0o/apple-autofill-domains https://github.com/b0o/apple-autofill-domains

nly 5y ago
My bet is it's a manual update process once in a blue moon
hiccuphippo 5y ago
Interesting! Perhaps it could even post a comment to an issue so people can subscribe to it.
- HellsMaddy 5y ago
  Good idea! I’ve created an issue[0] that can be subscribed to, I will implement the feature soon. [0]: https://github.com/b0o/apple-autofill-domains/issues/1 https://github.com/b0o/apple-autofill-domains/issues/1
  - asah 5y ago
    Random q: why fetch depth 20?
    - HellsMaddy 5y ago
      That’s actually a bug, thank you. It will break as soon as the last modification to the data file is more than 20 commits behind HEAD. I used 20 because it made the workflow function (it was working on my local machine but not when I pushed to GitHub because the default depth is 1). I need to update it to check for the last commit that modified the json file rather than searching through the entire commit history.
jzelinskie 5y ago
You should be careful with the cron intervals because GitHub eventually just disabled one of the actions that I wrote that worked exactly like this. I was generating a list of the YouTube's dynamic ad-serving domains.

baud147258 5y ago

funny, I checked the different forums I hang around and the only one in the list is the smallest (in terms of user counts). Though maybe it's the most well-known/infamous outside of its direct niche?

Tutanota 5y ago

It looks like the list is very old. Tutanota.de is on it, but we've switched to using tutanota.com years ago...

digitalsin 5y ago
Hey thanks for making a great email service!

nathan_f77 5y ago

I noticed that tiktok.com is missing, so this list might have been compiled sometime before 2019. I wonder if you could write a script that pinpoints the exact month or even day.

nathan_f77 5y ago
I wrote a script: https://github.com/ndbroadbent/autofill_tld_whitelist_url_age_calculator https://github.com/ndbroadbent/autofill_tld_whitelist_url_ag... This attempts to scan WHOIS records for random domains in the list and try to find the most recent "registered at" date for a domain. It's very unreliable. The whois-parser Ruby gem thought that giants.it was created on 2020-11-03 09:00:01, but I checked the record and it looks like it was actually created on 2009-09-28 11:00:43. It looks like nature-in-art.org.uk was first registered on 21-Jul-2019 I don't know if this would provide any useful information. It would take at least a year for a brand new domain to make it into this list. And I don't know if the "created at" date can be trusted, maybe it gets reset whenever a domain is transferred, or lapses and then gets renewed. In conclusion, I don't think this idea works at all.

jp0d 5y ago

How does one get access to the direct URL to such a file?

donohoe 5y ago

I am guessing that this list has not been updated in years - or at least properly validated. For example, search for “nytimes.com”. Many of the subdomains haven’t been used in years - and are to blogs that were retired 6 or so years ago.

bhobs 5y ago

My employer is in this list, along with their main competitor. However, said competitor's domain is incorrect and links to a much smaller unrelated page.

amichal 5y ago

I was at first guessing this this might have had as a (partial) data source the hsts static preload list[1]. But, a domain I know we never submitted to it was on there while one which was submitted (but has since aged out) is not. Also these lists are so absurdly large [1] https://cs.chromium.org/chromium/src/net/http/transport_security_state_static.json https://cs.chromium.org/chromium/src/net/http/transport_secu...

bamboozled 5y ago

Whitelist is a controversial / potentially offensive term, can it be changed please to allow list to make it inclusive please.

truthwhisperer 5y ago
frankincense 5y ago
It's literally the name of the resource: https://cdn.smoot.apple.com/static/autofill_tld_whitelist_url https://cdn.smoot.apple.com/static/autofill_tld_whitelist_ur...
numlock86 5y ago
That's a hoax just like the "ok hand gesture" = "white power" debate. It started as a joke on 4ch, now everyone (even big tech) believes in it because of a few thousand (social) media reposts.
- hjkl0 5y ago
  You’re saying that the debate about the terms “whitelist” and “blacklist”, and presumably also “master” and “slave”, is a hoax?
digitalsin 5y ago
Oh good grief.
curt15 5y ago
In the same way that "master recording" or "master branch" or "mastering" are somehow not inclusive?
- numlock86 5y ago
  You'd be surprised how many people get offended (usually on behalf of others) by this these days ...

irrational 5y ago

Fascinating. I know of an organization that abandoned (other than redirects) their original domain name about 4 years ago and adopted a new domain name. The old domain name is in the list (with about 30 subdomains!), but the new domain is not in the list at all. This makes me wonder how (if) the list is updated.

varenc 5y ago

OP here. I found this URL by intercepting traffic on my older jailbroken iOS device. It's possible that a more recent version of iOS doesn't use it. This url, among others, was returned in some configuration-fetching call to https://api.smoot.apple.com/bag https://api.smoot.apple.com/bag (which requires auth) Here's some other ones: - "correction_dict_url": "https://cdn.smoot.apple.com/static/static_corrections_dict/20200930/static_corrections_dict.json?version=20200930 https://cdn.smoot.apple.com/static/static_corrections_dict/2..." - "crowdsourcing_blacklist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_blacklist_url?version=2ca06afd0850f1f42695f6b6928dc0f4 https://cdn.smoot.apple.com/static/crowdsourcing_blacklist_u..." - "crowdsourcing_whitelist_url": "https://cdn.smoot.apple.com/static/crowdsourcing_whitelist_url?version=032857ed01170d11e723650d446758bd https://cdn.smoot.apple.com/static/crowdsourcing_whitelist_u..." - "spotlight_model_resources": "https://cdn.smoot.apple.com/static/spotlight_model_resources/2/spotlight_ml.mpak?version=2 https://cdn.smoot.apple.com/static/spotlight_model_resources..." - "spotlight_stopword.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_stopwords/4/stopwords-en.map?version=4 https://cdn.smoot.apple.com/static/spotlight_suggestions_sto..." - "spotlight_phrase_dictionary.map": "https://cdn.smoot.apple.com/static/spotlight_suggestions_phrase_dictionary/4/phrase-dictionary-en-US.map?version=4 https://cdn.smoot.apple.com/static/spotlight_suggestions_phr... - "silhouette_topic_mapping": "https://cdn.smoot.apple.com/static/silhouette_topic_mapping/5/silhouette_topic_mapping?version=5 https://cdn.smoot.apple.com/static/silhouette_topic_mapping/..." - "silhouette_whitelisted_topics": "https://cdn.smoot.apple.com/static/silhouette_whitelisted_topics/5/silhouette_whitelisted_topics?version=5 https://cdn.smoot.apple.com/static/silhouette_whitelisted_to..." - "silhouette_config": "https://cdn.smoot.apple.com/static/silhouette_config/5/silhouette_config?version=5 https://cdn.smoot.apple.com/static/silhouette_config/5/silho..." - "dictionary_resources_url": "https://cdn.smoot.apple.com/static/dictionary_resources_url?version=d4546b111e90a1d7005fa43d34bd2f7b https://cdn.smoot.apple.com/static/dictionary_resources_url?..."

jedberg 5y ago

Funny enough this website is on the list.

atum47 5y ago

Oh, my website is not in it... Bummer

fy70 5y ago

explaingarlic 5y ago

If you're here, you've made it big.

kayodelycaon 5y ago

Interesting. There are several furry art communities listed, but Fur Affinity is not. Fur Affinity is the largest and most popular of these by a fair margin. Unrelated to the furry websites the above, there are some nsfw websites listed but other, more popular ones are strangely missing. (The word "porn" does not appear in the list.) redditenhancementsuite.com is also listed... which I did not expect. I suspect this list is run through a keyword filter and a blacklist before anything is added.

sodality2 5y ago
There is however several sites that redirect to "erotic film" and blatant porn sites (the domain name also references porn, so it's not like someone scooped up another random domain here). So, probably not manually curated...

innagadadavida 5y ago

rip parsec

forgotmypw17 5y ago

This thread wouldn't be complete without the mention of AOL Keywords.

ramsundhar20 5y ago

How can I get my domain added to this list? I would be great visibility for a upcoming Product.

victorantos 5y ago

Here is the autocomplete in action using Typeahead.js https://victorantos.github.io/typeahead.js/examples/ https://victorantos.github.io/typeahead.js/examples/

b__d 5y ago

I have the very strong feeling that this is is powered by https://register.apple.com/placesonmaps/ https://register.apple.com/placesonmaps/ – at least as a hint. As soon as you have officially registered your Apple Maps entry (with an website URL) that website gets on the list. e: This is reinforced since we updated our domain/URLs from a ccTLD to a gTLD not long ago, also claiming the Maps entry, and the list reflects the gTLD domain!