4 ms·

Anyone know how this list was created or how often it gets updated?

eyelidlessness 5y ago
My hunch was that it originated well before iOS, and could be traced back to forking KHTML, but if that hunch was right I can’t find any way to validate it.
- blowski 5y ago
  Agreed. Some of the domains there were popular 10-15 years ago, but are now relatively obscure. Meanwhile, high traffic domains that have emerged over the past few years are missing. Compare "pricerunner.com" and "tiktok.com" for example.
- svenpeter 5y ago
  The list was at least updated after iOS: I've found wiibrew.org and hackmii.com in there which are both Wii homebrew sites that became popular around 2008/2009 and probably declined in popularity starting in ~2012/2013. Then there's also wiiu-developers.nintendo.com and wiiudaily.com which probably didn't exist before late 2012 or early 2013 when the WiiU was released.
weinzierl 5y ago
This an interesting question. Skimming the list it seems that - at least - it is not based solely on popularity (like the Alexa 1 million list for example). I see lots of websites for small German towns, which should only have a couple of visitors per week. Of the blogs and personal websites I read - some popular, some less so - only paulgraham.com is there. I suspect the list is biased to official and very old domains.
- ultimoo 5y ago
  To add another data point: I couldn't find "substack" on there, and it's been around since 2017.
myfonj 5y ago
At this moment, Last-Modified HTTP header reads `Wed, 30 Mar 2022 02:27:02 GMT` (5 days back).
new299 5y ago
The strangest thing about this list for me is that it contains multiple .onion addresses. It also seems to have been at least somewhat filtered for "objectionable" content (porn etc.). I assume it must have come from user searches at some point?
- yreg 5y ago
  There are also seven pirate bays.
varenc 5y ago
My guess actually is that iOS/Apple no longer uses this particular list. I found this by intercepting traffic on an older jailbroken iOS 13 device. Given how old some of the domains in the list are, I'd guess that iOS 15 no longer uses it. I also never actually saw my phone fetch this list, I just saw this URL in another configuration response. tl;dr; I bet it'll never get updated. (but some similar list at a more hidden/protected location likely will be) p.s. this list of common spelling corrections is interesting too: https://cdn.smoot.apple.com/static/static_corrections_dict/20200930/static_corrections_dict.json https://cdn.smoot.apple.com/static/static_corrections_dict/2...

My hunch was that it originated well before iOS, and could be traced back to forking KHTML, but if that hunch was right I can’t find any way to validate it.

blowski 5y ago
Agreed. Some of the domains there were popular 10-15 years ago, but are now relatively obscure. Meanwhile, high traffic domains that have emerged over the past few years are missing. Compare "pricerunner.com" and "tiktok.com" for example.
svenpeter 5y ago
The list was at least updated after iOS: I've found wiibrew.org and hackmii.com in there which are both Wii homebrew sites that became popular around 2008/2009 and probably declined in popularity starting in ~2012/2013. Then there's also wiiu-developers.nintendo.com and wiiudaily.com which probably didn't exist before late 2012 or early 2013 when the WiiU was released.

weinzierl 5y ago

This an interesting question. Skimming the list it seems that - at least - it is not based solely on popularity (like the Alexa 1 million list for example). I see lots of websites for small German towns, which should only have a couple of visitors per week. Of the blogs and personal websites I read - some popular, some less so - only paulgraham.com is there. I suspect the list is biased to official and very old domains.

ultimoo 5y ago
To add another data point: I couldn't find "substack" on there, and it's been around since 2017.

myfonj 5y ago

At this moment, Last-Modified HTTP header reads `Wed, 30 Mar 2022 02:27:02 GMT` (5 days back).

new299 5y ago

The strangest thing about this list for me is that it contains multiple .onion addresses. It also seems to have been at least somewhat filtered for "objectionable" content (porn etc.). I assume it must have come from user searches at some point?

yreg 5y ago
There are also seven pirate bays.

varenc 5y ago

My guess actually is that iOS/Apple no longer uses this particular list. I found this by intercepting traffic on an older jailbroken iOS 13 device. Given how old some of the domains in the list are, I'd guess that iOS 15 no longer uses it. I also never actually saw my phone fetch this list, I just saw this URL in another configuration response. tl;dr; I bet it'll never get updated. (but some similar list at a more hidden/protected location likely will be) p.s. this list of common spelling corrections is interesting too: https://cdn.smoot.apple.com/static/static_corrections_dict/20200930/static_corrections_dict.json https://cdn.smoot.apple.com/static/static_corrections_dict/2...