4 ms·

> The mystery of there being more ID numbers in the breach than people in SA Do you have a reference for this? From what I've seen, Troy managed to restore 31

> The mystery of there being more ID numbers in the breach than people in SA Do you have a reference for this? From what I've seen, Troy managed to restore 31.6 million records, and said previously that the full backup seems to have 45 million. There last national census (2011) put the (current, living) population at 51.7 million, and rapidly growing. Granted, many of those are not of home ownership age, but the ballpark is very close all of a sudden (especially if you include the deceased). There's also the question of whether those records are unique ID numbers; from what I understand (based on discussions of colleagues who work with actual SA deeds data), each record represents one status change in title deed of a property. So, each property purchase you've made will be in there as a row, with some people in there dozens of times. Edit: I see he talks about 60 million rows; though I wonder if the statement about uniqueness is correct. Since the table he refers to seems to have two columns with the letters "ID" in it, I'd wager that the first one is a simple autonumber, and the second one is the actual ID number. But who knows, he's the one with the data.

SideburnsOfDoom 9y ago
> Do you have a reference for this? From what I've seen, Troy managed to restore 31.6 million records, and said previously that the full backup seems to have 45 million the reference for an update on those numbers is in the article linked above. He later got all the data in. From TFA: "My original import of the South African "Master Deeds" data didn't complete. Just ran a complete one: 60,323,827 rows with unique gov IDs."
- danielbarla 9y ago
  I noticed that just after posting; made an edit though. Since he's basing that on a row count, I'm not convinced it's necessarily unique IDs. To be fair, I don't have the data, and he does. We do like our autonumbers here in SA, so I wouldn't be surprised, despite the column name.
  - SideburnsOfDoom 9y ago
    The row count is puzzling, yes. There simply are not that many property-owning South African citizens. Some expats are known to be in that data. Then there are the rows marked deceased. But as others have pointed out, so many South African citizens (out of the circa 55 million) are poor and are not property owners. The 60 million rows of data hasn't been comprehensively accounted for yet.
    - danielbarla 9y ago
      Yepp. As far as I can tell, about 15 million of the population are in the 0 to 14 age group, so are highly unlikely to appear on a deed (not sure if it's even technically possible). The total number of properties in the country has got to be a fraction of that; the average number of people per home is apparently at 2.2 [1]. Stats SA seems to report in the region of 400 to 500K deaths per year, so if it was just down to deceased, it'd have to go back a fairly long way. [1] - https://www.arcgis.com/home/item.html?id=582208ececa2424ab6e387d9cdcf01e3 https://www.arcgis.com/home/item.html?id=582208ececa2424ab6e...
thrwway_x34 9y ago
>Do you have a reference for this Yes, the article. >There's also the question of whether those records are unique ID numbers Primary key contraints, plus they name of the column "NEW_IDN" (see GP) would strongly suggest that this is the case. It could be an autonumber, but NEW_IDN as a column name has a clear meaning. Also I think Troy would know how to check for duplicates.

SideburnsOfDoom 9y ago

> Do you have a reference for this? From what I've seen, Troy managed to restore 31.6 million records, and said previously that the full backup seems to have 45 million the reference for an update on those numbers is in the article linked above. He later got all the data in. From TFA: "My original import of the South African "Master Deeds" data didn't complete. Just ran a complete one: 60,323,827 rows with unique gov IDs."

danielbarla 9y ago
I noticed that just after posting; made an edit though. Since he's basing that on a row count, I'm not convinced it's necessarily unique IDs. To be fair, I don't have the data, and he does. We do like our autonumbers here in SA, so I wouldn't be surprised, despite the column name.
- SideburnsOfDoom 9y ago
  The row count is puzzling, yes. There simply are not that many property-owning South African citizens. Some expats are known to be in that data. Then there are the rows marked deceased. But as others have pointed out, so many South African citizens (out of the circa 55 million) are poor and are not property owners. The 60 million rows of data hasn't been comprehensively accounted for yet.
  - danielbarla 9y ago
    Yepp. As far as I can tell, about 15 million of the population are in the 0 to 14 age group, so are highly unlikely to appear on a deed (not sure if it's even technically possible). The total number of properties in the country has got to be a fraction of that; the average number of people per home is apparently at 2.2 [1]. Stats SA seems to report in the region of 400 to 500K deaths per year, so if it was just down to deceased, it'd have to go back a fairly long way. [1] - https://www.arcgis.com/home/item.html?id=582208ececa2424ab6e387d9cdcf01e3 https://www.arcgis.com/home/item.html?id=582208ececa2424ab6e...

thrwway_x34 9y ago

>Do you have a reference for this Yes, the article. >There's also the question of whether those records are unique ID numbers Primary key contraints, plus they name of the column "NEW_IDN" (see GP) would strongly suggest that this is the case. It could be an autonumber, but NEW_IDN as a column name has a clear meaning. Also I think Troy would know how to check for duplicates.