3 ms·

Can anyone explain the following bit: "They’re cleanly partitioned into 20 million data separate data sets, one per user." Does it mean they have a database pe

• daleharvey 15y ago
  Not likely, but they can very easily have a database holding all users with id starting with 'a'
  • driverdan 15y ago
    That's a really bad method of sharding. Names do not distribute equally over the alphabet.
• swah 15y ago
  Their SQL is executed per user, so they only touch around 1/20M the size of the database for any request.
• herge 15y ago
  It means that the data from one user has no relations to the data from another user. So most if not all their queries only query the data of one user. This is really useful for things like sharding, where you can split a database table onto more than one machine, because there will be few queries that will stall fetching data from one machine to another.
• driverdan 15y ago
  Why not have a database for each user? Evernote's data is partitioned perfectly for that. Notebooks and notes are accessible to one user or are public. There is no sharing notes between users.
  • mitchellhislop 15y ago
    There is sharing notes between users though - I have several shared notebooks, each holding shared notes.
    • ThaddeusQuay2 15y ago
      Actually, his idea of a database for each user could still work, even though there is sharing of data between users. Take each database, and turn it into an executable object, which reads/writes its own data, and which communicates with other objects for sharing. It's like taking the actor model of computation, and orienting it for database use. I don't know of any working example of where this has been done, but I don't see why it wouldn't be feasible. http://en.wikipedia.org/wiki/Actor_model http://en.wikipedia.org/wiki/Actor_model
• brown9-2 15y ago
  http://blog.evernote.com/tech/2011/05/17/architectural-digest/# http://blog.evernote.com/tech/2011/05/17/architectural-diges...