3 ms·
We used this model to distribute translations, feature flags, configuration, search indexes, etc at Airbnb. But instead of SQLite we used Sparkey, a KV file for
by jitl 2y ago
We used this model to distribute translations, feature flags, configuration, search indexes, etc at Airbnb. But instead of SQLite we used Sparkey, a KV file format developed by Spotify. In early years there was a Cron job on every box that pulled that service’s thingies; then once we switched to Kubernetes we used a deamomset & host tagging (taints?) to pull a variety of thingies to each host and then ensure the services that use the thingies only ran on the hosts that had the thingies.
In Ruby we called this “hammerspace” https://github.com/airbnb/hammerspace https://github.com/airbnb/hammerspace
- michaelbuckbee 2y ago1. Very cool 2. If you were making it today would you just use SQLite?
- skevy 2y agoYes, we would. And likely will switch to SQLite at some point in the future. (source, I work adjacent to these systems at Airbnb)
- otterley 2y agoIn Kubernetes, pod affinities (not taints) are the typical and preferred mechanism used to ensure pods are scheduled on the same node as their dependencies.