4 ms·
How would you handle schema migrations in a system like this?
by zaking17 3y ago
How would you handle schema migrations in a system like this?
- ananthakumaran 3y agoIt depends on the layer, some of the layers might be able to take advantage of how the data is persisted. For example, if you use avro/protobuf, the decoder will handle it for you. If that's not the case, you would have to implement the migration by yourself. There is a paper[1] on this subject called "Online, asynchronous schema change in F1", which explains how to implement it. 1: https://dl.acm.org/doi/abs/10.14778/2536222.2536230 https://dl.acm.org/doi/abs/10.14778/2536222.2536230
- zaking17 3y agothanks, i'm really enjoying that paper