3 ms·
The default Python allocator experiences a lot of fragmentation over time, leading to sparse memory packing. Dropbox implemented a custom allocator with differ
by Scaevolus 9y ago
The default Python allocator experiences a lot of fragmentation over time, leading to sparse memory packing.
Dropbox implemented a custom allocator with different types and sizes getting their own arenas, leading to long term memory stability. Even controlling all their own code, processing millions of file paths, metadata, and buffers inevitably lead to memory leaks.