3 ms·
I made the mistake of copying a node project I was working on.... holy cow does Backup and Sync choke on all those tiny JavaScript files. It started syncing an
by duxup 7y ago
I made the mistake of copying a node project I was working on.... holy cow does Backup and Sync choke on all those tiny JavaScript files.
It started syncing and just couldn't stop.
I had to delete or move all the Backup and Sync contents across my devices to get to 0 before it quit endlessly thrashing.
- manigandham 7y agoDropbox still has the best sync tech and is the only one that can handle deep and numerous file hierarchies. The rest have better pricing and integrations like email/productivity apps.
- fireattack 7y agoCan confirm. I have to move all my node projects to Dropbox for this particular reason.
- cerved 7y agoAre you putting `node_modules` in cloud storage?
- fireattack 7y agoYes. I knew you could use git and install modules on each end separately, but putting the whole thing in sync is just more convenient for some personal toy projects.
- duxup 7y agoThanks for the tip!
- brnt 7y agoActually, Resilio is not any slower than Dropbox. Syncthing is also faster thans any commercial offering I ever tried. Even Nextcloud sync is fast after an initial init.
- manigandham 7y agoWhat exactly are you referring to? Upload speed? That's not the issue. Dropbox is the best at crawling a very complex directory structure with millions of files and diffing it efficiently with the server and other clients, and then transferring all the individual changes. Nothing else comes close. And their write-ups show the work involved: https://dropbox.tech/infrastructure/rewriting-the-heart-of-our-sync-engine https://dropbox.tech/infrastructure/rewriting-the-heart-of-o... https://dropbox.tech/infrastructure/-testing-our-new-sync-engine https://dropbox.tech/infrastructure/-testing-our-new-sync-en...
- brnt 7y agoIndexing. Dropbox is slower than Resilio in my experience, and for shares with 100k-1M files, many small. But also throughput is good.
- fireattack 7y agoOn my laptop (an old Ultrabook), GDrive Sync and Backup will literally take 30+ minutes on "process files" (while using 30% cpu and high disk I/O) every time I reboot. Also its UI (IIRC written in Python) often fails to load (give you a blank box).