3 ms·
That doesn’t sound like a text file. Sounds like you have the world’s least convenient database. You’re on your own with that one. Sounds like a job for SQLite
by josephg 3y ago
That doesn’t sound like a text file. Sounds like you have the world’s least convenient database.
You’re on your own with that one. Sounds like a job for SQLite, not a rope library.
- KerrAvon 3y agoDude. TFA is literally about the core data structures for a text editor. Many people care about large text files. It's something people actually do. BBEdit on the Mac can edit files much larger than RAM without thrashing. If you don't want to support text editors, that's fine, but then what is your rope library for?
- josephg 3y agoGood question. I wrote it to support my work on highly efficient text CRDTs for collaborative editing. I wrote a blog post about it a few years ago, though this is out of date now since I’ve made so many new performance improvements: https://josephg.com/blog/crdts-go-brrr/ https://josephg.com/blog/crdts-go-brrr/
- alpaca128 3y agoI've reformatted 1GB files with a Vim macro in the past, weeks ago I processed 3-4GB JSON files, it's not that unusual nowadays if you work with a bit of data. Though note that in many cases long lines are also important to consider - many editors struggle hard and become near unusable if the line on screen is e.g. 1MB long (which again isn't as uncommon as you'd think).
- eviks 3y agoIndeed. Do you know which editors don't blink working with a 1gb-1line json file?
- roland35 3y agoI like big json files and I can not lie! All the other programmers can't deny! When I load json with an itty bitty schema...