10 ms·

Sublime Text handles large files with ease. I routinely hand edit 5MB CSV files (with a color-coding plugin) and have had zero performance issues.

bacondude3 8y ago
What plugin? I've been trying to find a good CSV plugin for Sublime.
- vehemenz 8y ago
  rainbow_csv
de_Selby 8y ago
I'm not arguing for or against sublime's performace, but I'd suggest you need to redefine what a large file is!
- acidburnNSA 8y ago
  For example in the nuclear industry we regularly view and edit 1 GB text file inputs and outputs from chain reactor simulators. Vim, grep, tail -f, and awk, and Python are all essential tools in our belts.
  - kamaal 8y ago
    Wow! That's the coolest thing I've read in a while. I can only imagine how much fun it must be to work as a Nuclear Physicist.
- vehemenz 8y ago
  The author of the article was having issues with a 1.5MB file. 5MB is substantially larger than that!
danmg 8y ago
5MB isn't big.
- dredmorbius 8y ago
  That's book-length text.
  - nickjj 8y ago
    For context 900,000 words is ~5MB of text which is roughly 2,500 to 3,200 pages depending on font size and spacing. That's a big book!
    - danmg 8y ago
      This is like saying that a spreadsheet with 26 columns and 1000 rows is big data, because it's larger than the budget of a city. It's really not big until you have to worry about memory mapping parts of it from disk just to view it.
      - dredmorbius 8y ago
        "Big" doesn't strictly refer to informaion technology contexts. User / usage context also matters. For text, a byte is (roughly) a letter, 8 bytes about a word, 32 - 64 bytes a typical sentence, 140 bytes a tweet, 500 bytes the text that will fit on an index card, and 2.4 kB about a page of text (40 lines of 60 characters, about 250 words). Ten pages is a mid-length essay (25 kB, 2500 words), 100 pages a monograph or short novel (250 kB, 25,000 words), and 1,000 pages a sizeable book (2.5 MB, 250,000 words). As we extend from there, we're talking about shelves, aisles, floors, and libraries worth of content. My initial "5 MB is about a book" coment comes from experience with formatted textual (rather than graphical/raster) PDFs of books. The sum total of published human writing is modest by present data standards. The 24 million books of the U.S. Library of Congress, as extual PDFs, would occupy less than 120 TB of storage, about $6,000 at current prices. Reading that -- by humans, not machines -- might keep you up a few nights. When writing large literary works, the problems are far less with tthe computing than the authoring: developing and expressing ideas clearly, consistently, and effectively. The constraints on writing tools are imposed by wetware and cranial hardware, not silicon and software.
deleted 8y ago
[deleted]

bacondude3 8y ago

What plugin? I've been trying to find a good CSV plugin for Sublime.

vehemenz 8y ago
rainbow_csv

de_Selby 8y ago

I'm not arguing for or against sublime's performace, but I'd suggest you need to redefine what a large file is!

acidburnNSA 8y ago
For example in the nuclear industry we regularly view and edit 1 GB text file inputs and outputs from chain reactor simulators. Vim, grep, tail -f, and awk, and Python are all essential tools in our belts.
- kamaal 8y ago
  Wow! That's the coolest thing I've read in a while. I can only imagine how much fun it must be to work as a Nuclear Physicist.
vehemenz 8y ago
The author of the article was having issues with a 1.5MB file. 5MB is substantially larger than that!

danmg 8y ago

5MB isn't big.

dredmorbius 8y ago
That's book-length text.
- nickjj 8y ago
  For context 900,000 words is ~5MB of text which is roughly 2,500 to 3,200 pages depending on font size and spacing. That's a big book!
  - danmg 8y ago
    This is like saying that a spreadsheet with 26 columns and 1000 rows is big data, because it's larger than the budget of a city. It's really not big until you have to worry about memory mapping parts of it from disk just to view it.
    - dredmorbius 8y ago
      "Big" doesn't strictly refer to informaion technology contexts. User / usage context also matters. For text, a byte is (roughly) a letter, 8 bytes about a word, 32 - 64 bytes a typical sentence, 140 bytes a tweet, 500 bytes the text that will fit on an index card, and 2.4 kB about a page of text (40 lines of 60 characters, about 250 words). Ten pages is a mid-length essay (25 kB, 2500 words), 100 pages a monograph or short novel (250 kB, 25,000 words), and 1,000 pages a sizeable book (2.5 MB, 250,000 words). As we extend from there, we're talking about shelves, aisles, floors, and libraries worth of content. My initial "5 MB is about a book" coment comes from experience with formatted textual (rather than graphical/raster) PDFs of books. The sum total of published human writing is modest by present data standards. The 24 million books of the U.S. Library of Congress, as extual PDFs, would occupy less than 120 TB of storage, about $6,000 at current prices. Reading that -- by humans, not machines -- might keep you up a few nights. When writing large literary works, the problems are far less with tthe computing than the authoring: developing and expressing ideas clearly, consistently, and effectively. The constraints on writing tools are imposed by wetware and cranial hardware, not silicon and software.

deleted 8y ago

[deleted]