4 ms·

I'm not near a computer at the moment, can any body tell me how the performance is with very large files (>20mb) compared to the previous releases? If there wa

by SCdF 14y ago

I'm not near a computer at the moment, can any body tell me how the performance is with very large files (>20mb) compared to the previous releases? If there was one thing that disappointed me about ST2 it was that it wasn't very competent with massive log files and the like. ATM I use an ide for Java, ST2 for nearly everything else (other languages, random text) and less / vi / others for logs and other massive files. Would love to be able to kill off another tool.

veidr 14y ago
I just opened a 49.8MB log file and the ST3 beta took 6 seconds to open it. The app can open/edit other files while this initial loading happens. For fun I tried some other editors (this is on OS X): BBEdit 10.5: instant vim 7.3: instant TextEdit 1.8: instant Textmate 2.0.0a9351: hung the entire app for 15 seconds ST2: 9 seconds So yeah, ST3 still seems to fare pretty poorly in this regard.
- swah 14y ago
  Probably something related to the new symbol parsing?
  - Dirlewanger 14y ago
    Doubt it. Problem exists in ST2 as well. I have a ~200MB ETL file I've been working with recently...takes ST2 around 20 seconds to open it.
- SCdF 14y ago
  Bah, yeah, so that's my biggest gripe with ST.. it seems to want to load the whole file into memory before it lets you work with it. I'm not sure if that's a philosophical thing or a limitation of how ST works, but it's really annoying. If he worked out a robust way to have file open performance on par with the likes of vim then I'd upgrade in a heartbeat.
Jare 14y ago
Sadly, in the announcement comments, John says this: "How well large files are supported is mostly a function of the syntax definition being used. Sublime Text 3 does have performance improvements compared to Sublime Text 2 here, but not significantly so." Big disappointment for a lot of us.
- PeterisP 14y ago
  It would be a couple of lines to check if the file is above some limit and offer an option to open it without the syntax definition applied. If I work with many small SQL/XML/whatever files, then I want it to look pretty; but if I open a 100+ mb datadump, then Sublime should be able to open it as plain text without waiting for half an hour. There are valid text files floating around with sizes above 1gb - why shouldn't I be able to open it, run searches and browse the contents? The computing power can do it, you can map it to memory if needed, I can spare 10gb ram if working on that size of data; but it needs to work reasonably fast.
  - Jare 14y ago
    I suspect the slowdown when opening a 100mb .txt file is not really in syntax parsing - it's "Plain Text", no syntax definition attached.
    - PeterisP 14y ago
      I was unclear in the description - my datadump gb's tend to be sql or xml. Turning syntax off helps; simply it's a real pain to switch it on/off manually every time, as I'm working both with small and large files of the same type. I'd like the software to do that automagically based on file size or loading time estimates.
- dnos 14y ago
  Yes, I am very disappointed. I cannot comprehend how the handling of large files hasn't been addressed yet. I really hope at least there is a setting for toggling the syntax on/off based on file size, if nothing else. I mean seriously, DOS' EDIT.EXE is better than Sublime Text in this regard. It almost makes me want to punch a wall or something, all because of a text editor.
JonnieCache 14y ago
I just pushed a ~100mb SQL file into it and it doesn't seem very pleased about it. The progress bar is crawling along, it's probably going to take like 5 minutes or something. Vim does perfectly fine for the odd occasion I need to do something like that (very large files often mean you're Doing It Wrong™)
Strom 14y ago
I'd say files up to 100MB work reasonably well, but when getting to the 500MB/1GB range, I need bust out a more performant editor, especially for find/replace. This is one of my main problems with this otherwise excellent editor.
ditoa 14y ago
Sublime was never very good with large files in my experience. UltraEdit has always been the best for that (if you are a Windows user, I don't know if the Mac and Linux versions perform as well).
c10n 14y ago
Upvote here: http://sublimetext.userecho.com/topic/98149-use-memory-mapped-files-for-opening-and-viewing-large-files-eg-1gb/ http://sublimetext.userecho.com/topic/98149-use-memory-mappe...

by SCdF 14y ago

veidr 14y ago

I just opened a 49.8MB log file and the ST3 beta took 6 seconds to open it. The app can open/edit other files while this initial loading happens. For fun I tried some other editors (this is on OS X): BBEdit 10.5: instant vim 7.3: instant TextEdit 1.8: instant Textmate 2.0.0a9351: hung the entire app for 15 seconds ST2: 9 seconds So yeah, ST3 still seems to fare pretty poorly in this regard.

swah 14y ago
Probably something related to the new symbol parsing?
- Dirlewanger 14y ago
  Doubt it. Problem exists in ST2 as well. I have a ~200MB ETL file I've been working with recently...takes ST2 around 20 seconds to open it.
SCdF 14y ago
Bah, yeah, so that's my biggest gripe with ST.. it seems to want to load the whole file into memory before it lets you work with it. I'm not sure if that's a philosophical thing or a limitation of how ST works, but it's really annoying. If he worked out a robust way to have file open performance on par with the likes of vim then I'd upgrade in a heartbeat.

Jare 14y ago

Sadly, in the announcement comments, John says this: "How well large files are supported is mostly a function of the syntax definition being used. Sublime Text 3 does have performance improvements compared to Sublime Text 2 here, but not significantly so." Big disappointment for a lot of us.

PeterisP 14y ago
It would be a couple of lines to check if the file is above some limit and offer an option to open it without the syntax definition applied. If I work with many small SQL/XML/whatever files, then I want it to look pretty; but if I open a 100+ mb datadump, then Sublime should be able to open it as plain text without waiting for half an hour. There are valid text files floating around with sizes above 1gb - why shouldn't I be able to open it, run searches and browse the contents? The computing power can do it, you can map it to memory if needed, I can spare 10gb ram if working on that size of data; but it needs to work reasonably fast.
- Jare 14y ago
  I suspect the slowdown when opening a 100mb .txt file is not really in syntax parsing - it's "Plain Text", no syntax definition attached.
  - PeterisP 14y ago
    I was unclear in the description - my datadump gb's tend to be sql or xml. Turning syntax off helps; simply it's a real pain to switch it on/off manually every time, as I'm working both with small and large files of the same type. I'd like the software to do that automagically based on file size or loading time estimates.
dnos 14y ago
Yes, I am very disappointed. I cannot comprehend how the handling of large files hasn't been addressed yet. I really hope at least there is a setting for toggling the syntax on/off based on file size, if nothing else. I mean seriously, DOS' EDIT.EXE is better than Sublime Text in this regard. It almost makes me want to punch a wall or something, all because of a text editor.

JonnieCache 14y ago

I just pushed a ~100mb SQL file into it and it doesn't seem very pleased about it. The progress bar is crawling along, it's probably going to take like 5 minutes or something. Vim does perfectly fine for the odd occasion I need to do something like that (very large files often mean you're Doing It Wrong™)

Strom 14y ago

I'd say files up to 100MB work reasonably well, but when getting to the 500MB/1GB range, I need bust out a more performant editor, especially for find/replace. This is one of my main problems with this otherwise excellent editor.

ditoa 14y ago

Sublime was never very good with large files in my experience. UltraEdit has always been the best for that (if you are a Windows user, I don't know if the Mac and Linux versions perform as well).

c10n 14y ago

Upvote here: http://sublimetext.userecho.com/topic/98149-use-memory-mapped-files-for-opening-and-viewing-large-files-eg-1gb/ http://sublimetext.userecho.com/topic/98149-use-memory-mappe...