3 ms·
Do a ton of excel work - the 1m row limit is surprisingly low. And sharding across worksheets is miserable in my view
by random5634 5y ago
Do a ton of excel work - the 1m row limit is surprisingly low. And sharding across worksheets is miserable in my view
- edrobap 5y agoIt amuses me how the low limit nature of Excel has affected the ecosystem around it. Apache POI, which is a popular library to operate on Excel files, has a weird 4GB limit [1] on uncompressed file size. throw new IllegalArgumentException("Max entry size is bounded [0-4GB], but had " + maxEntrySize); [1] https://svn.apache.org/viewvc/poi/tags/REL_5_0_0/src/ooxml/java/org/apache/poi/openxml4j/util/ZipSecureFile.java?revision=1885418&view=markup https://svn.apache.org/viewvc/poi/tags/REL_5_0_0/src/ooxml/j...
- simias 5y agoWhat makes you think this limitation is related to Excel? 4GiB is a very common limit due to it being the max size you can fit on a 32bit integer. It's the max file size on FAT32 as well for instance.
- edrobap 5y agoThanks for bringing the 32bit point. Turns out that .ZIP specification has the limit [1] . The solution here is ZIP64. Excel does support ZIP64 but the implementation isn't suitable higher sized zip files [2] [1] https://en.wikipedia.org/wiki/ZIP_(file_format) https://en.wikipedia.org/wiki/ZIP_(file_format) [2] https://issues.apache.org/jira/browse/COMPRESS-474 https://issues.apache.org/jira/browse/COMPRESS-474