3 ms·
Works fine with Python's standard library. Files in a ZipFile can be read in a streaming manner. There is no need to store all the data in memory. import i
by johndough 6y ago
Works fine with Python's standard library. Files in a ZipFile can be read in a streaming manner. There is no need to store all the data in memory.
import io, csv, zipfile
max_lines = 10
with zipfile.ZipFile("data.zip") as z:
for info in z.infolist():
with z.open(info.filename) as f:
reader = csv.reader(io.TextIOWrapper(f))
for i_line, line in enumerate(reader):
if i_line >= max_lines: break
print(line)
- 2bluesc 6y agoThis is true when writing to a file. The goal of my PoC was to not write a file and instead to stream to the web browser.