6 ms·
Could you please tell me how did you convert it to sqlite? I've got a huge 1 GB txt file that crashes my comp every time I try to search for myself there :( Tha
by b212 6y ago
Could you please tell me how did you convert it to sqlite? I've got a huge 1 GB txt file that crashes my comp every time I try to search for myself there :( Thank you!
- banana_giraffe 6y agoSuper hacky python script I used to turn the text files into a sqlite database: https://pastebin.com/gBWhCVGz https://pastebin.com/gBWhCVGz
- kuyan 6y agoThanks, this worked for me! Here's my contribution; I tweaked your script a little for memory usage. https://pastebin.com/4hA8VACe https://pastebin.com/4hA8VACe
- shazzdeeds 6y agoThanks. I tweaked the script to include an incremental printout across files and also creating an index on phone num to easily search. https://pastebin.com/AxY5PeDQ https://pastebin.com/AxY5PeDQ
- datavirtue 6y agoTry Ultra Edit, free trial. It can read and search massive text files without crashing. Quite responsive.on 10GB files.
- knolan 6y agoFirstly don’t do something like open it in notepad. 1GB text files are not exactly difficult to work with once you use a proper text editor or parsing tools.
- bobbylarrybobby 6y agoI suggest using a shell program like grep (or even the search feature of less), as shell programs are notoriously good at lazily seeking through files to keep memory use low.
- throwmusic2366 6y agoDoes it open with Geany? https://www.geany.org/ https://www.geany.org/ It's FLOSS. Available on Windows, Mac and Linux.
- swiley 6y agosqlight can ".read" a number of formats. It's one of the more convenient ways to do joins on ugly tables.
- cable2600 6y agoI used to use Borland's Brief to edit large files. But it is commercial. There is a free version in beta here https://sourceforge.net/projects/grief/ https://sourceforge.net/projects/grief/ Grief. It pages the file in and out of memory to save space.
- max_hammer 6y agoYou can use `awk` for any sql like operations on file.