8 ms·
I've poured over ((ok, grepped) ~500GB of Chroincling America data to find lines that meet my low standard for nonsene, basically ones that match egrep "[^a-zA-
by version_five 4y ago
I've poured over ((ok, grepped) ~500GB of Chroincling America data to find lines that meet my low standard for nonsene, basically ones that match egrep "[^a-zA-Z0-9 ]{3,}"
I'm super curious to know fast this was. grep is generally very fast and this should be doable on a normal computer, though it might take a little while
- tgv 4y agoWould the typos (Chroincling, orthe, etc.) be on purpose?
- deleted 4y ago[deleted]
- riceart 4y agoThat regex does not match typos.
- totetsu 4y agoThere are faster tools than grep for dealing with large files. ag the silver searcher workes okay.
- version_five 4y agosilver searcher Thanks for the reminder, I knew something like this existed but I couldn't remember what it was called!