3 ms·

> using AWK will almost always be faster than designing a schema and importing into a database first I have never had to do that with unstructured data - ah wa

> using AWK will almost always be faster than designing a schema and importing into a database first I have never had to do that with unstructured data - ah wait, I lie! I pulled data off the covid wiki page, a quick emacs regexping, a bit of macrology, pasted it into a spreadsheet (libreoffice recognises it's tab or whatever separated) and bingo, you're off. > Oh, and want to know a really good tool for getting data from a text file into a database? AWK! For smallish amounts, I use emacs regexps. For data too large for emacs, I'd probably use python. > and without fuss that can create value for your company, and those are things that can go on your resume. That's not how it works any more. They look for skills. They should not, they should do as you say, but seems not any more. > specific things you have accomplished becomes more important than the keywords on your resume again, no. Believe me, I have a track record of delivering, but all my job agents do is match by skills. And that's what their clients want. It's depressing. So I disagree but thanks anyway

srean 6y ago
For large data why do you use Python and not C++ or Haskell ? They can do anything that Python can do. What's that you said, 'convenience and specialization', ah I see, that thought never occurred to me. May be that's why I reach for AWK over Python.
davidgould 6y ago
Awk, particularly mawk, is several times faster than python for a lot of file ripping tasks. If I had several billion lines of data to reformat or summarize, I'd almost always reach for awk before python.
jimbokun 6y ago
> a quick emacs regexping, a bit of macrology, pasted it into a spreadsheet (libreoffice recognises it's tab or whatever separated) and bingo, you're off. It's very likely that, if you knew AWK well, you could have completed this task faster. > Believe me, I have a track record of delivering, but all my job agents do is match by skills. And that's what their clients want. It's hard to find the few companies that actually prioritize results, but it's worth it.

srean 6y ago

For large data why do you use Python and not C++ or Haskell ? They can do anything that Python can do. What's that you said, 'convenience and specialization', ah I see, that thought never occurred to me. May be that's why I reach for AWK over Python.

davidgould 6y ago

Awk, particularly mawk, is several times faster than python for a lot of file ripping tasks. If I had several billion lines of data to reformat or summarize, I'd almost always reach for awk before python.

jimbokun 6y ago

> a quick emacs regexping, a bit of macrology, pasted it into a spreadsheet (libreoffice recognises it's tab or whatever separated) and bingo, you're off. It's very likely that, if you knew AWK well, you could have completed this task faster. > Believe me, I have a track record of delivering, but all my job agents do is match by skills. And that's what their clients want. It's hard to find the few companies that actually prioritize results, but it's worth it.