3 ms·
awk '!seen[$0]++' awk 'NR==FNR{A[$0]; next} $0 in A' file1.txt file2.txt
by known 7y ago
awk '!seen[$0]++'
awk 'NR==FNR{A[$0]; next} $0 in A' file1.txt file2.txt
- flukus 7y agoThanks, was trying to remember that first trick just last week. For log files I had to make a slight adjustment to filter the time at the front: !seen[gensub($1, "", "g", $0)]++ For anyone wondering, it filters out duplicates by storing the first occurrence of the line and skipping subsequent ones.