Thanks, was trying to remember that first trick just last week. For log files I had to make a slight adjustment to filter the time at the front: !seen[gensub

Thanks, was trying to remember that first trick just last week. For log files I had to make a slight adjustment to filter the time at the front: !seen[gensub($1, "", "g", $0)]++ For anyone wondering, it filters out duplicates by storing the first occurrence of the line and skipping subsequent ones.