Skip to content
Archive of posts tagged sorting

Three text processing tasks

Unlikely to help someone, but anyway.

Remove duplicates, but keeping only the last occurrence

Again on IRC, somebody asked how to remove duplicates from a file, but keeping only the last occurrence of each item. The classic awk idiom awk '!a[$0]++' prints only the first instance of every line. So if the input is, for example foo bar baz foo xxx yyy bar the "normal" output (ie using the […]

Sorting with awk

How to sort data in awk