Add flake8 annotions (#1502)

* Check for duplicates across dictionaries

And no longer allow self-corrections within these checks (given we exclude them elsewhere already)

* Add an annotating flake8 task

* Actually checkout the code in this step

* Add the missing newline