commit fc354f07855a9197e71f851ad930cbf5652f9160
author Albert-Jan Nijburg <albertjan@trinket.io> Wed May 31 15:00:21 2017 +0100
committer Victor Stinner <victor.stinner@gmail.com> Wed May 31 16:00:21 2017 +0200
tree 5c7c6ad2a4de72993d916c321156572d4fa4635d
parent 85aba238e49abd2d5a604102981d28a50f305443

bpo-25324: copy tok_name before changing it (#1608)

* add test to check if were modifying token

* copy list so import tokenize doesnt have side effects on token

* shorten line

* add tokenize tokens to token.h to get them to show up in token

* move ERRORTOKEN back to its previous location, and fix nitpick

* copy comments from token.h automatically

* fix whitespace and make more pythonic

* change to fix comments from @haypo

* update token.rst and Misc/NEWS

* change wording

* some more wording changes