| commit | 7d24b1698a5590df066f829fb4eeef93186d7150 | [log] [tgz] |
|---|---|---|
| author | Ezio Melotti <ezio.melotti@gmail.com> | Sat Nov 03 17:30:51 2012 +0200 |
| committer | Ezio Melotti <ezio.melotti@gmail.com> | Sat Nov 03 17:30:51 2012 +0200 |
| tree | c216580e6d3aa39581bfd7cf20b5b9d029bf4825 | |
| parent | d7bae5e85ac9ae3a6fbd5c9de5b21be0df7a848d [diff] [blame] |
#16152: fix tokenize to ignore whitespace at the end of the code when no newline is found. Patch by Ned Batchelder.
diff --git a/Lib/test/test_tokenize.py b/Lib/test/test_tokenize.py index a51e781..489f68f 100644 --- a/Lib/test/test_tokenize.py +++ b/Lib/test/test_tokenize.py
@@ -550,6 +550,10 @@ NAME 'pass' (3, 9) (3, 13) DEDENT '' (4, 0) (4, 0) DEDENT '' (4, 0) (4, 0) + +Pathological whitespace (http://bugs.python.org/issue16152) + >>> dump_tokens("@ ") + OP '@' (1, 0) (1, 1) """