commit d5e7556e522f4662ad34b35924b6c76895df340e
author Serhiy Storchaka <storchaka@gmail.com> Thu May 31 07:35:39 2018 +0300
committer GitHub <noreply@github.com> Thu May 31 07:35:39 2018 +0300
tree f01d0d33ca8eb7946e63a35a6f946e2061786650
parent 9994eff17f943fb2c190708b12c96fef9838a425

bpo-33645: Fix an "unknown parsing error" in the parser. (GH-7119)

It is reproduced when parse the "<>" operator and run
Python with both options -3 and -We.

Parser/tokenizer.c

diff --git a/Parser/tokenizer.c b/Parser/tokenizer.c
index 4fdbad9..61bfb4e 100644
--- a/Parser/tokenizer.c
+++ b/Parser/tokenizer.c
@@ -1636,6 +1636,8 @@
                                    "<> not supported in 3.x; use !=",
                                    tok->filename, tok->lineno,
                                    NULL, NULL)) {
+                tok->done = E_ERROR;
+                tok->cur = tok->inp;
                 return ERRORTOKEN;
             }
         }