| commit | 040d7ca498c68153abb0387a8f900176ea08e2bb | [log] [tgz] |
|---|---|---|
| author | Guido van Rossum <guido@python.org> | Fri Aug 23 01:36:01 2002 +0000 |
| committer | Guido van Rossum <guido@python.org> | Fri Aug 23 01:36:01 2002 +0000 |
| tree | 7b73933d480b84eb7c013b88e231bff0d2a9d157 | |
| parent | fd372aa8e990ca68a37da9170248fc95e45efad9 [diff] |
Rewritten using the tokenize module, which gives us a real tokenizer rather than a number of approximating regular expressions. Alas, it is 3-4 times slower. Let that be a challenge for the tokenize module.