1. 50bb7e1 Remove a tuple unpacking in a parameter list to remove a SyntaxWarning raised by Brett Cannon · 16 years ago
  2. 8456f64 revert 63965 for preformance reasons by Benjamin Peterson · 16 years ago
  3. 30dc7b8 use the more idomatic while True by Benjamin Peterson · 16 years ago
  4. da0c025 Issue2495: tokenize.untokenize did not insert space between two consecutive string literals: by Amaury Forgeot d'Arc · 16 years ago
  5. 0aed07a Added PEP 3127 support to tokenize (with tests); added PEP 3127 to NEWS. by Eric Smith · 17 years ago
  6. 14404b6 Fix #1679: "0x" was taken as a valid integer literal. by Georg Brandl · 17 years ago
  7. 288e89a Added bytes and b'' as aliases for str and '' by Christian Heimes · 17 years ago
  8. 8a7e76b Add name to credits (for untokenize). by Raymond Hettinger · 18 years ago
  9. 39c532c Replace dead code with an assert. by Jeremy Hylton · 18 years ago
  10. 76467ba Bug fixes large and small for tokenize. by Jeremy Hylton · 18 years ago
  11. 2463f8f Make tabnanny recognize IndentationErrors raised by tokenize. by Georg Brandl · 18 years ago
  12. c259cc9 Insert a safety space after numbers as well as names in untokenize(). by Guido van Rossum · 18 years ago
  13. da99d1c SF bug #1224621: tokenize module does not detect inconsistent dedents by Raymond Hettinger · 19 years ago
  14. 68c0453 Add untokenize() function to allow full round-trip tokenization. by Raymond Hettinger · 19 years ago
  15. c2a5a63 PEP-0318, @decorator-style. In Guido's words: by Anthony Baxter · 20 years ago
  16. 68468eb Get rid of many apply() calls. by Guido van Rossum · 22 years ago
  17. 78a7aee SF 633560: tokenize.__all__ needs "generate_tokens" by Raymond Hettinger · 22 years ago
  18. 9d6897a Speed up the most egregious "if token in (long tuple)" cases by using by Guido van Rossum · 22 years ago
  19. 8ac1495 Whitespace normalization. by Tim Peters · 22 years ago
  20. d1fa3db Added docstrings excerpted from Python Library Reference. Closes patch 556161. by Raymond Hettinger · 22 years ago
  21. 496563a Remove some now-obsolete generator future statements. by Tim Peters · 22 years ago
  22. e98d16e Cleanup x so it is not left in module by Neal Norwitz · 22 years ago
  23. d507dab SF patch #455966: Allow leading 0 in float/imag literals. by Tim Peters · 23 years ago
  24. 96204f5 Add new tokens // and //=, in support of PEP 238. by Guido van Rossum · 23 years ago
  25. 79e75e1 Use string.ascii_letters instead of string.letters (SF bug #226706). by Fred Drake · 23 years ago
  26. b09f7ed Preliminary support for "from __future__ import generators" to enable by Guido van Rossum · 23 years ago
  27. 4efb6e9 Turns out Neil didn't intend for *all* of his gen-branch work to get committed. by Tim Peters · 23 years ago
  28. 5ca576e Merging the gen-branch into the main line, at Guido's direction. Yay! by Tim Peters · 23 years ago
  29. 28c62bb Provide a StopTokenizing exception for conveniently exiting the loop. by Ka-Ping Yee · 24 years ago
  30. 4f64c13 Better __credits__. by Ka-Ping Yee · 24 years ago
  31. 244c593 Add __author__ and __credits__ variables. by Ka-Ping Yee · 24 years ago
  32. 40fc160 final round of __all__ lists (I hope) - skipped urllib2 because Moshe may be by Skip Montanaro · 24 years ago
  33. b08b2d3 String method conversion. by Eric S. Raymond · 24 years ago
  34. 1ff08b1 Add tokenizer support and tests for u'', U"", uR'', Ur"", etc. by Ka-Ping Yee · 24 years ago
  35. b90f89a Whitespace normalization. by Tim Peters · 24 years ago
  36. de49583 Possible fix for Skip's bug 116136 (sre recursion limit hit in tokenize.py). by Tim Peters · 24 years ago
  37. e1519a1 Update for augmented assignment, tested & approved by Guido. by Thomas Wouters · 24 years ago
  38. 9b8d801 Convert some old-style string exceptions to class exceptions. by Fred Drake · 24 years ago
  39. a90c78b Differentiate between NEWLINE token (an official newline) and NL token by Guido van Rossum · 26 years ago
  40. fefc922 New, fixed version with proper r"..." and R"..." support from Ka-Ping. by Guido van Rossum · 27 years ago
  41. 3b63177 Redone (by Ka-Ping) using the new re module, and adding recognition by Guido van Rossum · 27 years ago
  42. 2b1566b Correct typo in last line (test program invocation). by Guido van Rossum · 27 years ago
  43. de65527 Ping's latest. Fixes triple quoted strings ending in odd by Guido van Rossum · 27 years ago
  44. 1aec323 Ka-Ping's muich improved version of March 26, 1997: by Guido van Rossum · 27 years ago
  45. b5dc5e3 Added support for imaginary constants (e.g. 0j, 1j, 1.0j). by Guido van Rossum · 28 years ago
  46. b51eaa1 Fixed doc string, added __version__, fixed 1 bug. by Guido van Rossum · 28 years ago
  47. fc6f533 Ka-Ping's version. by Guido van Rossum · 28 years ago
  48. b31c7f7 * test_select.py: (some) tests for built-in select module by Guido van Rossum · 31 years ago
  49. 10d10ff Change the order in which Floatnumber and Intnumber are tried by Guido van Rossum · 33 years ago
  50. 4d8e859 Initial revision by Guido van Rossum · 33 years ago