1. a721aba Issue #26331: Implement the parsing part of PEP 515. by Brett Cannon · 8 years ago
  2. 724f6a6 Rename test_pep####.py files by Zachary Ware · 8 years ago
  3. a0154c0 Fix running test_tokenize directly by Zachary Ware · 8 years ago
  4. 1c8222c Issue 25311: Add support for f-strings to tokenize.py. Also added some comments to explain what's happening, since it's not so obvious. by Eric V. Smith · 9 years ago
  5. 6731774 Issue 25422: Add tests for multi-line string tokenization. Also remove truncated tokens. by Eric V. Smith · 9 years ago
  6. 6f5175d Issue #25317: Converted doctests in test_tokenize to unittests. by Serhiy Storchaka · 9 years ago
  7. 5f6fa82 Issue #25317: Converted doctests in test_tokenize to unittests. by Serhiy Storchaka · 9 years ago
  8. 96ec934 Issue #24619: Simplify async/await tokenization. by Yury Selivanov · 9 years ago
  9. 8fb307c Issue #24619: New approach for tokenizing async/await. by Yury Selivanov · 9 years ago
  10. a95a476 Issue #20387: Merge test and patch from 3.4.4 by Jason R. Coombs · 9 years ago
  11. b6d1cdd Issue #20387: Correct test to properly capture expectation. by Jason R. Coombs · 9 years ago
  12. 5713b3c Issue #20387: Add test capturing failure to roundtrip indented code in tokenize module. by Jason R. Coombs · 9 years ago
  13. 7cf3638 Remove unused import and remove doctest-only import into doctests. by Jason R. Coombs · 9 years ago
  14. 24d262a (Merge 3.5) Issue #23840: tokenize.open() now closes the temporary binary file by Victor Stinner · 9 years ago
  15. 387729e Issue #23840: tokenize.open() now closes the temporary binary file on error to by Victor Stinner · 9 years ago
  16. 8085b80 Issue 24226: Fix parsing of many sequential one-line 'def' statements. by Yury Selivanov · 9 years ago
  17. 7544508 PEP 0492 -- Coroutines with async and await syntax. Issue #24017. by Yury Selivanov · 9 years ago
  18. ee4c0b9 Issue #23681: Fixed Python 2 to 3 poring bugs. by Serhiy Storchaka · 9 years ago
  19. 74a49ac Issue #23681: Fixed Python 2 to 3 poring bugs. by Serhiy Storchaka · 9 years ago
  20. d51374e PEP 465: a dedicated infix operator for matrix multiplication (closes #21176) by Benjamin Peterson · 10 years ago
  21. 9dc3a36 Issue #9974: When untokenizing, use row info to insert backslash+newline. by Terry Jan Reedy · 10 years ago
  22. 938ba68 Issue #20750, Enable roundtrip tests for new 5-tuple untokenize. The by Terry Jan Reedy · 10 years ago
  23. 5b8d2c3 Issue #8478: Untokenizer.compat now processes first token from iterator input. by Terry Jan Reedy · 10 years ago
  24. 58edfd9 whitespace by Terry Jan Reedy · 10 years ago
  25. 5e6db31 Untokenize: An logically incorrect assert tested user input validity. by Terry Jan Reedy · 10 years ago
  26. 768c16c Issue #18960: Fix bugs with Python source code encoding in the second line. by Serhiy Storchaka · 10 years ago
  27. dafea85 Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script by Serhiy Storchaka · 11 years ago
  28. fafa8b7 #16152: merge with 3.2. by Ezio Melotti · 12 years ago
  29. 2cc3b4b #16152: fix tokenize to ignore whitespace at the end of the code when no newline is found. Patch by Ned Batchelder. by Ezio Melotti · 12 years ago
  30. fed2c51 Merge branch by Florent Xicluna · 12 years ago
  31. 11f0b41 Issue #14990: tokenize: correctly fail with SyntaxError on invalid encoding declaration. by Florent Xicluna · 12 years ago
  32. 0b3847d Issue #15096: Drop support for the ur string prefix by Christian Heimes · 12 years ago
  33. 8d5c0b8 Issue #15054: Fix incorrect tokenization of 'b' string literals. by Meador Inge · 12 years ago
  34. c33f3f2 Issue #14629: Mention the filename in SyntaxError exceptions from by Brett Cannon · 12 years ago
  35. 63c39fe merge 3.2: issue 14629 by Martin v. Löwis · 12 years ago
  36. 63674f4 Issue #14629: Raise SyntaxError in tokenizer.detect_encoding by Martin v. Löwis · 12 years ago
  37. c0eaeca Updated tokenize to support the inverse byte literals new in 3.3 by Armin Ronacher · 12 years ago
  38. 00c7f85 Issue #2134: Add support for tokenize.TokenInfo.exact_type. by Meador Inge · 12 years ago
  39. d8b509b #13012: use splitlines(keepends=True/False) instead of splitlines(0/1). by Ezio Melotti · 13 years ago
  40. 963e402 tokenize is just broken on test_pep3131.py by Benjamin Peterson · 13 years ago
  41. 2ea6fcc Issue #12587: Correct faulty test file and reference in test_tokenize. by Ned Deily · 13 years ago
  42. b3aedd4 #9424: Replace deprecated assert* methods in the Python test suite. by Ezio Melotti · 14 years ago
  43. 92665ab test_tokenize: use self.assertEqual() instead of plain assert by Victor Stinner · 14 years ago
  44. 58c0752 Issue #10335: Add tokenize.open(), detect the file encoding using by Victor Stinner · 14 years ago
  45. 9f5f65c Fix #10258 - clean up resource warning by Brian Curtin · 14 years ago
  46. 5bc4fa7 Replace the "compiler" resource with the more generic "cpu", so by Antoine Pitrou · 14 years ago
  47. 33856de handle names starting with non-ascii characters correctly #9712 by Benjamin Peterson · 14 years ago
  48. e992a7d remove pointless coding cookie by Benjamin Peterson · 14 years ago
  49. 388122d Issue #9337: Make float.__str__ identical to float.__repr__. by Mark Dickinson · 14 years ago
  50. 3c0b317 Merged revisions 82356 via svnmerge from by Mark Dickinson · 14 years ago
  51. 689a558 in tokenize.detect_encoding(), return utf-8-sig when a BOM is found by Benjamin Peterson · 14 years ago
  52. a0dfa82 Merged revisions 75149,75260-75263,75265-75267,75292,75300,75376,75405,75429-75433,75437,75445,75501,75551,75572,75589-75591,75657,75742,75868,75952-75957,76057,76105,76139,76143,76162,76223 via svnmerge from by Benjamin Peterson · 15 years ago
  53. d3afada normalize latin-1 and utf-8 variant encodings like the builtin tokenizer does by Benjamin Peterson · 15 years ago
  54. c9c0f20 convert old fail* assertions to assert* by Benjamin Peterson · 15 years ago
  55. 433f32c raise a SyntaxError in detect_encoding() when a codec lookup fails like the builtin parser #4021 by Benjamin Peterson · 16 years ago
  56. ee8712c #2621 rename test.test_support to test.support by Benjamin Peterson · 16 years ago
  57. 752abd0 Convert a lot of print statements to print functions in docstrings, by Neal Norwitz · 16 years ago
  58. ba4af49 Merged revisions 61964-61979 via svnmerge from by Christian Heimes · 16 years ago
  59. 428de65 - Issue #719888: Updated tokenize to use a bytes API. generate_tokens has been by Trent Nelson · 16 years ago
  60. 74ca557 Added tests for tokenize, blocked corresponding checkin from trunk. by Eric Smith · 16 years ago
  61. 0c1f7c0 Fix doctests in test_tokenize by converting Python 2.x syntax by Mark Dickinson · 16 years ago
  62. dd15f6c Merged revisions 61239-61249,61252-61257,61260-61264,61269-61275,61278-61279,61285-61286,61288-61290,61298,61303-61305,61312-61314,61317,61329,61332,61344,61350-61351,61363-61376,61378-61379,61382-61383,61387-61388,61392,61395-61396,61402-61403 via svnmerge from by Christian Heimes · 16 years ago
  63. 4fe72f9 Patch 1420 by Ron Adam. by Guido van Rossum · 17 years ago
  64. 7a98be2 Remove RISCOS support by Skip Montanaro · 17 years ago
  65. f066c1b Make test_tokenize really pass -- don't add extra output. by Guido van Rossum · 17 years ago
  66. cfbbf48 Make test_tokenize pass again: by Guido van Rossum · 17 years ago
  67. a6bcefc When testing all stdlib modules, ignore test_pep263.py which is encoded by Guido van Rossum · 17 years ago
  68. c43e79f Fix a buch of shallow test failures. by Guido van Rossum · 17 years ago
  69. e7ba495 Merged revisions 55631-55794 via svnmerge from by Guido van Rossum · 17 years ago
  70. a18af4e PEP 3114: rename .next() to .__next__() and add next() builtin. by Georg Brandl · 17 years ago
  71. 0bcbb0d Fix the roundtripping function. by Guido van Rossum · 17 years ago
  72. 88fc664 * Remove PRINT_ITEM(_TO), PRINT_NEWLINE(_TO) opcodes. by Georg Brandl · 17 years ago
  73. be19ed7 Fix most trivially-findable print statements. by Guido van Rossum · 17 years ago
  74. c150536 PEP 3107 - Function Annotations thanks to Tony Lownds by Neal Norwitz · 18 years ago
  75. 89f507f Four months of trunk changes (including a few releases...) by Thomas Wouters · 18 years ago
  76. 49fd7fa Merge p3yk branch with the trunk up to revision 45595. This breaks a fair by Thomas Wouters · 18 years ago
  77. da99d1c SF bug #1224621: tokenize module does not detect inconsistent dedents by Raymond Hettinger · 19 years ago
  78. 68c0453 Add untokenize() function to allow full round-trip tokenization. by Raymond Hettinger · 19 years ago
  79. 0ff2ee0 Effectively renamed tokenize_tests.py to have a txt extension instead. by Tim Peters · 21 years ago
  80. 11cb813 Close the file after tokenizing it. Because the open file object was by Tim Peters · 21 years ago
  81. 04f357c Get rid of relative imports in all unittests. Now anything that by Barry Warsaw · 22 years ago
  82. e2ae77b SF patch #474590 -- RISC OS support by Guido van Rossum · 23 years ago
  83. f785042 a bold attempt to fix things broken by MAL's verify patch: import by Fredrik Lundh · 23 years ago
  84. 3661908 This patch removes all uses of "assert" in the regression test suite by Marc-André Lemburg · 23 years ago
  85. 004d5e6 Make reindent.py happy (convert everything to 4-space indents!). by Fred Drake · 24 years ago
  86. e26132c Move unified findfile() into test_support.py by Guido van Rossum · 26 years ago
  87. 0874f7f Tests for tokenize.py (Ka-Ping Yee) by Guido van Rossum · 27 years ago