1. 5f6fa82 Issue #25317: Converted doctests in test_tokenize to unittests. by Serhiy Storchaka · 9 years ago
  2. b6d1cdd Issue #20387: Correct test to properly capture expectation. by Jason R. Coombs · 9 years ago
  3. 5713b3c Issue #20387: Add test capturing failure to roundtrip indented code in tokenize module. by Jason R. Coombs · 9 years ago
  4. 7cf3638 Remove unused import and remove doctest-only import into doctests. by Jason R. Coombs · 9 years ago
  5. 387729e Issue #23840: tokenize.open() now closes the temporary binary file on error to by Victor Stinner · 9 years ago
  6. 74a49ac Issue #23681: Fixed Python 2 to 3 poring bugs. by Serhiy Storchaka · 10 years ago
  7. 9dc3a36 Issue #9974: When untokenizing, use row info to insert backslash+newline. by Terry Jan Reedy · 11 years ago
  8. 938ba68 Issue #20750, Enable roundtrip tests for new 5-tuple untokenize. The by Terry Jan Reedy · 11 years ago
  9. 5b8d2c3 Issue #8478: Untokenizer.compat now processes first token from iterator input. by Terry Jan Reedy · 11 years ago
  10. 58edfd9 whitespace by Terry Jan Reedy · 11 years ago
  11. 5e6db31 Untokenize: An logically incorrect assert tested user input validity. by Terry Jan Reedy · 11 years ago
  12. 768c16c Issue #18960: Fix bugs with Python source code encoding in the second line. by Serhiy Storchaka · 11 years ago
  13. dafea85 Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script by Serhiy Storchaka · 11 years ago
  14. fafa8b7 #16152: merge with 3.2. by Ezio Melotti · 12 years ago
  15. 2cc3b4b #16152: fix tokenize to ignore whitespace at the end of the code when no newline is found. Patch by Ned Batchelder. by Ezio Melotti · 12 years ago
  16. fed2c51 Merge branch by Florent Xicluna · 12 years ago
  17. 11f0b41 Issue #14990: tokenize: correctly fail with SyntaxError on invalid encoding declaration. by Florent Xicluna · 12 years ago
  18. 0b3847d Issue #15096: Drop support for the ur string prefix by Christian Heimes · 12 years ago
  19. 8d5c0b8 Issue #15054: Fix incorrect tokenization of 'b' string literals. by Meador Inge · 12 years ago
  20. c33f3f2 Issue #14629: Mention the filename in SyntaxError exceptions from by Brett Cannon · 12 years ago
  21. 63c39fe merge 3.2: issue 14629 by Martin v. Löwis · 12 years ago
  22. 63674f4 Issue #14629: Raise SyntaxError in tokenizer.detect_encoding by Martin v. Löwis · 12 years ago
  23. c0eaeca Updated tokenize to support the inverse byte literals new in 3.3 by Armin Ronacher · 13 years ago
  24. 00c7f85 Issue #2134: Add support for tokenize.TokenInfo.exact_type. by Meador Inge · 13 years ago
  25. d8b509b #13012: use splitlines(keepends=True/False) instead of splitlines(0/1). by Ezio Melotti · 13 years ago
  26. 963e402 tokenize is just broken on test_pep3131.py by Benjamin Peterson · 13 years ago
  27. 2ea6fcc Issue #12587: Correct faulty test file and reference in test_tokenize. by Ned Deily · 13 years ago
  28. b3aedd4 #9424: Replace deprecated assert* methods in the Python test suite. by Ezio Melotti · 14 years ago
  29. 92665ab test_tokenize: use self.assertEqual() instead of plain assert by Victor Stinner · 14 years ago
  30. 58c0752 Issue #10335: Add tokenize.open(), detect the file encoding using by Victor Stinner · 14 years ago
  31. 9f5f65c Fix #10258 - clean up resource warning by Brian Curtin · 14 years ago
  32. 5bc4fa7 Replace the "compiler" resource with the more generic "cpu", so by Antoine Pitrou · 14 years ago
  33. 33856de handle names starting with non-ascii characters correctly #9712 by Benjamin Peterson · 14 years ago
  34. e992a7d remove pointless coding cookie by Benjamin Peterson · 14 years ago
  35. 388122d Issue #9337: Make float.__str__ identical to float.__repr__. by Mark Dickinson · 14 years ago
  36. 3c0b317 Merged revisions 82356 via svnmerge from by Mark Dickinson · 14 years ago
  37. 689a558 in tokenize.detect_encoding(), return utf-8-sig when a BOM is found by Benjamin Peterson · 15 years ago
  38. a0dfa82 Merged revisions 75149,75260-75263,75265-75267,75292,75300,75376,75405,75429-75433,75437,75445,75501,75551,75572,75589-75591,75657,75742,75868,75952-75957,76057,76105,76139,76143,76162,76223 via svnmerge from by Benjamin Peterson · 15 years ago
  39. d3afada normalize latin-1 and utf-8 variant encodings like the builtin tokenizer does by Benjamin Peterson · 15 years ago
  40. c9c0f20 convert old fail* assertions to assert* by Benjamin Peterson · 15 years ago
  41. 433f32c raise a SyntaxError in detect_encoding() when a codec lookup fails like the builtin parser #4021 by Benjamin Peterson · 16 years ago
  42. ee8712c #2621 rename test.test_support to test.support by Benjamin Peterson · 16 years ago
  43. 752abd0 Convert a lot of print statements to print functions in docstrings, by Neal Norwitz · 16 years ago
  44. ba4af49 Merged revisions 61964-61979 via svnmerge from by Christian Heimes · 17 years ago
  45. 428de65 - Issue #719888: Updated tokenize to use a bytes API. generate_tokens has been by Trent Nelson · 17 years ago
  46. 74ca557 Added tests for tokenize, blocked corresponding checkin from trunk. by Eric Smith · 17 years ago
  47. 0c1f7c0 Fix doctests in test_tokenize by converting Python 2.x syntax by Mark Dickinson · 17 years ago
  48. dd15f6c Merged revisions 61239-61249,61252-61257,61260-61264,61269-61275,61278-61279,61285-61286,61288-61290,61298,61303-61305,61312-61314,61317,61329,61332,61344,61350-61351,61363-61376,61378-61379,61382-61383,61387-61388,61392,61395-61396,61402-61403 via svnmerge from by Christian Heimes · 17 years ago
  49. 4fe72f9 Patch 1420 by Ron Adam. by Guido van Rossum · 17 years ago
  50. 7a98be2 Remove RISCOS support by Skip Montanaro · 17 years ago
  51. f066c1b Make test_tokenize really pass -- don't add extra output. by Guido van Rossum · 17 years ago
  52. cfbbf48 Make test_tokenize pass again: by Guido van Rossum · 17 years ago
  53. a6bcefc When testing all stdlib modules, ignore test_pep263.py which is encoded by Guido van Rossum · 17 years ago
  54. c43e79f Fix a buch of shallow test failures. by Guido van Rossum · 17 years ago
  55. e7ba495 Merged revisions 55631-55794 via svnmerge from by Guido van Rossum · 17 years ago
  56. a18af4e PEP 3114: rename .next() to .__next__() and add next() builtin. by Georg Brandl · 17 years ago
  57. 0bcbb0d Fix the roundtripping function. by Guido van Rossum · 18 years ago
  58. 88fc664 * Remove PRINT_ITEM(_TO), PRINT_NEWLINE(_TO) opcodes. by Georg Brandl · 18 years ago
  59. be19ed7 Fix most trivially-findable print statements. by Guido van Rossum · 18 years ago
  60. c150536 PEP 3107 - Function Annotations thanks to Tony Lownds by Neal Norwitz · 18 years ago
  61. 89f507f Four months of trunk changes (including a few releases...) by Thomas Wouters · 18 years ago
  62. 49fd7fa Merge p3yk branch with the trunk up to revision 45595. This breaks a fair by Thomas Wouters · 18 years ago
  63. da99d1c SF bug #1224621: tokenize module does not detect inconsistent dedents by Raymond Hettinger · 19 years ago
  64. 68c0453 Add untokenize() function to allow full round-trip tokenization. by Raymond Hettinger · 19 years ago
  65. 0ff2ee0 Effectively renamed tokenize_tests.py to have a txt extension instead. by Tim Peters · 21 years ago
  66. 11cb813 Close the file after tokenizing it. Because the open file object was by Tim Peters · 21 years ago
  67. 04f357c Get rid of relative imports in all unittests. Now anything that by Barry Warsaw · 22 years ago
  68. e2ae77b SF patch #474590 -- RISC OS support by Guido van Rossum · 23 years ago
  69. f785042 a bold attempt to fix things broken by MAL's verify patch: import by Fredrik Lundh · 24 years ago
  70. 3661908 This patch removes all uses of "assert" in the regression test suite by Marc-André Lemburg · 24 years ago
  71. 004d5e6 Make reindent.py happy (convert everything to 4-space indents!). by Fred Drake · 24 years ago
  72. e26132c Move unified findfile() into test_support.py by Guido van Rossum · 26 years ago
  73. 0874f7f Tests for tokenize.py (Ka-Ping Yee) by Guido van Rossum · 27 years ago