Effectively renamed tokenize_tests.py to have a txt extension instead.
This file isn't meant to be executed, it's data input for test_tokenize.py.
The problem with the .py extension is that it uses "non-standard"
indentation, and it's good to test that, but reindent.py keeps wanting
to fix it. But fixing the indentation causes the expected-output file to
change, since exact line and column numbers are part of the
tokenize.tokenize() output getting tested.
diff --git a/Lib/test/test_tokenize.py b/Lib/test/test_tokenize.py
index 22a1d90..d217404 100644
--- a/Lib/test/test_tokenize.py
+++ b/Lib/test/test_tokenize.py
@@ -4,7 +4,7 @@
if verbose:
print 'starting...'
-f = file(findfile('tokenize_tests'+os.extsep+'py'))
+f = file(findfile('tokenize_tests' + os.extsep + 'txt'))
tokenize.tokenize(f.readline)
f.close()
diff --git a/Lib/test/tokenize_tests.py b/Lib/test/tokenize_tests.txt
similarity index 100%
rename from Lib/test/tokenize_tests.py
rename to Lib/test/tokenize_tests.txt
diff --git a/PCbuild/python20.wse b/PCbuild/python20.wse
index 90ecf25..e97d4b0 100644
--- a/PCbuild/python20.wse
+++ b/PCbuild/python20.wse
@@ -2357,6 +2357,12 @@
Description=Python Test files
Flags=0000000000000010
end
+item: Install File
+ Source=..\lib\test\*.txt
+ Destination=%MAINDIR%\Lib\test
+ Description=Python Test files
+ Flags=0000000000000010
+end
item: Remark
end
item: Install File