Merge the rest of the trunk.
Merged revisions 46490-46494,46496,46498,46500,46506,46521,46538,46558,46563-46567,46570-46571,46583,46593,46595-46598,46604,46606,46609-46753 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r46610 | martin.v.loewis | 2006-06-03 09:42:26 +0200 (Sat, 03 Jun 2006) | 2 lines
Updated version (win32-icons2.zip) from #1490384.
........
r46612 | andrew.kuchling | 2006-06-03 20:09:41 +0200 (Sat, 03 Jun 2006) | 1 line
[Bug #1472084] Fix description of do_tag
........
r46614 | andrew.kuchling | 2006-06-03 20:33:35 +0200 (Sat, 03 Jun 2006) | 1 line
[Bug #1475554] Strengthen text to say 'must' instead of 'should'
........
r46616 | andrew.kuchling | 2006-06-03 20:41:28 +0200 (Sat, 03 Jun 2006) | 1 line
[Bug #1441864] Clarify description of 'data' argument
........
r46617 | andrew.kuchling | 2006-06-03 20:43:24 +0200 (Sat, 03 Jun 2006) | 1 line
Minor rewording
........
r46619 | andrew.kuchling | 2006-06-03 21:02:35 +0200 (Sat, 03 Jun 2006) | 9 lines
[Bug #1497414] _self is a reserved word in the WATCOM 10.6 C compiler.
Fix by renaming the variable.
In a different module, Neal fixed it by renaming _self to self. There's
already a variable named 'self' here, so I used selfptr.
(I'm committing this on a Mac without Tk, but it's a simple search-and-replace.
<crosses fingers>, so I'll watch the buildbots and see what happens.)
........
r46621 | fredrik.lundh | 2006-06-03 23:56:05 +0200 (Sat, 03 Jun 2006) | 5 lines
"_self" is a said to be a reserved word in Watcom C 10.6. I'm
not sure that's really standard compliant behaviour, but I guess
we have to fix that anyway...
........
r46622 | andrew.kuchling | 2006-06-04 00:44:42 +0200 (Sun, 04 Jun 2006) | 1 line
Update readme
........
r46623 | andrew.kuchling | 2006-06-04 00:59:23 +0200 (Sun, 04 Jun 2006) | 1 line
Drop 0 parameter
........
r46624 | andrew.kuchling | 2006-06-04 00:59:59 +0200 (Sun, 04 Jun 2006) | 1 line
Some code tidying; use curses.wrapper
........
r46625 | andrew.kuchling | 2006-06-04 01:02:15 +0200 (Sun, 04 Jun 2006) | 1 line
Use True; value returned from main is unused
........
r46626 | andrew.kuchling | 2006-06-04 01:07:21 +0200 (Sun, 04 Jun 2006) | 1 line
Use true division, and the True value
........
r46627 | andrew.kuchling | 2006-06-04 01:09:58 +0200 (Sun, 04 Jun 2006) | 1 line
Docstring fix; use True
........
r46628 | andrew.kuchling | 2006-06-04 01:15:56 +0200 (Sun, 04 Jun 2006) | 1 line
Put code in a main() function; loosen up the spacing to match current code style
........
r46629 | andrew.kuchling | 2006-06-04 01:39:07 +0200 (Sun, 04 Jun 2006) | 1 line
Use functions; modernize code
........
r46630 | andrew.kuchling | 2006-06-04 01:43:22 +0200 (Sun, 04 Jun 2006) | 1 line
This demo requires Medusa (not just asyncore); remove it
........
r46631 | andrew.kuchling | 2006-06-04 01:46:36 +0200 (Sun, 04 Jun 2006) | 2 lines
Remove xmlrpc demo -- it duplicates the SimpleXMLRPCServer module.
........
r46632 | andrew.kuchling | 2006-06-04 01:47:22 +0200 (Sun, 04 Jun 2006) | 1 line
Remove xmlrpc/ directory
........
r46633 | andrew.kuchling | 2006-06-04 01:51:21 +0200 (Sun, 04 Jun 2006) | 1 line
Remove dangling reference
........
r46634 | andrew.kuchling | 2006-06-04 01:59:36 +0200 (Sun, 04 Jun 2006) | 1 line
Add more whitespace; use a better socket name
........
r46635 | tim.peters | 2006-06-04 03:22:53 +0200 (Sun, 04 Jun 2006) | 2 lines
Whitespace normalization.
........
r46637 | tim.peters | 2006-06-04 05:26:02 +0200 (Sun, 04 Jun 2006) | 16 lines
In a PYMALLOC_DEBUG build obmalloc adds extra debugging info
to each allocated block. This was using 4 bytes for each such
piece of info regardless of platform. This didn't really matter
before (proof: no bug reports, and the debug-build obmalloc would
have assert-failed if it was ever asked for a chunk of memory
>= 2**32 bytes), since container indices were plain ints. But after
the Py_ssize_t changes, it's at least theoretically possible to
allocate a list or string whose guts exceed 2**32 bytes, and the
PYMALLOC_DEBUG routines would fail then (having only 4 bytes
to record the originally requested size).
Now we use sizeof(size_t) bytes for each of a PYMALLOC_DEBUG
build's extra debugging fields. This won't make any difference
on 32-bit boxes, but will add 16 bytes to each allocation in
a debug build on a 64-bit box.
........
r46638 | tim.peters | 2006-06-04 05:38:04 +0200 (Sun, 04 Jun 2006) | 4 lines
_PyObject_DebugMalloc(): The return value should add
2*sizeof(size_t) now, not 8. This probably accounts for
current disasters on the 64-bit buildbot slaves.
........
r46639 | neal.norwitz | 2006-06-04 08:19:31 +0200 (Sun, 04 Jun 2006) | 1 line
SF #1499797, Fix for memory leak in WindowsError_str
........
r46640 | andrew.macintyre | 2006-06-04 14:31:09 +0200 (Sun, 04 Jun 2006) | 2 lines
Patch #1454481: Make thread stack size runtime tunable.
........
r46641 | andrew.macintyre | 2006-06-04 14:59:59 +0200 (Sun, 04 Jun 2006) | 2 lines
clean up function declarations to conform to PEP-7 style.
........
r46642 | martin.blais | 2006-06-04 15:49:49 +0200 (Sun, 04 Jun 2006) | 15 lines
Fixes in struct and socket from merge reviews.
- Following Guido's comments, renamed
* pack_to -> pack_into
* recv_buf -> recv_into
* recvfrom_buf -> recvfrom_into
- Made fixes to _struct.c according to Neal Norwitz comments on the checkins
list.
- Converted some ints into the appropriate -- I hope -- ssize_t and size_t.
........
r46643 | ronald.oussoren | 2006-06-04 16:05:28 +0200 (Sun, 04 Jun 2006) | 3 lines
"Import" LDFLAGS in Mac/OSX/Makefile.in to ensure pythonw gets build with
the right compiler flags.
........
r46644 | ronald.oussoren | 2006-06-04 16:24:59 +0200 (Sun, 04 Jun 2006) | 2 lines
Drop Mac wrappers for the WASTE library.
........
r46645 | tim.peters | 2006-06-04 17:49:07 +0200 (Sun, 04 Jun 2006) | 3 lines
s_methods[]: Stop compiler warnings by casting
s_unpack_from to PyCFunction.
........
r46646 | george.yoshida | 2006-06-04 19:04:12 +0200 (Sun, 04 Jun 2006) | 2 lines
Remove a redundant word
........
r46647 | george.yoshida | 2006-06-04 19:17:25 +0200 (Sun, 04 Jun 2006) | 2 lines
Markup fix
........
r46648 | martin.v.loewis | 2006-06-04 21:36:28 +0200 (Sun, 04 Jun 2006) | 2 lines
Patch #1359618: Speed-up charmap encoder.
........
r46649 | georg.brandl | 2006-06-04 23:46:16 +0200 (Sun, 04 Jun 2006) | 3 lines
Repair refleaks in unicodeobject.
........
r46650 | georg.brandl | 2006-06-04 23:56:52 +0200 (Sun, 04 Jun 2006) | 4 lines
Patch #1346214: correctly optimize away "if 0"-style stmts
(thanks to Neal for review)
........
r46651 | georg.brandl | 2006-06-05 00:15:37 +0200 (Mon, 05 Jun 2006) | 2 lines
Bug #1500293: fix memory leaks in _subprocess module.
........
r46654 | tim.peters | 2006-06-05 01:43:53 +0200 (Mon, 05 Jun 2006) | 2 lines
Whitespace normalization.
........
r46655 | tim.peters | 2006-06-05 01:52:47 +0200 (Mon, 05 Jun 2006) | 16 lines
Revert revisions:
46640 Patch #1454481: Make thread stack size runtime tunable.
46647 Markup fix
The first is causing many buildbots to fail test runs, and there
are multiple causes with seemingly no immediate prospects for
repairing them. See python-dev discussion.
Note that a branch can (and should) be created for resolving these
problems, like
svn copy svn+ssh://svn.python.org/python/trunk -r46640 svn+ssh://svn.python.org/python/branches/NEW_BRANCH
followed by merging rev 46647 to the new branch.
........
r46656 | andrew.kuchling | 2006-06-05 02:08:09 +0200 (Mon, 05 Jun 2006) | 1 line
Mention second encoding speedup
........
r46657 | gregory.p.smith | 2006-06-05 02:31:01 +0200 (Mon, 05 Jun 2006) | 7 lines
bugfix: when log_archive was called with the DB_ARCH_REMOVE flag present
in BerkeleyDB >= 4.2 it tried to construct a list out of an uninitialized
char **log_list.
feature: export the DB_ARCH_REMOVE flag by name in the module on BerkeleyDB >= 4.2.
........
r46658 | gregory.p.smith | 2006-06-05 02:33:35 +0200 (Mon, 05 Jun 2006) | 5 lines
fix a bug in the previous commit. don't leak empty list on error return and
fix the additional rare (out of memory only) bug that it was supposed to fix
of not freeing log_list when the python allocator failed.
........
r46660 | tim.peters | 2006-06-05 02:55:26 +0200 (Mon, 05 Jun 2006) | 9 lines
"Flat is better than nested."
Move the long-winded, multiply-nested -R support out
of runtest() and into some module-level helper functions.
This makes runtest() and the -R code easier to follow.
That in turn allowed seeing some opportunities for code
simplification, and made it obvious that reglog.txt
never got closed.
........
r46661 | hyeshik.chang | 2006-06-05 02:59:54 +0200 (Mon, 05 Jun 2006) | 3 lines
Fix a potentially invalid memory access of CJKCodecs' shift-jis
decoder. (found by Neal Norwitz)
........
r46663 | gregory.p.smith | 2006-06-05 03:39:52 +0200 (Mon, 05 Jun 2006) | 3 lines
* support DBEnv.log_stat() method on BerkeleyDB >= 4.0 [patch #1494885]
........
r46664 | tim.peters | 2006-06-05 03:43:03 +0200 (Mon, 05 Jun 2006) | 3 lines
Remove doctest.testmod's deprecated (in 2.4) `isprivate`
argument. A lot of hair went into supporting that!
........
r46665 | tim.peters | 2006-06-05 03:47:24 +0200 (Mon, 05 Jun 2006) | 2 lines
Whitespace normalization.
........
r46666 | tim.peters | 2006-06-05 03:48:21 +0200 (Mon, 05 Jun 2006) | 2 lines
Make doctest news more accurate.
........
r46667 | gregory.p.smith | 2006-06-05 03:56:15 +0200 (Mon, 05 Jun 2006) | 3 lines
* support DBEnv.lsn_reset() method on BerkeleyDB >= 4.4 [patch #1494902]
........
r46668 | gregory.p.smith | 2006-06-05 04:02:25 +0200 (Mon, 05 Jun 2006) | 3 lines
mention the just committed bsddb changes
........
r46671 | gregory.p.smith | 2006-06-05 19:38:04 +0200 (Mon, 05 Jun 2006) | 3 lines
* add support for DBSequence objects [patch #1466734]
........
r46672 | gregory.p.smith | 2006-06-05 20:20:07 +0200 (Mon, 05 Jun 2006) | 3 lines
forgot to add this file in previous commit
........
r46673 | tim.peters | 2006-06-05 20:36:12 +0200 (Mon, 05 Jun 2006) | 2 lines
Whitespace normalization.
........
r46674 | tim.peters | 2006-06-05 20:36:54 +0200 (Mon, 05 Jun 2006) | 2 lines
Add missing svn:eol-style property to text files.
........
r46675 | gregory.p.smith | 2006-06-05 20:48:21 +0200 (Mon, 05 Jun 2006) | 4 lines
* fix DBCursor.pget() bug with keyword argument names when no data= is
supplied [SF pybsddb bug #1477863]
........
r46676 | andrew.kuchling | 2006-06-05 21:05:32 +0200 (Mon, 05 Jun 2006) | 1 line
Remove use of Trove name, which isn't very helpful to users
........
r46677 | andrew.kuchling | 2006-06-05 21:08:25 +0200 (Mon, 05 Jun 2006) | 1 line
[Bug #1470026] Include link to list of classifiers
........
r46679 | tim.peters | 2006-06-05 22:48:49 +0200 (Mon, 05 Jun 2006) | 10 lines
Access _struct attributes directly instead of mucking with getattr.
string_reverse(): Simplify.
assertRaises(): Raise TestFailed on failure.
test_unpack_from(), test_pack_into(), test_pack_into_fn(): never
use `assert` to test for an expected result (it doesn't test anything
when Python is run with -O).
........
r46680 | tim.peters | 2006-06-05 22:49:27 +0200 (Mon, 05 Jun 2006) | 2 lines
Add missing svn:eol-style property to text files.
........
r46681 | gregory.p.smith | 2006-06-06 01:38:06 +0200 (Tue, 06 Jun 2006) | 3 lines
add depends = ['md5.h'] to the _md5 module extension for correctness sake.
........
r46682 | brett.cannon | 2006-06-06 01:51:55 +0200 (Tue, 06 Jun 2006) | 4 lines
Add 3 more bytes to a buffer to cover constants in string and null byte on top of 10 possible digits for an int.
Closes bug #1501223.
........
r46684 | gregory.p.smith | 2006-06-06 01:59:37 +0200 (Tue, 06 Jun 2006) | 5 lines
- bsddb: the __len__ method of a DB object has been fixed to return correct
results. It could previously incorrectly return 0 in some cases.
Fixes SF bug 1493322 (pybsddb bug 1184012).
........
r46686 | tim.peters | 2006-06-06 02:25:07 +0200 (Tue, 06 Jun 2006) | 7 lines
_PySys_Init(): It's rarely a good idea to size a buffer to the
exact maximum size someone guesses is needed. In this case, if
we're really worried about extreme integers, then "cp%d" can
actually need 14 bytes (2 for "cp" + 1 for \0 at the end +
11 for -(2**31-1)). So reserve 128 bytes instead -- nothing is
actually saved by making a stack-local buffer tiny.
........
r46687 | neal.norwitz | 2006-06-06 09:22:08 +0200 (Tue, 06 Jun 2006) | 1 line
Remove unused variable (and stop compiler warning)
........
r46688 | neal.norwitz | 2006-06-06 09:23:01 +0200 (Tue, 06 Jun 2006) | 1 line
Fix a bunch of parameter strings
........
r46689 | thomas.heller | 2006-06-06 13:34:33 +0200 (Tue, 06 Jun 2006) | 6 lines
Convert CFieldObject tp_members to tp_getset, since there is no
structmember typecode for Py_ssize_t fields. This should fix some of
the errors on the PPC64 debian machine (64-bit, big endian).
Assigning to readonly fields now raises AttributeError instead of
TypeError, so the testcase has to be changed as well.
........
r46690 | thomas.heller | 2006-06-06 13:54:32 +0200 (Tue, 06 Jun 2006) | 1 line
Damn - the sentinel was missing. And fix another silly mistake.
........
r46691 | martin.blais | 2006-06-06 14:46:55 +0200 (Tue, 06 Jun 2006) | 13 lines
Normalized a few cases of whitespace in function declarations.
Found them using::
find . -name '*.py' | while read i ; do grep 'def[^(]*( ' $i /dev/null ; done
find . -name '*.py' | while read i ; do grep ' ):' $i /dev/null ; done
(I was doing this all over my own code anyway, because I'd been using spaces in
all defs, so I thought I'd make a run on the Python code as well. If you need
to do such fixes in your own code, you can use xx-rename or parenregu.el within
emacs.)
........
r46693 | thomas.heller | 2006-06-06 17:34:18 +0200 (Tue, 06 Jun 2006) | 1 line
Specify argtypes for all test functions. Maybe that helps on strange ;-) architectures
........
r46694 | tim.peters | 2006-06-06 17:50:17 +0200 (Tue, 06 Jun 2006) | 5 lines
BSequence_set_range(): Rev 46688 ("Fix a bunch of
parameter strings") changed this function's signature
seemingly by mistake, which is causing buildbots to fail
test_bsddb3. Restored the pre-46688 signature.
........
r46695 | tim.peters | 2006-06-06 17:52:35 +0200 (Tue, 06 Jun 2006) | 4 lines
On python-dev Thomas Heller said these were committed
by mistake in rev 46693, so reverting this part of
rev 46693.
........
r46696 | andrew.kuchling | 2006-06-06 19:10:41 +0200 (Tue, 06 Jun 2006) | 1 line
Fix comment typo
........
r46697 | brett.cannon | 2006-06-06 20:08:16 +0200 (Tue, 06 Jun 2006) | 2 lines
Fix coding style guide bug.
........
r46698 | thomas.heller | 2006-06-06 20:50:46 +0200 (Tue, 06 Jun 2006) | 2 lines
Add a hack so that foreign functions returning float now do work on 64-bit
big endian platforms.
........
r46699 | thomas.heller | 2006-06-06 21:25:13 +0200 (Tue, 06 Jun 2006) | 3 lines
Use the same big-endian hack as in _ctypes/callproc.c for callback functions.
This fixes the callback function tests that return float.
........
r46700 | ronald.oussoren | 2006-06-06 21:50:24 +0200 (Tue, 06 Jun 2006) | 5 lines
* Ensure that "make altinstall" works when the tree was configured
with --enable-framework
* Also for --enable-framework: allow users to use --prefix to specify
the location of the compatibility symlinks (such as /usr/local/bin/python)
........
r46701 | ronald.oussoren | 2006-06-06 21:56:00 +0200 (Tue, 06 Jun 2006) | 3 lines
A quick hack to ensure the right key-bindings for IDLE on osx: install patched
configuration files during a framework install.
........
r46702 | tim.peters | 2006-06-07 03:04:59 +0200 (Wed, 07 Jun 2006) | 4 lines
dash_R_cleanup(): Clear filecmp._cache. This accounts for
different results across -R runs (at least on Windows) of
test_filecmp.
........
r46705 | tim.peters | 2006-06-07 08:57:51 +0200 (Wed, 07 Jun 2006) | 17 lines
SF patch 1501987: Remove randomness from test_exceptions,
from ?iga Seilnacht (sorry about the name, but Firefox
on my box can't display the first character of the name --
the SF "Unix name" is zseil).
This appears to cure the oddball intermittent leaks across
runs when running test_exceptions under -R. I'm not sure
why, but I'm too sleepy to care ;-)
The thrust of the SF patch was to remove randomness in the
pickle protocol used. I changed the patch to use
range(pickle.HIGHEST_PROTOCOL + 1), to try both pickle and
cPickle, and randomly mucked with other test lines to put
statements on their own lines.
Not a bugfix candidate (this is fiddling new-in-2.5 code).
........
r46706 | andrew.kuchling | 2006-06-07 15:55:33 +0200 (Wed, 07 Jun 2006) | 1 line
Add an SQLite introduction, taken from the 'What's New' text
........
r46708 | andrew.kuchling | 2006-06-07 19:02:52 +0200 (Wed, 07 Jun 2006) | 1 line
Mention other placeholders
........
r46709 | andrew.kuchling | 2006-06-07 19:03:46 +0200 (Wed, 07 Jun 2006) | 1 line
Add an item; also, escape %
........
r46710 | andrew.kuchling | 2006-06-07 19:04:01 +0200 (Wed, 07 Jun 2006) | 1 line
Mention other placeholders
........
r46716 | ronald.oussoren | 2006-06-07 20:57:44 +0200 (Wed, 07 Jun 2006) | 2 lines
Move Mac/OSX/Tools one level up
........
r46717 | ronald.oussoren | 2006-06-07 20:58:01 +0200 (Wed, 07 Jun 2006) | 2 lines
Move Mac/OSX/PythonLauncher one level up
........
r46718 | ronald.oussoren | 2006-06-07 20:58:42 +0200 (Wed, 07 Jun 2006) | 2 lines
mv Mac/OSX/BuildScript one level up
........
r46719 | ronald.oussoren | 2006-06-07 21:02:03 +0200 (Wed, 07 Jun 2006) | 2 lines
Move Mac/OSX/* one level up
........
r46720 | ronald.oussoren | 2006-06-07 21:06:01 +0200 (Wed, 07 Jun 2006) | 2 lines
And the last bit: move IDLE one level up and adjust makefiles
........
r46723 | ronald.oussoren | 2006-06-07 21:38:53 +0200 (Wed, 07 Jun 2006) | 4 lines
- Patch the correct version of python in the Info.plists at build time, instead
of relying on a maintainer to update them before releases.
- Remove the now empty Mac/OSX directory
........
r46727 | ronald.oussoren | 2006-06-07 22:18:44 +0200 (Wed, 07 Jun 2006) | 7 lines
* If BuildApplet.py is used as an applet it starts with a version of
sys.exutable that isn't usuable on an #!-line. That results in generated
applets that don't actually work. Work around this problem by resetting
sys.executable.
* argvemulator.py didn't work on intel macs. This patch fixes this
(bug #1491468)
........
r46728 | tim.peters | 2006-06-07 22:40:06 +0200 (Wed, 07 Jun 2006) | 2 lines
Whitespace normalization.
........
r46729 | tim.peters | 2006-06-07 22:40:54 +0200 (Wed, 07 Jun 2006) | 2 lines
Add missing svn:eol-style property to text files.
........
r46730 | thomas.heller | 2006-06-07 22:43:06 +0200 (Wed, 07 Jun 2006) | 7 lines
Fix for foreign functions returning small structures on 64-bit big
endian machines. Should fix the remaininf failure in the PPC64
Debian buildbot.
Thanks to Matthias Klose for providing access to a machine to debug
and test this.
........
r46731 | brett.cannon | 2006-06-07 23:48:17 +0200 (Wed, 07 Jun 2006) | 2 lines
Clarify documentation for bf_getcharbuffer.
........
r46735 | neal.norwitz | 2006-06-08 07:12:45 +0200 (Thu, 08 Jun 2006) | 1 line
Fix a refleak in recvfrom_into
........
r46736 | gregory.p.smith | 2006-06-08 07:17:08 +0200 (Thu, 08 Jun 2006) | 9 lines
- bsddb: the bsddb.dbtables Modify method now raises the proper error and
aborts the db transaction safely when a modifier callback fails.
Fixes SF python patch/bug #1408584.
Also cleans up the bsddb.dbtables docstrings since thats the only
documentation that exists for that unadvertised module. (people
really should really just use sqlite3)
........
r46737 | gregory.p.smith | 2006-06-08 07:38:11 +0200 (Thu, 08 Jun 2006) | 4 lines
* Turn the deadlock situation described in SF bug #775414 into a
DBDeadLockError exception.
* add the test case for my previous dbtables commit.
........
r46738 | gregory.p.smith | 2006-06-08 07:39:54 +0200 (Thu, 08 Jun 2006) | 2 lines
pasted set_lk_detect line in wrong spot in previous commit. fixed. passes tests this time.
........
r46739 | armin.rigo | 2006-06-08 12:56:24 +0200 (Thu, 08 Jun 2006) | 6 lines
(arre, arigo) SF bug #1350060
Give a consistent behavior for comparison and hashing of method objects
(both user- and built-in methods). Now compares the 'self' recursively.
The hash was already asking for the hash of 'self'.
........
r46740 | andrew.kuchling | 2006-06-08 13:56:44 +0200 (Thu, 08 Jun 2006) | 1 line
Typo fix
........
r46741 | georg.brandl | 2006-06-08 14:45:01 +0200 (Thu, 08 Jun 2006) | 2 lines
Bug #1502750: Fix getargs "i" format to use LONG_MIN and LONG_MAX for bounds checking.
........
r46743 | georg.brandl | 2006-06-08 14:54:13 +0200 (Thu, 08 Jun 2006) | 2 lines
Bug #1502728: Correctly link against librt library on HP-UX.
........
r46745 | georg.brandl | 2006-06-08 14:55:47 +0200 (Thu, 08 Jun 2006) | 3 lines
Add news for recent bugfix.
........
r46746 | georg.brandl | 2006-06-08 15:31:07 +0200 (Thu, 08 Jun 2006) | 4 lines
Argh. "integer" is a very confusing word ;)
Actually, checking for INT_MAX and INT_MIN is correct since
the format code explicitly handles a C "int".
........
r46748 | nick.coghlan | 2006-06-08 15:54:49 +0200 (Thu, 08 Jun 2006) | 1 line
Add functools.update_wrapper() and functools.wraps() as described in PEP 356
........
r46751 | georg.brandl | 2006-06-08 16:50:21 +0200 (Thu, 08 Jun 2006) | 4 lines
Bug #1502805: don't alias file.__exit__ to file.close since the
latter can return something that's true.
........
r46752 | georg.brandl | 2006-06-08 16:50:53 +0200 (Thu, 08 Jun 2006) | 3 lines
Convert test_file to unittest.
........
diff --git a/Mac/BuildScript/build-installer.py b/Mac/BuildScript/build-installer.py
new file mode 100755
index 0000000..05afe98
--- /dev/null
+++ b/Mac/BuildScript/build-installer.py
@@ -0,0 +1,1028 @@
+#!/usr/bin/python2.3
+"""
+This script is used to build the "official unofficial" universal build on
+Mac OS X. It requires Mac OS X 10.4, Xcode 2.2 and the 10.4u SDK to do its
+work.
+
+Please ensure that this script keeps working with Python 2.3, to avoid
+bootstrap issues (/usr/bin/python is Python 2.3 on OSX 10.4)
+
+Usage: see USAGE variable in the script.
+"""
+import platform, os, sys, getopt, textwrap, shutil, urllib2, stat, time, pwd
+
+INCLUDE_TIMESTAMP=1
+VERBOSE=1
+
+from plistlib import Plist
+
+import MacOS
+import Carbon.File
+import Carbon.Icn
+import Carbon.Res
+from Carbon.Files import kCustomIconResource, fsRdWrPerm, kHasCustomIcon
+from Carbon.Files import kFSCatInfoFinderInfo
+
+try:
+ from plistlib import writePlist
+except ImportError:
+ # We're run using python2.3
+ def writePlist(plist, path):
+ plist.write(path)
+
+def shellQuote(value):
+ """
+ Return the string value in a form that can savely be inserted into
+ a shell command.
+ """
+ return "'%s'"%(value.replace("'", "'\"'\"'"))
+
+def grepValue(fn, variable):
+ variable = variable + '='
+ for ln in open(fn, 'r'):
+ if ln.startswith(variable):
+ value = ln[len(variable):].strip()
+ return value[1:-1]
+
+def getVersion():
+ return grepValue(os.path.join(SRCDIR, 'configure'), 'PACKAGE_VERSION')
+
+def getFullVersion():
+ fn = os.path.join(SRCDIR, 'Include', 'patchlevel.h')
+ for ln in open(fn):
+ if 'PY_VERSION' in ln:
+ return ln.split()[-1][1:-1]
+
+ raise RuntimeError, "Cannot find full version??"
+
+# The directory we'll use to create the build, will be erased and recreated
+WORKDIR="/tmp/_py"
+
+# The directory we'll use to store third-party sources, set this to something
+# else if you don't want to re-fetch required libraries every time.
+DEPSRC=os.path.join(WORKDIR, 'third-party')
+DEPSRC=os.path.expanduser('~/Universal/other-sources')
+
+# Location of the preferred SDK
+SDKPATH="/Developer/SDKs/MacOSX10.4u.sdk"
+#SDKPATH="/"
+
+# Source directory (asume we're in Mac/BuildScript)
+SRCDIR=os.path.dirname(
+ os.path.dirname(
+ os.path.dirname(
+ os.path.abspath(__file__
+ ))))
+
+USAGE=textwrap.dedent("""\
+ Usage: build_python [options]
+
+ Options:
+ -? or -h: Show this message
+ -b DIR
+ --build-dir=DIR: Create build here (default: %(WORKDIR)r)
+ --third-party=DIR: Store third-party sources here (default: %(DEPSRC)r)
+ --sdk-path=DIR: Location of the SDK (default: %(SDKPATH)r)
+ --src-dir=DIR: Location of the Python sources (default: %(SRCDIR)r)
+""")% globals()
+
+
+# Instructions for building libraries that are necessary for building a
+# batteries included python.
+LIBRARY_RECIPES=[
+ dict(
+ # Note that GNU readline is GPL'd software
+ name="GNU Readline 5.1.4",
+ url="http://ftp.gnu.org/pub/gnu/readline/readline-5.1.tar.gz" ,
+ patchlevel='0',
+ patches=[
+ # The readline maintainers don't do actual micro releases, but
+ # just ship a set of patches.
+ 'http://ftp.gnu.org/pub/gnu/readline/readline-5.1-patches/readline51-001',
+ 'http://ftp.gnu.org/pub/gnu/readline/readline-5.1-patches/readline51-002',
+ 'http://ftp.gnu.org/pub/gnu/readline/readline-5.1-patches/readline51-003',
+ 'http://ftp.gnu.org/pub/gnu/readline/readline-5.1-patches/readline51-004',
+ ]
+ ),
+
+ dict(
+ name="SQLite 3.3.5",
+ url="http://www.sqlite.org/sqlite-3.3.5.tar.gz",
+ checksum='93f742986e8bc2dfa34792e16df017a6feccf3a2',
+ configure_pre=[
+ '--enable-threadsafe',
+ '--enable-tempstore',
+ '--enable-shared=no',
+ '--enable-static=yes',
+ '--disable-tcl',
+ ]
+ ),
+
+ dict(
+ name="NCurses 5.5",
+ url="http://ftp.gnu.org/pub/gnu/ncurses/ncurses-5.5.tar.gz",
+ configure_pre=[
+ "--without-cxx",
+ "--without-ada",
+ "--without-progs",
+ "--without-curses-h",
+ "--enable-shared",
+ "--with-shared",
+ "--datadir=/usr/share",
+ "--sysconfdir=/etc",
+ "--sharedstatedir=/usr/com",
+ "--with-terminfo-dirs=/usr/share/terminfo",
+ "--with-default-terminfo-dir=/usr/share/terminfo",
+ "--libdir=/Library/Frameworks/Python.framework/Versions/%s/lib"%(getVersion(),),
+ "--enable-termcap",
+ ],
+ patches=[
+ "ncurses-5.5.patch",
+ ],
+ useLDFlags=False,
+ install='make && make install DESTDIR=%s && cd %s/usr/local/lib && ln -fs ../../../Library/Frameworks/Python.framework/Versions/%s/lib/lib* .'%(
+ shellQuote(os.path.join(WORKDIR, 'libraries')),
+ shellQuote(os.path.join(WORKDIR, 'libraries')),
+ getVersion(),
+ ),
+ ),
+ dict(
+ name="Sleepycat DB 4.4",
+ url="http://downloads.sleepycat.com/db-4.4.20.tar.gz",
+ #name="Sleepycat DB 4.3.29",
+ #url="http://downloads.sleepycat.com/db-4.3.29.tar.gz",
+ buildDir="build_unix",
+ configure="../dist/configure",
+ configure_pre=[
+ '--includedir=/usr/local/include/db4',
+ ]
+ ),
+]
+
+
+# Instructions for building packages inside the .mpkg.
+PKG_RECIPES=[
+ dict(
+ name="PythonFramework",
+ long_name="Python Framework",
+ source="/Library/Frameworks/Python.framework",
+ readme="""\
+ This package installs Python.framework, that is the python
+ interpreter and the standard library. This also includes Python
+ wrappers for lots of Mac OS X API's.
+ """,
+ postflight="scripts/postflight.framework",
+ ),
+ dict(
+ name="PythonApplications",
+ long_name="GUI Applications",
+ source="/Applications/MacPython %(VER)s",
+ readme="""\
+ This package installs IDLE (an interactive Python IDLE),
+ Python Launcher and Build Applet (create application bundles
+ from python scripts).
+
+ It also installs a number of examples and demos.
+ """,
+ required=False,
+ ),
+ dict(
+ name="PythonUnixTools",
+ long_name="UNIX command-line tools",
+ source="/usr/local/bin",
+ readme="""\
+ This package installs the unix tools in /usr/local/bin for
+ compatibility with older releases of MacPython. This package
+ is not necessary to use MacPython.
+ """,
+ required=False,
+ ),
+ dict(
+ name="PythonDocumentation",
+ long_name="Python Documentation",
+ topdir="/Library/Frameworks/Python.framework/Versions/%(VER)s/Resources/English.lproj/Documentation",
+ source="/pydocs",
+ readme="""\
+ This package installs the python documentation at a location
+ that is useable for pydoc and IDLE. If you have installed Xcode
+ it will also install a link to the documentation in
+ /Developer/Documentation/Python
+ """,
+ postflight="scripts/postflight.documentation",
+ required=False,
+ ),
+ dict(
+ name="PythonProfileChanges",
+ long_name="Shell profile updater",
+ readme="""\
+ This packages updates your shell profile to make sure that
+ the MacPython tools are found by your shell in preference of
+ the system provided Python tools.
+
+ If you don't install this package you'll have to add
+ "/Library/Frameworks/Python.framework/Versions/%(VER)s/bin"
+ to your PATH by hand.
+ """,
+ postflight="scripts/postflight.patch-profile",
+ topdir="/Library/Frameworks/Python.framework",
+ source="/empty-dir",
+ required=False,
+ ),
+ dict(
+ name="PythonSystemFixes",
+ long_name="Fix system Python",
+ readme="""\
+ This package updates the system python installation on
+ Mac OS X 10.3 to ensure that you can build new python extensions
+ using that copy of python after installing this version of
+ python.
+ """
+ postflight="../Tools/fixapplepython23.py",
+ topdir="/Library/Frameworks/Python.framework",
+ source="/empty-dir",
+ required=False,
+ )
+]
+
+def fatal(msg):
+ """
+ A fatal error, bail out.
+ """
+ sys.stderr.write('FATAL: ')
+ sys.stderr.write(msg)
+ sys.stderr.write('\n')
+ sys.exit(1)
+
+def fileContents(fn):
+ """
+ Return the contents of the named file
+ """
+ return open(fn, 'rb').read()
+
+def runCommand(commandline):
+ """
+ Run a command and raise RuntimeError if it fails. Output is surpressed
+ unless the command fails.
+ """
+ fd = os.popen(commandline, 'r')
+ data = fd.read()
+ xit = fd.close()
+ if xit != None:
+ sys.stdout.write(data)
+ raise RuntimeError, "command failed: %s"%(commandline,)
+
+ if VERBOSE:
+ sys.stdout.write(data); sys.stdout.flush()
+
+def captureCommand(commandline):
+ fd = os.popen(commandline, 'r')
+ data = fd.read()
+ xit = fd.close()
+ if xit != None:
+ sys.stdout.write(data)
+ raise RuntimeError, "command failed: %s"%(commandline,)
+
+ return data
+
+def checkEnvironment():
+ """
+ Check that we're running on a supported system.
+ """
+
+ if platform.system() != 'Darwin':
+ fatal("This script should be run on a Mac OS X 10.4 system")
+
+ if platform.release() <= '8.':
+ fatal("This script should be run on a Mac OS X 10.4 system")
+
+ if not os.path.exists(SDKPATH):
+ fatal("Please install the latest version of Xcode and the %s SDK"%(
+ os.path.basename(SDKPATH[:-4])))
+
+
+
+def parseOptions(args = None):
+ """
+ Parse arguments and update global settings.
+ """
+ global WORKDIR, DEPSRC, SDKPATH, SRCDIR
+
+ if args is None:
+ args = sys.argv[1:]
+
+ try:
+ options, args = getopt.getopt(args, '?hb',
+ [ 'build-dir=', 'third-party=', 'sdk-path=' , 'src-dir='])
+ except getopt.error, msg:
+ print msg
+ sys.exit(1)
+
+ if args:
+ print "Additional arguments"
+ sys.exit(1)
+
+ for k, v in options:
+ if k in ('-h', '-?'):
+ print USAGE
+ sys.exit(0)
+
+ elif k in ('-d', '--build-dir'):
+ WORKDIR=v
+
+ elif k in ('--third-party',):
+ DEPSRC=v
+
+ elif k in ('--sdk-path',):
+ SDKPATH=v
+
+ elif k in ('--src-dir',):
+ SRCDIR=v
+
+ else:
+ raise NotImplementedError, k
+
+ SRCDIR=os.path.abspath(SRCDIR)
+ WORKDIR=os.path.abspath(WORKDIR)
+ SDKPATH=os.path.abspath(SDKPATH)
+ DEPSRC=os.path.abspath(DEPSRC)
+
+ print "Settings:"
+ print " * Source directory:", SRCDIR
+ print " * Build directory: ", WORKDIR
+ print " * SDK location: ", SDKPATH
+ print " * third-party source:", DEPSRC
+ print ""
+
+
+
+
+def extractArchive(builddir, archiveName):
+ """
+ Extract a source archive into 'builddir'. Returns the path of the
+ extracted archive.
+
+ XXX: This function assumes that archives contain a toplevel directory
+ that is has the same name as the basename of the archive. This is
+ save enough for anything we use.
+ """
+ curdir = os.getcwd()
+ try:
+ os.chdir(builddir)
+ if archiveName.endswith('.tar.gz'):
+ retval = os.path.basename(archiveName[:-7])
+ if os.path.exists(retval):
+ shutil.rmtree(retval)
+ fp = os.popen("tar zxf %s 2>&1"%(shellQuote(archiveName),), 'r')
+
+ elif archiveName.endswith('.tar.bz2'):
+ retval = os.path.basename(archiveName[:-8])
+ if os.path.exists(retval):
+ shutil.rmtree(retval)
+ fp = os.popen("tar jxf %s 2>&1"%(shellQuote(archiveName),), 'r')
+
+ elif archiveName.endswith('.tar'):
+ retval = os.path.basename(archiveName[:-4])
+ if os.path.exists(retval):
+ shutil.rmtree(retval)
+ fp = os.popen("tar xf %s 2>&1"%(shellQuote(archiveName),), 'r')
+
+ elif archiveName.endswith('.zip'):
+ retval = os.path.basename(archiveName[:-4])
+ if os.path.exists(retval):
+ shutil.rmtree(retval)
+ fp = os.popen("unzip %s 2>&1"%(shellQuote(archiveName),), 'r')
+
+ data = fp.read()
+ xit = fp.close()
+ if xit is not None:
+ sys.stdout.write(data)
+ raise RuntimeError, "Cannot extract %s"%(archiveName,)
+
+ return os.path.join(builddir, retval)
+
+ finally:
+ os.chdir(curdir)
+
+KNOWNSIZES = {
+ "http://ftp.gnu.org/pub/gnu/readline/readline-5.1.tar.gz": 7952742,
+ "http://downloads.sleepycat.com/db-4.4.20.tar.gz": 2030276,
+}
+
+def downloadURL(url, fname):
+ """
+ Download the contents of the url into the file.
+ """
+ try:
+ size = os.path.getsize(fname)
+ except OSError:
+ pass
+ else:
+ if KNOWNSIZES.get(url) == size:
+ print "Using existing file for", url
+ return
+ fpIn = urllib2.urlopen(url)
+ fpOut = open(fname, 'wb')
+ block = fpIn.read(10240)
+ try:
+ while block:
+ fpOut.write(block)
+ block = fpIn.read(10240)
+ fpIn.close()
+ fpOut.close()
+ except:
+ try:
+ os.unlink(fname)
+ except:
+ pass
+
+def buildRecipe(recipe, basedir, archList):
+ """
+ Build software using a recipe. This function does the
+ 'configure;make;make install' dance for C software, with a possibility
+ to customize this process, basically a poor-mans DarwinPorts.
+ """
+ curdir = os.getcwd()
+
+ name = recipe['name']
+ url = recipe['url']
+ configure = recipe.get('configure', './configure')
+ install = recipe.get('install', 'make && make install DESTDIR=%s'%(
+ shellQuote(basedir)))
+
+ archiveName = os.path.split(url)[-1]
+ sourceArchive = os.path.join(DEPSRC, archiveName)
+
+ if not os.path.exists(DEPSRC):
+ os.mkdir(DEPSRC)
+
+
+ if os.path.exists(sourceArchive):
+ print "Using local copy of %s"%(name,)
+
+ else:
+ print "Downloading %s"%(name,)
+ downloadURL(url, sourceArchive)
+ print "Archive for %s stored as %s"%(name, sourceArchive)
+
+ print "Extracting archive for %s"%(name,)
+ buildDir=os.path.join(WORKDIR, '_bld')
+ if not os.path.exists(buildDir):
+ os.mkdir(buildDir)
+
+ workDir = extractArchive(buildDir, sourceArchive)
+ os.chdir(workDir)
+ if 'buildDir' in recipe:
+ os.chdir(recipe['buildDir'])
+
+
+ for fn in recipe.get('patches', ()):
+ if fn.startswith('http://'):
+ # Download the patch before applying it.
+ path = os.path.join(DEPSRC, os.path.basename(fn))
+ downloadURL(fn, path)
+ fn = path
+
+ fn = os.path.join(curdir, fn)
+ runCommand('patch -p%s < %s'%(recipe.get('patchlevel', 1),
+ shellQuote(fn),))
+
+ configure_args = [
+ "--prefix=/usr/local",
+ "--enable-static",
+ "--disable-shared",
+ #"CPP=gcc -arch %s -E"%(' -arch '.join(archList,),),
+ ]
+
+ if 'configure_pre' in recipe:
+ args = list(recipe['configure_pre'])
+ if '--disable-static' in args:
+ configure_args.remove('--enable-static')
+ if '--enable-shared' in args:
+ configure_args.remove('--disable-shared')
+ configure_args.extend(args)
+
+ if recipe.get('useLDFlags', 1):
+ configure_args.extend([
+ "CFLAGS=-arch %s -isysroot %s -I%s/usr/local/include"%(
+ ' -arch '.join(archList),
+ shellQuote(SDKPATH)[1:-1],
+ shellQuote(basedir)[1:-1],),
+ "LDFLAGS=-syslibroot,%s -L%s/usr/local/lib -arch %s"%(
+ shellQuote(SDKPATH)[1:-1],
+ shellQuote(basedir)[1:-1],
+ ' -arch '.join(archList)),
+ ])
+ else:
+ configure_args.extend([
+ "CFLAGS=-arch %s -isysroot %s -I%s/usr/local/include"%(
+ ' -arch '.join(archList),
+ shellQuote(SDKPATH)[1:-1],
+ shellQuote(basedir)[1:-1],),
+ ])
+
+ if 'configure_post' in recipe:
+ configure_args = configure_args = list(recipe['configure_post'])
+
+ configure_args.insert(0, configure)
+ configure_args = [ shellQuote(a) for a in configure_args ]
+
+ print "Running configure for %s"%(name,)
+ runCommand(' '.join(configure_args) + ' 2>&1')
+
+ print "Running install for %s"%(name,)
+ runCommand('{ ' + install + ' ;} 2>&1')
+
+ print "Done %s"%(name,)
+ print ""
+
+ os.chdir(curdir)
+
+def buildLibraries():
+ """
+ Build our dependencies into $WORKDIR/libraries/usr/local
+ """
+ print ""
+ print "Building required libraries"
+ print ""
+ universal = os.path.join(WORKDIR, 'libraries')
+ os.mkdir(universal)
+ os.makedirs(os.path.join(universal, 'usr', 'local', 'lib'))
+ os.makedirs(os.path.join(universal, 'usr', 'local', 'include'))
+
+ for recipe in LIBRARY_RECIPES:
+ buildRecipe(recipe, universal, ('i386', 'ppc',))
+
+
+
+def buildPythonDocs():
+ # This stores the documentation as Resources/English.lproj/Docuentation
+ # inside the framwork. pydoc and IDLE will pick it up there.
+ print "Install python documentation"
+ rootDir = os.path.join(WORKDIR, '_root')
+ version = getVersion()
+ docdir = os.path.join(rootDir, 'pydocs')
+
+ name = 'html-%s.tar.bz2'%(getFullVersion(),)
+ sourceArchive = os.path.join(DEPSRC, name)
+ if os.path.exists(sourceArchive):
+ print "Using local copy of %s"%(name,)
+
+ else:
+ print "Downloading %s"%(name,)
+ downloadURL('http://www.python.org/ftp/python/doc/%s/%s'%(
+ getFullVersion(), name), sourceArchive)
+ print "Archive for %s stored as %s"%(name, sourceArchive)
+
+ extractArchive(os.path.dirname(docdir), sourceArchive)
+ os.rename(
+ os.path.join(
+ os.path.dirname(docdir), 'Python-Docs-%s'%(getFullVersion(),)),
+ docdir)
+
+
+def buildPython():
+ print "Building a universal python"
+
+ buildDir = os.path.join(WORKDIR, '_bld', 'python')
+ rootDir = os.path.join(WORKDIR, '_root')
+
+ if os.path.exists(buildDir):
+ shutil.rmtree(buildDir)
+ if os.path.exists(rootDir):
+ shutil.rmtree(rootDir)
+ os.mkdir(buildDir)
+ os.mkdir(rootDir)
+ os.mkdir(os.path.join(rootDir, 'empty-dir'))
+ curdir = os.getcwd()
+ os.chdir(buildDir)
+
+ # Not sure if this is still needed, the original build script
+ # claims that parts of the install assume python.exe exists.
+ os.symlink('python', os.path.join(buildDir, 'python.exe'))
+
+ # Extract the version from the configure file, needed to calculate
+ # several paths.
+ version = getVersion()
+
+ print "Running configure..."
+ runCommand("%s -C --enable-framework --enable-universalsdk=%s LDFLAGS='-g -L%s/libraries/usr/local/lib' OPT='-g -O3 -I%s/libraries/usr/local/include' 2>&1"%(
+ shellQuote(os.path.join(SRCDIR, 'configure')),
+ shellQuote(SDKPATH), shellQuote(WORKDIR)[1:-1],
+ shellQuote(WORKDIR)[1:-1]))
+
+ print "Running make"
+ runCommand("make")
+
+ print "Runing make frameworkinstall"
+ runCommand("make frameworkinstall DESTDIR=%s"%(
+ shellQuote(rootDir)))
+
+ print "Runing make frameworkinstallextras"
+ runCommand("make frameworkinstallextras DESTDIR=%s"%(
+ shellQuote(rootDir)))
+
+ print "Copy required shared libraries"
+ if os.path.exists(os.path.join(WORKDIR, 'libraries', 'Library')):
+ runCommand("mv %s/* %s"%(
+ shellQuote(os.path.join(
+ WORKDIR, 'libraries', 'Library', 'Frameworks',
+ 'Python.framework', 'Versions', getVersion(),
+ 'lib')),
+ shellQuote(os.path.join(WORKDIR, '_root', 'Library', 'Frameworks',
+ 'Python.framework', 'Versions', getVersion(),
+ 'lib'))))
+
+ print "Fix file modes"
+ frmDir = os.path.join(rootDir, 'Library', 'Frameworks', 'Python.framework')
+ for dirpath, dirnames, filenames in os.walk(frmDir):
+ for dn in dirnames:
+ os.chmod(os.path.join(dirpath, dn), 0775)
+
+ for fn in filenames:
+ if os.path.islink(fn):
+ continue
+
+ # "chmod g+w $fn"
+ p = os.path.join(dirpath, fn)
+ st = os.stat(p)
+ os.chmod(p, stat.S_IMODE(st.st_mode) | stat.S_IXGRP)
+
+ # We added some directories to the search path during the configure
+ # phase. Remove those because those directories won't be there on
+ # the end-users system.
+ path =os.path.join(rootDir, 'Library', 'Frameworks', 'Python.framework',
+ 'Versions', version, 'lib', 'python%s'%(version,),
+ 'config', 'Makefile')
+ fp = open(path, 'r')
+ data = fp.read()
+ fp.close()
+
+ data = data.replace('-L%s/libraries/usr/local/lib'%(WORKDIR,), '')
+ data = data.replace('-I%s/libraries/usr/local/include'%(WORKDIR,), '')
+ fp = open(path, 'w')
+ fp.write(data)
+ fp.close()
+
+ # Add symlinks in /usr/local/bin, using relative links
+ usr_local_bin = os.path.join(rootDir, 'usr', 'local', 'bin')
+ to_framework = os.path.join('..', '..', '..', 'Library', 'Frameworks',
+ 'Python.framework', 'Versions', version, 'bin')
+ if os.path.exists(usr_local_bin):
+ shutil.rmtree(usr_local_bin)
+ os.makedirs(usr_local_bin)
+ for fn in os.listdir(
+ os.path.join(frmDir, 'Versions', version, 'bin')):
+ os.symlink(os.path.join(to_framework, fn),
+ os.path.join(usr_local_bin, fn))
+
+ os.chdir(curdir)
+
+
+
+def patchFile(inPath, outPath):
+ data = fileContents(inPath)
+ data = data.replace('$FULL_VERSION', getFullVersion())
+ data = data.replace('$VERSION', getVersion())
+ data = data.replace('$MACOSX_DEPLOYMENT_TARGET', '10.3 or later')
+ data = data.replace('$ARCHITECTURES', "i386, ppc")
+ data = data.replace('$INSTALL_SIZE', installSize())
+ fp = open(outPath, 'wb')
+ fp.write(data)
+ fp.close()
+
+def patchScript(inPath, outPath):
+ data = fileContents(inPath)
+ data = data.replace('@PYVER@', getVersion())
+ fp = open(outPath, 'wb')
+ fp.write(data)
+ fp.close()
+ os.chmod(outPath, 0755)
+
+
+
+def packageFromRecipe(targetDir, recipe):
+ curdir = os.getcwd()
+ try:
+ pkgname = recipe['name']
+ srcdir = recipe.get('source')
+ pkgroot = recipe.get('topdir', srcdir)
+ postflight = recipe.get('postflight')
+ readme = textwrap.dedent(recipe['readme'])
+ isRequired = recipe.get('required', True)
+
+ print "- building package %s"%(pkgname,)
+
+ # Substitute some variables
+ textvars = dict(
+ VER=getVersion(),
+ FULLVER=getFullVersion(),
+ )
+ readme = readme % textvars
+
+ if pkgroot is not None:
+ pkgroot = pkgroot % textvars
+ else:
+ pkgroot = '/'
+
+ if srcdir is not None:
+ srcdir = os.path.join(WORKDIR, '_root', srcdir[1:])
+ srcdir = srcdir % textvars
+
+ if postflight is not None:
+ postflight = os.path.abspath(postflight)
+
+ packageContents = os.path.join(targetDir, pkgname + '.pkg', 'Contents')
+ os.makedirs(packageContents)
+
+ if srcdir is not None:
+ os.chdir(srcdir)
+ runCommand("pax -wf %s . 2>&1"%(shellQuote(os.path.join(packageContents, 'Archive.pax')),))
+ runCommand("gzip -9 %s 2>&1"%(shellQuote(os.path.join(packageContents, 'Archive.pax')),))
+ runCommand("mkbom . %s 2>&1"%(shellQuote(os.path.join(packageContents, 'Archive.bom')),))
+
+ fn = os.path.join(packageContents, 'PkgInfo')
+ fp = open(fn, 'w')
+ fp.write('pmkrpkg1')
+ fp.close()
+
+ rsrcDir = os.path.join(packageContents, "Resources")
+ os.mkdir(rsrcDir)
+ fp = open(os.path.join(rsrcDir, 'ReadMe.txt'), 'w')
+ fp.write(readme)
+ fp.close()
+
+ if postflight is not None:
+ patchScript(postflight, os.path.join(rsrcDir, 'postflight'))
+
+ vers = getFullVersion()
+ major, minor = map(int, getVersion().split('.', 2))
+ pl = Plist(
+ CFBundleGetInfoString="MacPython.%s %s"%(pkgname, vers,),
+ CFBundleIdentifier='org.python.MacPython.%s'%(pkgname,),
+ CFBundleName='MacPython.%s'%(pkgname,),
+ CFBundleShortVersionString=vers,
+ IFMajorVersion=major,
+ IFMinorVersion=minor,
+ IFPkgFormatVersion=0.10000000149011612,
+ IFPkgFlagAllowBackRev=False,
+ IFPkgFlagAuthorizationAction="RootAuthorization",
+ IFPkgFlagDefaultLocation=pkgroot,
+ IFPkgFlagFollowLinks=True,
+ IFPkgFlagInstallFat=True,
+ IFPkgFlagIsRequired=isRequired,
+ IFPkgFlagOverwritePermissions=False,
+ IFPkgFlagRelocatable=False,
+ IFPkgFlagRestartAction="NoRestart",
+ IFPkgFlagRootVolumeOnly=True,
+ IFPkgFlagUpdateInstalledLangauges=False,
+ )
+ writePlist(pl, os.path.join(packageContents, 'Info.plist'))
+
+ pl = Plist(
+ IFPkgDescriptionDescription=readme,
+ IFPkgDescriptionTitle=recipe.get('long_name', "MacPython.%s"%(pkgname,)),
+ IFPkgDescriptionVersion=vers,
+ )
+ writePlist(pl, os.path.join(packageContents, 'Resources', 'Description.plist'))
+
+ finally:
+ os.chdir(curdir)
+
+
+def makeMpkgPlist(path):
+
+ vers = getFullVersion()
+ major, minor = map(int, getVersion().split('.', 2))
+
+ pl = Plist(
+ CFBundleGetInfoString="MacPython %s"%(vers,),
+ CFBundleIdentifier='org.python.MacPython',
+ CFBundleName='MacPython',
+ CFBundleShortVersionString=vers,
+ IFMajorVersion=major,
+ IFMinorVersion=minor,
+ IFPkgFlagComponentDirectory="Contents/Packages",
+ IFPkgFlagPackageList=[
+ dict(
+ IFPkgFlagPackageLocation='%s.pkg'%(item['name']),
+ IFPkgFlagPackageSelection='selected'
+ )
+ for item in PKG_RECIPES
+ ],
+ IFPkgFormatVersion=0.10000000149011612,
+ IFPkgFlagBackgroundScaling="proportional",
+ IFPkgFlagBackgroundAlignment="left",
+ )
+
+ writePlist(pl, path)
+
+
+def buildInstaller():
+
+ # Zap all compiled files
+ for dirpath, _, filenames in os.walk(os.path.join(WORKDIR, '_root')):
+ for fn in filenames:
+ if fn.endswith('.pyc') or fn.endswith('.pyo'):
+ os.unlink(os.path.join(dirpath, fn))
+
+ outdir = os.path.join(WORKDIR, 'installer')
+ if os.path.exists(outdir):
+ shutil.rmtree(outdir)
+ os.mkdir(outdir)
+
+ pkgroot = os.path.join(outdir, 'MacPython.mpkg', 'Contents')
+ pkgcontents = os.path.join(pkgroot, 'Packages')
+ os.makedirs(pkgcontents)
+ for recipe in PKG_RECIPES:
+ packageFromRecipe(pkgcontents, recipe)
+
+ rsrcDir = os.path.join(pkgroot, 'Resources')
+
+ fn = os.path.join(pkgroot, 'PkgInfo')
+ fp = open(fn, 'w')
+ fp.write('pmkrpkg1')
+ fp.close()
+
+ os.mkdir(rsrcDir)
+
+ makeMpkgPlist(os.path.join(pkgroot, 'Info.plist'))
+ pl = Plist(
+ IFPkgDescriptionTitle="Universal MacPython",
+ IFPkgDescriptionVersion=getVersion(),
+ )
+
+ writePlist(pl, os.path.join(pkgroot, 'Resources', 'Description.plist'))
+ for fn in os.listdir('resources'):
+ if fn == '.svn': continue
+ if fn.endswith('.jpg'):
+ shutil.copy(os.path.join('resources', fn), os.path.join(rsrcDir, fn))
+ else:
+ patchFile(os.path.join('resources', fn), os.path.join(rsrcDir, fn))
+
+ shutil.copy("../../../LICENSE", os.path.join(rsrcDir, 'License.txt'))
+
+
+def installSize(clear=False, _saved=[]):
+ if clear:
+ del _saved[:]
+ if not _saved:
+ data = captureCommand("du -ks %s"%(
+ shellQuote(os.path.join(WORKDIR, '_root'))))
+ _saved.append("%d"%((0.5 + (int(data.split()[0]) / 1024.0)),))
+ return _saved[0]
+
+
+def buildDMG():
+ """
+ Create DMG containing the rootDir
+ """
+ outdir = os.path.join(WORKDIR, 'diskimage')
+ if os.path.exists(outdir):
+ shutil.rmtree(outdir)
+
+ imagepath = os.path.join(outdir,
+ 'python-%s-macosx'%(getFullVersion(),))
+ if INCLUDE_TIMESTAMP:
+ imagepath = imagepath + '%04d-%02d-%02d'%(time.localtime()[:3])
+ imagepath = imagepath + '.dmg'
+
+ os.mkdir(outdir)
+ runCommand("hdiutil create -volname 'Univeral MacPython %s' -srcfolder %s %s"%(
+ getFullVersion(),
+ shellQuote(os.path.join(WORKDIR, 'installer')),
+ shellQuote(imagepath)))
+
+ return imagepath
+
+
+def setIcon(filePath, icnsPath):
+ """
+ Set the custom icon for the specified file or directory.
+
+ For a directory the icon data is written in a file named 'Icon\r' inside
+ the directory. For both files and directories write the icon as an 'icns'
+ resource. Furthermore set kHasCustomIcon in the finder flags for filePath.
+ """
+ ref, isDirectory = Carbon.File.FSPathMakeRef(icnsPath)
+ icon = Carbon.Icn.ReadIconFile(ref)
+ del ref
+
+ #
+ # Open the resource fork of the target, to add the icon later on.
+ # For directories we use the file 'Icon\r' inside the directory.
+ #
+
+ ref, isDirectory = Carbon.File.FSPathMakeRef(filePath)
+
+ if isDirectory:
+ tmpPath = os.path.join(filePath, "Icon\r")
+ if not os.path.exists(tmpPath):
+ fp = open(tmpPath, 'w')
+ fp.close()
+
+ tmpRef, _ = Carbon.File.FSPathMakeRef(tmpPath)
+ spec = Carbon.File.FSSpec(tmpRef)
+
+ else:
+ spec = Carbon.File.FSSpec(ref)
+
+ try:
+ Carbon.Res.HCreateResFile(*spec.as_tuple())
+ except MacOS.Error:
+ pass
+
+ # Try to create the resource fork again, this will avoid problems
+ # when adding an icon to a directory. I have no idea why this helps,
+ # but without this adding the icon to a directory will fail sometimes.
+ try:
+ Carbon.Res.HCreateResFile(*spec.as_tuple())
+ except MacOS.Error:
+ pass
+
+ refNum = Carbon.Res.FSpOpenResFile(spec, fsRdWrPerm)
+
+ Carbon.Res.UseResFile(refNum)
+
+ # Check if there already is an icon, remove it if there is.
+ try:
+ h = Carbon.Res.Get1Resource('icns', kCustomIconResource)
+ except MacOS.Error:
+ pass
+
+ else:
+ h.RemoveResource()
+ del h
+
+ # Add the icon to the resource for of the target
+ res = Carbon.Res.Resource(icon)
+ res.AddResource('icns', kCustomIconResource, '')
+ res.WriteResource()
+ res.DetachResource()
+ Carbon.Res.CloseResFile(refNum)
+
+ # And now set the kHasCustomIcon property for the target. Annoyingly,
+ # python doesn't seem to have bindings for the API that is needed for
+ # this. Cop out and call SetFile
+ os.system("/Developer/Tools/SetFile -a C %s"%(
+ shellQuote(filePath),))
+
+ if isDirectory:
+ os.system('/Developer/Tools/SetFile -a V %s'%(
+ shellQuote(tmpPath),
+ ))
+
+def main():
+ # First parse options and check if we can perform our work
+ parseOptions()
+ checkEnvironment()
+
+ os.environ['MACOSX_DEPLOYMENT_TARGET'] = '10.3'
+
+ if os.path.exists(WORKDIR):
+ shutil.rmtree(WORKDIR)
+ os.mkdir(WORKDIR)
+
+ # Then build third-party libraries such as sleepycat DB4.
+ buildLibraries()
+
+ # Now build python itself
+ buildPython()
+ buildPythonDocs()
+ fn = os.path.join(WORKDIR, "_root", "Applications",
+ "MacPython %s"%(getVersion(),), "Update Shell Profile.command")
+ shutil.copy("scripts/postflight.patch-profile", fn)
+ os.chmod(fn, 0755)
+
+ folder = os.path.join(WORKDIR, "_root", "Applications", "MacPython %s"%(
+ getVersion(),))
+ os.chmod(folder, 0755)
+ setIcon(folder, "../Icons/Python Folder.icns")
+
+ # Create the installer
+ buildInstaller()
+
+ # And copy the readme into the directory containing the installer
+ patchFile('resources/ReadMe.txt', os.path.join(WORKDIR, 'installer', 'ReadMe.txt'))
+
+ # Ditto for the license file.
+ shutil.copy('../../../LICENSE', os.path.join(WORKDIR, 'installer', 'License.txt'))
+
+ fp = open(os.path.join(WORKDIR, 'installer', 'Build.txt'), 'w')
+ print >> fp, "# BUILD INFO"
+ print >> fp, "# Date:", time.ctime()
+ print >> fp, "# By:", pwd.getpwuid(os.getuid()).pw_gecos
+ fp.close()
+
+ # Custom icon for the DMG, shown when the DMG is mounted.
+ shutil.copy("../Icons/Disk Image.icns",
+ os.path.join(WORKDIR, "installer", ".VolumeIcon.icns"))
+ os.system("/Developer/Tools/SetFile -a C %s"%(
+ os.path.join(WORKDIR, "installer", ".VolumeIcon.icns")))
+
+
+ # And copy it to a DMG
+ buildDMG()
+
+
+if __name__ == "__main__":
+ main()