blob: 916bf5c8a1151f01640de8a6184cc3694bbb6f46 [file] [log] [blame]
Martin v. Löwisb38b0192004-01-02 21:13:28 +00001Building Python using VC++ 7.1
Guido van Rossuma29b3602000-03-29 01:51:37 +00002-------------------------------------
Tim Peters4b5fb072000-07-01 00:03:43 +00003This directory is used to build Python for Win32 platforms, e.g. Windows
Martin v. Löwisb38b0192004-01-02 21:13:28 +0000495, 98 and NT. It requires Microsoft Visual C++ 7.1
5(a.k.a. Visual Studio .NET 2003).
Guido van Rossum15b239f1998-05-26 14:16:23 +00006(For other Windows platforms and compilers, see ../PC/readme.txt.)
7
Martin v. Löwisb38b0192004-01-02 21:13:28 +00008All you need to do is open the workspace "pcbuild.sln" in MSVC++, select
9the Debug or Release setting (using "Solution Configuration" from
10the "Standard" toolbar"), and build the projects.
Guido van Rossum15b239f1998-05-26 14:16:23 +000011
Tim Petersbefc97c2001-01-18 19:01:39 +000012The proper order to build subprojects:
Guido van Rossum15b239f1998-05-26 14:16:23 +000013
Tim Peters97c96402001-01-17 23:23:13 +0000141) pythoncore (this builds the main Python DLL and library files,
Tim Petersbefc97c2001-01-18 19:01:39 +000015 python21.{dll, lib} in Release mode)
16 NOTE: in previous releases, this subproject was
17 named after the release number, e.g. python20.
Guido van Rossum15b239f1998-05-26 14:16:23 +000018
Tim Petersbefc97c2001-01-18 19:01:39 +0000192) python (this builds the main Python executable,
20 python.exe in Release mode)
Tim Peters4b5fb072000-07-01 00:03:43 +000021
223) the other subprojects, as desired or needed (note: you probably don't
23 want to build most of the other subprojects, unless you're building an
24 entire Python distribution from scratch, or specifically making changes
25 to the subsystems they implement; see SUBPROJECTS below)
Guido van Rossum15b239f1998-05-26 14:16:23 +000026
27When using the Debug setting, the output files have a _d added to
Martin v. Löwisb38b0192004-01-02 21:13:28 +000028their name: python24_d.dll, python_d.exe, parser_d.pyd, and so on.
Guido van Rossume79cf321998-07-07 22:35:03 +000029
Tim Peters4b5fb072000-07-01 00:03:43 +000030SUBPROJECTS
31-----------
Tim Peters610a8272000-07-01 02:51:23 +000032These subprojects should build out of the box. Subprojects other than the
Tim Petersbefc97c2001-01-18 19:01:39 +000033main ones (pythoncore, python, pythonw) generally build a DLL (renamed to
Tim Peters610a8272000-07-01 02:51:23 +000034.pyd) from a specific module so that users don't have to load the code
Tim Peters4b5fb072000-07-01 00:03:43 +000035supporting that module unless they import the module.
Guido van Rossume79cf321998-07-07 22:35:03 +000036
Tim Peters97c96402001-01-17 23:23:13 +000037pythoncore
Tim Peters4b5fb072000-07-01 00:03:43 +000038 .dll and .lib
39python
40 .exe
41pythonw
42 pythonw.exe, a variant of python.exe that doesn't pop up a DOS box
43_socket
44 socketmodule.c
Tim Petersd66595f2001-02-04 03:09:53 +000045_testcapi
Tim Petersb16c56f2001-02-02 21:24:51 +000046 tests of the Python C API, run via Lib/test/test_capi.py, and
Tim Petersd66595f2001-02-04 03:09:53 +000047 implemented by module Modules/_testcapimodule.c
Tim Petersb012a152002-02-13 23:56:46 +000048pyexpat
49 Python wrapper for accelerated XML parsing, which incorporates stable
50 code from the Expat project: http://sourceforge.net/projects/expat/
Tim Peters4b5fb072000-07-01 00:03:43 +000051select
52 selectmodule.c
Tim Peters19f52c22001-01-24 10:07:22 +000053unicodedata
Tim Peters4b5fb072000-07-01 00:03:43 +000054 large tables of Unicode data
Tim Peters4b5fb072000-07-01 00:03:43 +000055winsound
56 play sounds (typically .wav files) under Windows
57
58The following subprojects will generally NOT build out of the box. They
59wrap code Python doesn't control, and you'll need to download the base
Tim Petersaff12842000-08-25 06:52:44 +000060packages first and unpack them into siblings of PCbuilds's parent
61directory; for example, if your PCbuild is .......\dist\src\PCbuild\,
62unpack into new subdirectories of dist\.
Tim Peters4b5fb072000-07-01 00:03:43 +000063
64_tkinter
Tim Peters077736b2002-11-14 23:24:40 +000065 Python wrapper for the Tk windowing system. Requires building
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +000066 Tcl/Tk first. Following are instructions for Tcl/Tk 8.4.7; these
Guido van Rossumd54357d2004-03-20 21:00:26 +000067 should work for version 8.4.6 too, with suitable substitutions:
Tim Peters077736b2002-11-14 23:24:40 +000068
69 Get source
70 ----------
71 Go to
72 http://prdownloads.sourceforge.net/tcl/
73 and download
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +000074 tcl847-src.zip
75 tk847-src.zip
Tim Peters077736b2002-11-14 23:24:40 +000076 Unzip into
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +000077 dist\tcl8.4.7\
78 dist\tk8.4.7\
Tim Peters077736b2002-11-14 23:24:40 +000079 respectively.
80
Guido van Rossumd54357d2004-03-20 21:00:26 +000081 Build Tcl first (done here w/ MSVC 7.1 on Windows XP)
Tim Peters6c629952002-11-15 18:36:11 +000082 ---------------
Guido van Rossumd54357d2004-03-20 21:00:26 +000083 Use "Start -> All Programs -> Microsoft Visual Studio .NET 2003
84 -> Visual Studio .NET Tools -> Visual Studio .NET 2003 Command Prompt"
85 to get a shell window with the correct environment settings
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +000086 cd dist\tcl8.4.7\win
Tim Peters077736b2002-11-14 23:24:40 +000087 nmake -f makefile.vc
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +000088 nmake -f makefile.vc INSTALLDIR=..\..\tcltk install
Tim Peters077736b2002-11-14 23:24:40 +000089
90 XXX Should we compile with OPTS=threads?
91
Tim Peters011de6cc2004-04-11 17:29:12 +000092 Optional: run tests, via
93 nmake -f makefile.vc test
94
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +000095 On WinXP Pro, wholly up to date as of 30-Aug-2004:
96 all.tcl: Total 10572 Passed 9869 Skipped 703 Failed 0
Tim Peters011de6cc2004-04-11 17:29:12 +000097 Sourced 129 Test Files.
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +000098 Files with failing tests: ioCmd.test
Tim Peters077736b2002-11-14 23:24:40 +000099
Tim Peters077736b2002-11-14 23:24:40 +0000100 Build Tk
Tim Peters6c629952002-11-15 18:36:11 +0000101 --------
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +0000102 cd dist\tk8.4.7\win
103 nmake -f makefile.vc TCLDIR=..\..\tcl8.4.7
104 nmake -f makefile.vc TCLDIR=..\..\tcl8.4.7 INSTALLDIR=..\..\tcltk install
Tim Peters077736b2002-11-14 23:24:40 +0000105
106 XXX Should we compile with OPTS=threads?
107
Tim Peters077736b2002-11-14 23:24:40 +0000108 XXX Our installer copies a lot of stuff out of the Tcl/Tk install
109 XXX directory. Is all of that really needed for Python use of Tcl/Tk?
110
Tim Peters011de6cc2004-04-11 17:29:12 +0000111 Optional: run tests, via
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +0000112 nmake -f makefile.vc TCLDIR=..\..\tcl8.4.7 test
Tim Peters011de6cc2004-04-11 17:29:12 +0000113
Martin v. Löwis6de2d4d2004-08-30 09:22:04 +0000114 On WinXP Pro, wholly up to date as of 30-Aug-2004:
115 all.tcl: Total 8421 Passed 6826 Skipped 1581 Failed 14
116 Sourced 91 Test Files.
117 Files with failing tests: frame.test scrollbar.test textWind.test winDialog.test
118 winWm.test winfo.test
Tim Peters4b5fb072000-07-01 00:03:43 +0000119
120zlib
Tim Petersee826f82001-01-31 19:39:44 +0000121 Python wrapper for the zlib compression library. Get the source code
Jeremy Hylton73b3df92004-01-09 16:05:07 +0000122 for version 1.2.1 from a convenient mirror at:
Tim Peters6077f642002-03-13 21:51:55 +0000123 http://www.gzip.org/zlib/
Jeremy Hylton73b3df92004-01-09 16:05:07 +0000124 Unpack into dist\zlib-1.2.1.
Tim Petersee826f82001-01-31 19:39:44 +0000125 A custom pre-link step in the zlib project settings should manage to
Jeremy Hylton73b3df92004-01-09 16:05:07 +0000126 build zlib-1.2.1\zlib.lib by magic before zlib.pyd (or zlib_d.pyd) is
Tim Petersee826f82001-01-31 19:39:44 +0000127 linked in PCbuild\.
128 However, the zlib project is not smart enough to remove anything under
Jeremy Hylton73b3df92004-01-09 16:05:07 +0000129 zlib-1.2.1\ when you do a clean, so if you want to rebuild zlib.lib
130 you need to clean up zlib-1.2.1\ by hand.
Tim Peters4b5fb072000-07-01 00:03:43 +0000131
Tim Petersb0ead4e2002-11-09 04:48:58 +0000132bz2
133 Python wrapper for the libbz2 compression library. Homepage
134 http://sources.redhat.com/bzip2/
135 Download the source tarball, bzip2-1.0.2.tar.gz.
Tim Peters077736b2002-11-14 23:24:40 +0000136 Unpack into dist\bzip2-1.0.2. WARNING: If you're using WinZip, you
Tim Petersb0ead4e2002-11-09 04:48:58 +0000137 must disable its "TAR file smart CR/LF conversion" feature (under
138 Options -> Configuration -> Miscellaneous -> Other) for the duration.
Tim Peters077736b2002-11-14 23:24:40 +0000139
Thomas Heller46a007e2003-08-20 18:27:36 +0000140 A custom pre-link step in the bz2 project settings should manage to
141 build bzip2-1.0.2\libbz2.lib by magic before bz2.pyd (or bz2_d.pyd) is
142 linked in PCbuild\.
143 However, the bz2 project is not smart enough to remove anything under
144 bzip2-1.0.2\ when you do a clean, so if you want to rebuild bzip2.lib
145 you need to clean up bzip2-1.0.2\ by hand.
Tim Peters077736b2002-11-14 23:24:40 +0000146
Thomas Heller46a007e2003-08-20 18:27:36 +0000147 The build step shouldn't yield any warnings or errors, and should end
Tim Petersb0ead4e2002-11-09 04:48:58 +0000148 by displaying 6 blocks each terminated with
149 FC: no differences encountered
150 If FC finds differences, see the warning abou WinZip above (when I
151 first tried it, sample3.ref failed due to CRLF conversion).
Tim Peterscaba60a2004-01-04 02:04:35 +0000152
Tim Petersb0ead4e2002-11-09 04:48:58 +0000153 All of this managed to build bzip2-1.0.2\libbz2.lib, which the Python
154 project links in.
155
156
Tim Peters78e35f92002-11-22 20:00:34 +0000157_bsddb
Tim Peters00640262003-01-24 15:31:31 +0000158 Go to Sleepycat's download page:
159 http://www.sleepycat.com/download/
Tim Petersb0ead4e2002-11-09 04:48:58 +0000160
Mark Hammond2362da82004-01-06 04:04:01 +0000161 and download version 4.2.52.
Tim Peters011de6cc2004-04-11 17:29:12 +0000162
163 With or without strong cryptography? You can choose either with or
164 without strong cryptography, as per the instructions below. By
Thomas Heller81391402004-07-02 08:58:46 +0000165 default, Python is built and distributed WITHOUT strong crypto.
Tim Peters011de6cc2004-04-11 17:29:12 +0000166
Mark Hammond2362da82004-01-06 04:04:01 +0000167 Unpack into the dist\. directory, ensuring you expand with folder names.
Tim Peters011de6cc2004-04-11 17:29:12 +0000168
Mark Hammond2362da82004-01-06 04:04:01 +0000169 If you downloaded with strong crypto, this will create a dist\db-4.2.52
170 directory, and is ready to use.
Tim Peters011de6cc2004-04-11 17:29:12 +0000171
172 If you downloaded WITHOUT strong crypto, this will create a
Mark Hammond2362da82004-01-06 04:04:01 +0000173 dist\db-4.2.52.NC directory - this directory should be renamed to
174 dist\db-4.2.52 before use.
Tim Peters011de6cc2004-04-11 17:29:12 +0000175
Tim Petersa0d781a2004-04-11 18:23:06 +0000176 As of 11-Apr-2004, you also need to download and manually apply two
177 patches before proceeding (and the sleepycat download page tells you
178 about this). Cygwin patch worked for me. cd to dist\db-4.2.52 and
179 use "patch -p0 < patchfile" once for each downloaded patchfile.
180
Tim Peters00640262003-01-24 15:31:31 +0000181 Open
Martin v. Löwisb38b0192004-01-02 21:13:28 +0000182 dist\db-4.2.52\docs\index.html
Tim Peters00640262003-01-24 15:31:31 +0000183
Mark Hammond2362da82004-01-06 04:04:01 +0000184 and follow the "Windows->Building Berkeley DB with Visual C++ .NET"
185 instructions for building the Sleepycat
Tim Peters00640262003-01-24 15:31:31 +0000186 software. Note that Berkeley_DB.dsw is in the build_win32 subdirectory.
Guido van Rossumd54357d2004-03-20 21:00:26 +0000187 Build the "Release Static" version.
Tim Peters00640262003-01-24 15:31:31 +0000188
Guido van Rossumd54357d2004-03-20 21:00:26 +0000189 XXX We're linking against Release_static\libdb42s.lib.
Tim Peters84c7a3f2002-11-23 18:48:06 +0000190 XXX This yields the following warnings:
191"""
192Compiling...
193_bsddb.c
194Linking...
195 Creating library ./_bsddb.lib and object ./_bsddb.exp
Martin v. Löwisb38b0192004-01-02 21:13:28 +0000196_bsddb.obj : warning LNK4217: locally defined symbol _malloc imported in function __db_associateCallback
197_bsddb.obj : warning LNK4217: locally defined symbol _free imported in function __DB_consume
198_bsddb.obj : warning LNK4217: locally defined symbol _fclose imported in function _DB_verify
199_bsddb.obj : warning LNK4217: locally defined symbol _fopen imported in function _DB_verify
200_bsddb.obj : warning LNK4217: locally defined symbol _strncpy imported in function _init_pybsddb
201__bsddb - 0 error(s), 5 warning(s)
Tim Peters84c7a3f2002-11-23 18:48:06 +0000202"""
203 XXX This isn't encouraging, but I don't know what to do about it.
Tim Peters78e35f92002-11-22 20:00:34 +0000204
Tim Peters00640262003-01-24 15:31:31 +0000205 To run extensive tests, pass "-u bsddb" to regrtest.py. test_bsddb3.py
206 is then enabled. Running in verbose mode may be helpful.
207
208 XXX The test_bsddb3 tests don't always pass, on Windows (according to
Guido van Rossumd54357d2004-03-20 21:00:26 +0000209 XXX me) or on Linux (according to Barry). (I had much better luck
210 XXX on Win2K than on Win98SE.) The common failure mode across platforms
Tim Peters00640262003-01-24 15:31:31 +0000211 XXX is
212 XXX DBAgainError: (11, 'Resource temporarily unavailable -- unable
213 XXX to join the environment')
214 XXX
215 XXX and it appears timing-dependent. On Win2K I also saw this once:
216 XXX
217 XXX test02_SimpleLocks (bsddb.test.test_thread.HashSimpleThreaded) ...
218 XXX Exception in thread reader 1:
219 XXX Traceback (most recent call last):
220 XXX File "C:\Code\python\lib\threading.py", line 411, in __bootstrap
221 XXX self.run()
222 XXX File "C:\Code\python\lib\threading.py", line 399, in run
223 XXX apply(self.__target, self.__args, self.__kwargs)
224 XXX File "C:\Code\python\lib\bsddb\test\test_thread.py", line 268, in
225 XXX readerThread
226 XXX rec = c.next()
227 XXX DBLockDeadlockError: (-30996, 'DB_LOCK_DEADLOCK: Locker killed
228 XXX to resolve a deadlock')
Tim Petersad8605d2003-01-29 00:38:42 +0000229 XXX
230 XXX I'm told that DBLockDeadlockError is expected at times. It
231 XXX doesn't cause a test to fail when it happens (exceptions in
232 XXX threads are invisible to unittest).
Tim Peters00640262003-01-24 15:31:31 +0000233
Tim Peters71b24112004-04-11 19:02:59 +0000234 XXX 11-Apr-2004 tim
235 XXX On WinXP Pro, I got one failure from test_bsddb3:
236 XXX
237 XXX ERROR: test04_n_flag (bsddb.test.test_compat.CompatibilityTestCase)
238 XXX Traceback (most recent call last):
239 XXX File "C:\Code\python\lib\bsddb\test\test_compat.py", line 86, in test04_n_flag
240 XXX f = hashopen(self.filename, 'n')
241 XXX File "C:\Code\python\lib\bsddb\__init__.py", line 293, in hashopen
242 XXX d.open(file, db.DB_HASH, flags, mode)
243 XXX DBInvalidArgError: (22, 'Invalid argument -- DB_TRUNCATE illegal with locking specified')
Tim Peterse8bcb252002-12-04 02:39:52 +0000244
Mark Hammondf229f9f2002-12-03 05:47:26 +0000245_ssl
Tim Peterse8bcb252002-12-04 02:39:52 +0000246 Python wrapper for the secure sockets library.
Tim Peters4b5fb072000-07-01 00:03:43 +0000247
Mark Hammondf229f9f2002-12-03 05:47:26 +0000248 Get the latest source code for OpenSSL from
249 http://www.openssl.org
250
Tim Peterse8bcb252002-12-04 02:39:52 +0000251 You (probably) don't want the "engine" code. For example, get
Tim Petersa0d781a2004-04-11 18:23:06 +0000252 openssl-0.9.7d.tar.gz
Tim Peterse8bcb252002-12-04 02:39:52 +0000253 not
Tim Petersa0d781a2004-04-11 18:23:06 +0000254 openssl-engine-0.9.7d.tar.gz
Tim Peterse8bcb252002-12-04 02:39:52 +0000255
Mark Hammondf229f9f2002-12-03 05:47:26 +0000256 Unpack into the "dist" directory, retaining the folder name from
257 the archive - for example, the latest stable OpenSSL will install as
Thomas Heller81391402004-07-02 08:58:46 +0000258 dist/openssl-0.9.7d
Mark Hammondf229f9f2002-12-03 05:47:26 +0000259
260 You can (theoretically) use any version of OpenSSL you like - the
261 build process will automatically select the latest version.
262
263 You must also install ActivePerl from
264 http://www.activestate.com/Products/ActivePerl/
Tim Peterse8bcb252002-12-04 02:39:52 +0000265 as this is used by the OpenSSL build process. Complain to them <wink>.
Mark Hammondf229f9f2002-12-03 05:47:26 +0000266
267 The MSVC project simply invokes PCBuild/build_ssl.py to perform
Tim Peterse8bcb252002-12-04 02:39:52 +0000268 the build. This Python script locates and builds your OpenSSL
Mark Hammondf229f9f2002-12-03 05:47:26 +0000269 installation, then invokes a simple makefile to build the final .pyd.
270
271 build_ssl.py attempts to catch the most common errors (such as not
272 being able to find OpenSSL sources, or not being able to find a Perl
273 that works with OpenSSL) and give a reasonable error message.
274 If you have a problem that doesn't seem to be handled correctly
275 (eg, you know you have ActivePerl but we can't find it), please take
276 a peek at build_ssl.py and suggest patches. Note that build_ssl.py
277 should be able to be run directly from the command-line.
278
Tim Peterse8bcb252002-12-04 02:39:52 +0000279 build_ssl.py/MSVC isn't clever enough to clean OpenSSL - you must do
280 this by hand.
Tim Peters4b5fb072000-07-01 00:03:43 +0000281
Martin v. Löwis13e50fe2004-07-20 14:37:48 +0000282Building for Itanium
283--------------------
284
285The project files support a ReleaseItanium configuration which creates
286Win64/Itanium binaries. For this to work, you need to install the Platform
287SDK, in particular the 64-bit support. This includes an Itanium compiler
288(future releases of the SDK likely include an AMD64 compiler as well).
289In addition, you need the Visual Studio plugin for external C compilers,
290from http://sf.net/projects/vsextcomp. The plugin will wrap cl.exe, to
291locate the proper target compiler, and convert compiler options
292accordingly.
293
294The Itanium build has seen little testing. The SDK compiler reports a lot
295of warnings about conversion from size_t to int, which will be fixed in
296future Python releases.
Tim Peters6ee68d22002-12-04 03:16:37 +0000297
Tim Petersf9a4a6e2000-07-01 20:38:27 +0000298YOUR OWN EXTENSION DLLs
Tim Peters4b5fb072000-07-01 00:03:43 +0000299-----------------------
300If you want to create your own extension module DLL, there's an example
301with easy-to-follow instructions in ../PC/example/; read the file
302readme.txt there first.