blob: 657849698686f76dbec63d0b80e51385ffa1160d [file] [log] [blame]
Greg Ward7c1e5f62000-03-10 01:56:58 +00001\documentclass{howto}
2\usepackage{ltxmarkup}
3\usepackage{times}
Greg Ward7593eb32000-04-09 03:59:15 +00004\usepackage{distutils}
Greg Ward7c1e5f62000-03-10 01:56:58 +00005
6\title{Installing Python Modules}
7
8% The audience for this document includes people who don't know anything
9% about Python and aren't about to learn the language just in order to
10% install and maintain it for their users, i.e. system administrators.
11% Thus, I have to be sure to explain the basics at some point:
12% sys.path and PYTHONPATH at least. Should probably give pointers to
13% other docs on "import site", PYTHONSTARTUP, PYTHONHOME, etc.
14%
15% Also, I need to take into account that most modules out there don't
16% (yet) use Distutils: briefly explain the old Makefile.pre.in
17% convention (maybe move material from the E&E manual to here?), and
18% explain where to copy .py and .so files manually if the distribution
19% doesn't provide a mechanism for doing so.
20%
21% Finally, it might be useful to include all the material from my "Care
22% and Feeding of a Python Installation" talk in here somewhere. Yow!
23
Greg Ward7c1e5f62000-03-10 01:56:58 +000024\author{Greg Ward}
25\authoraddress{E-mail: \email{gward@python.net}}
26
Greg Warde3cca262000-08-31 16:36:31 +000027\makeindex
Greg Ward7c1e5f62000-03-10 01:56:58 +000028
29\begin{document}
30
31\maketitle
32
Greg Warde3cca262000-08-31 16:36:31 +000033\begin{abstract}
34 \noindent
35 This document describes the Python Distribution Utilities
36 (``Distutils'') from the end-user's point-of-view, describing how to
37 extend the capabilities of a standard Python installation by building
38 and installing third-party Python modules and extensions.
39\end{abstract}
40
Greg Ward7c1e5f62000-03-10 01:56:58 +000041%\begin{abstract}
42%\noindent
43%Abstract this!
44%\end{abstract}
45
46\tableofcontents
47
48\section{Introduction}
Greg Warde78298a2000-04-28 17:12:24 +000049\label{intro}
Greg Ward7c1e5f62000-03-10 01:56:58 +000050
Greg Ward6002ffc2000-04-09 20:54:50 +000051Although Python's extensive standard library covers many programming
52needs, there often comes a time when you need to add some new
53functionality to your Python installation in the form of third-party
54modules. This might be necessary to support your own programming, or to
55support an application that you want to use and that happens to be
56written in Python.
57
58In the past, there has been little support for adding third-party
59modules to an existing Python installation. With the introduction of
Fred Drake01df4532000-06-30 03:36:41 +000060the Python Distribution Utilities (Distutils for short) in Python 2.0,
Greg Ward6002ffc2000-04-09 20:54:50 +000061this is starting to change. Not everything will change overnight,
62though, so while this document concentrates on installing module
63distributions that use the Distutils, we will also spend some time
64dealing with the old ways.
65
66This document is aimed primarily at the people who need to install
67third-party Python modules: end-users and system administrators who just
68need to get some Python application running, and existing Python
69programmers who want to add some new goodies to their toolbox. You
70don't need to know Python to read this document; there will be some
71brief forays into using Python's interactive mode to explore your
72installation, but that's it. If you're looking for information on how
73to distribute your own Python modules so that others may use them, see
Fred Drake01df4532000-06-30 03:36:41 +000074the \citetitle[../dist/dist.html]{Distributing Python Modules} manual.
Greg Ward7c1e5f62000-03-10 01:56:58 +000075
76
Greg Ward6002ffc2000-04-09 20:54:50 +000077\subsection{Best case: trivial installation}
Greg Ward1ed49ee2000-09-13 00:00:58 +000078\label{trivial-install}
Greg Ward6002ffc2000-04-09 20:54:50 +000079
80In the best case, someone will have prepared a special version of the
81module distribution you want to install that is targeted specifically at
82your platform and is installed just like any other software on your
83platform. For example, the module developer might make an executable
84installer available for Windows users, an RPM package for users of
85RPM-based Linux systems (Red Hat, SuSE, Mandrake, and many others), a
86Debian package for users of Debian-based Linux systems (Debian proper,
87Caldera, Corel, etc.), and so forth.
88
89In that case, you would download the installer appropriate to your
Greg Wardc392caa2000-04-11 02:00:26 +000090platform and do the obvious thing with it: run it if it's an executable
91installer, \code{rpm --install} it if it's an RPM, etc. You don't need
92to run Python or a setup script, you don't need to compile
93anything---you might not even need to read any instructions (although
94it's always a good idea to do so anyways).
Greg Ward6002ffc2000-04-09 20:54:50 +000095
96Of course, things will not always be that easy. You might be interested
Greg Wardc392caa2000-04-11 02:00:26 +000097in a module distribution that doesn't have an easy-to-use installer for
98your platform. In that case, you'll have to start with the source
99distribution released by the module's author/maintainer. Installing
100from a source distribution is not too hard, as long as the modules are
101packaged in the standard way. The bulk of this document is about
102building and installing modules from standard source distributions.
Greg Ward7c1e5f62000-03-10 01:56:58 +0000103
104
Greg Ward6002ffc2000-04-09 20:54:50 +0000105\subsection{The new standard: Distutils}
Greg Warde78298a2000-04-28 17:12:24 +0000106\label{new-standard}
Greg Ward6002ffc2000-04-09 20:54:50 +0000107
108If you download a module source distribution, you can tell pretty
Greg Ward19c67f82000-06-24 01:33:16 +0000109quickly if it was packaged and distributed in the standard way, i.e.
110using the Distutils. First, the distribution's name and version number
111will be featured prominently in the name of the downloaded archive, e.g.
Greg Ward6002ffc2000-04-09 20:54:50 +0000112\file{foo-1.0.tar.gz} or \file{widget-0.9.7.zip}. Next, the archive
113will unpack into a similarly-named directory: \file{foo-1.0} or
114\file{widget-0.9.7}. Additionally, the distribution will contain a
115setup script \file{setup.py}, and a \file{README.txt} (or possibly
116\file{README}), which should explain that building and installing the
117module distribution is a simple matter of running
118\begin{verbatim}
119python setup.py install
120\end{verbatim}
121
122If all these things are true, then you already know how to build and
123install the modules you've just downloaded: run the command above.
124Unless you need to install things in a non-standard way or customize the
125build process, you don't really need this manual. Or rather, the above
126command is everything you need to get out of this manual.
Greg Ward7c1e5f62000-03-10 01:56:58 +0000127
128
Greg Ward6002ffc2000-04-09 20:54:50 +0000129\subsection{The old way: no standards}
Greg Warde78298a2000-04-28 17:12:24 +0000130\label{old-way}
Greg Ward7c1e5f62000-03-10 01:56:58 +0000131
Greg Ward6002ffc2000-04-09 20:54:50 +0000132Before the Distutils, there was no infrastructure to support installing
133third-party modules in a consistent, standardized way. Thus, it's not
134really possible to write a general manual for installing Python modules
135that don't use the Distutils; the only truly general statement that can
Greg Wardc392caa2000-04-11 02:00:26 +0000136be made is, ``Read the module's own installation instructions.''
Greg Ward6002ffc2000-04-09 20:54:50 +0000137
Greg Ward19c67f82000-06-24 01:33:16 +0000138However, if such instructions exist at all, they are often woefully
Greg Wardc392caa2000-04-11 02:00:26 +0000139inadequate and targeted at experienced Python developers. Such users
140are already familiar with how the Python library is laid out on their
141platform, and know where to copy various files in order for Python to
142find them. This document makes no such assumptions, and explains how
143the Python library is laid out on three major platforms (Unix, Windows,
144and Mac~OS), so that you can understand what happens when the Distutils
145do their job \emph{and} know how to install modules manually when the
146module author fails to provide a setup script.
Greg Ward6002ffc2000-04-09 20:54:50 +0000147
148Additionally, while there has not previously been a standard
149installation mechanism, Python has had some standard machinery for
150building extensions on Unix since Python \XXX{version?}. This machinery
151(the \file{Makefile.pre.in} file) is superseded by the Distutils, but it
152will no doubt live on in older module distributions for a while. This
153\file{Makefile.pre.in} mechanism is documented in the ``Extending \&
154Embedding Python'' manual, but that manual is aimed at module
155developers---hence, we include documentation for builders/installers
156here.
157
158All of the pre-Distutils material is tucked away in
Greg Warde78298a2000-04-28 17:12:24 +0000159section~\ref{pre-distutils}.
Greg Ward7c1e5f62000-03-10 01:56:58 +0000160
161
Greg Ward29576562000-03-18 15:11:50 +0000162\section{Standard Build and Install}
Greg Ward1ed49ee2000-09-13 00:00:58 +0000163\label{standard-install}
Greg Ward7c1e5f62000-03-10 01:56:58 +0000164
Greg Warde78298a2000-04-28 17:12:24 +0000165As described in section~\ref{new-standard}, building and installing
Greg Ward6002ffc2000-04-09 20:54:50 +0000166a module distribution using the Distutils is usually one simple command:
167\begin{verbatim}
168python setup.py install
169\end{verbatim}
170On Unix, you'd run this command from a shell prompt; on Windows, you
Greg Warde24f05e2000-09-12 23:55:19 +0000171have to open a command prompt window (``DOS box'') and do it there; on
172Mac~OS, things are a tad more complicated (see below).
Greg Ward6002ffc2000-04-09 20:54:50 +0000173
174
175\subsection{Platform variations}
Greg Ward1ed49ee2000-09-13 00:00:58 +0000176\label{platform-variations}
Greg Ward6002ffc2000-04-09 20:54:50 +0000177
178You should always run the setup command from the distribution root
179directory, i.e. the top-level subdirectory that the module source
180distribution unpacks into. For example, if you've just downloaded a
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000181module source distribution \file{foo-1.0.tar.gz} onto a Unix system, the
Greg Ward6002ffc2000-04-09 20:54:50 +0000182normal thing to do is:
183\begin{verbatim}
184gunzip -c foo-1.0.tar.gz | tar xf - # unpacks into directory foo-1.0
185cd foo-1.0
186python setup.py install
187\end{verbatim}
188
Greg Warde24f05e2000-09-12 23:55:19 +0000189On Windows, you'd probably download \file{foo-1.0.zip}. If you
190downloaded the archive file to \file{C:\textbackslash{}Temp}, then it
191would unpack into \file{C:\textbackslash{}Temp\textbackslash{}foo-1.0};
192you can use either a GUI archive manipulator (such as WinZip) or a
193command-line tool (such as \program{unzip} or \program{pkunzip}) to
194unpack the archive. Then, open a command prompt window (``DOS box''),
195and run:
Greg Ward6002ffc2000-04-09 20:54:50 +0000196\begin{verbatim}
Greg Warde24f05e2000-09-12 23:55:19 +0000197cd c:\Temp\foo-1.0
Greg Ward6002ffc2000-04-09 20:54:50 +0000198python setup.py install
199\end{verbatim}
200
Greg Warde24f05e2000-09-12 23:55:19 +0000201On Mac~OS, you have to go through a bit more effort to supply
202command-line arguments to the setup script:
203\begin{itemize}
204\item hit option-double-click on the script's icon (or option-drop it
205 onto the Python interpreter's icon)
206\item press the ``Set unix-style command line'' button
207\item set the ``Keep stdio window open on termination'' if you're
208 interested in seeing the output of the setup script (which is usually
209 voluminous and often useful)
Greg Ward15f5e2a2000-09-26 02:54:43 +0000210\item when the command-line dialog pops up, enter ``install'' (you
Greg Warde24f05e2000-09-12 23:55:19 +0000211 can, of course, enter any Distutils command-line as described in this
212 document or in the ``Distributing Python Modules'' document: just
213 leave of the initial \code{python setup.py} and you'll be fine)
214\end{itemize}
215\XXX{this should change: every Distutils setup script will need
216 command-line arguments for every run (and should probably keep stdout
217 around), so all this should happen automatically for setup scripts}
Greg Wardc392caa2000-04-11 02:00:26 +0000218
Greg Ward6002ffc2000-04-09 20:54:50 +0000219
220\subsection{Splitting the job up}
Greg Ward1ed49ee2000-09-13 00:00:58 +0000221\label{splitting-up}
Greg Ward6002ffc2000-04-09 20:54:50 +0000222
223Running \code{setup.py install} builds and installs all modules in one
Greg Ward14deaae2000-09-11 00:33:15 +0000224run. If you prefer to work incrementally---especially useful if you
225want to customize the build process, or if things are going wrong---you
226can use the setup script to do one thing at a time. This is
Greg Ward3e7b1332000-05-30 03:00:43 +0000227particularly helpful when the build and install will be done by
228different users---e.g., you might want to build a module distribution
229and hand it off to a system administrator for installation (or do it
230yourself, with super-user privileges).
Greg Ward6002ffc2000-04-09 20:54:50 +0000231
232For example, you can build everything in one step, and then install
233everything in a second step, by invoking the setup script twice:
234\begin{verbatim}
235python setup.py build
236python setup.py install
237\end{verbatim}
238(If you do this, you will notice that running the \command{install}
Greg Ward14deaae2000-09-11 00:33:15 +0000239command first runs the \command{build} command, which---in this
240case---quickly notices that it has nothing to do, since everything in
241the \file{build} directory is up-to-date.)
Greg Ward29576562000-03-18 15:11:50 +0000242
Greg Ward14deaae2000-09-11 00:33:15 +0000243You may not need this ability to break things down often if all you do
244is install modules downloaded off the 'net, but it's very handy for more
245advanced tasks. If you get into distributing your own Python modules
246and extensions, you'll run lots of individual Distutils commands on
247their own.
Greg Ward7c1e5f62000-03-10 01:56:58 +0000248
249
Greg Wardc392caa2000-04-11 02:00:26 +0000250\subsection{How building works}
Greg Ward1ed49ee2000-09-13 00:00:58 +0000251\label{how-build-works}
Greg Ward7c1e5f62000-03-10 01:56:58 +0000252
Greg Wardc392caa2000-04-11 02:00:26 +0000253As implied above, the \command{build} command is responsible for putting
254the files to install into a \emph{build directory}. By default, this is
255\file{build} under the distribution root; if you're excessively
256concerned with speed, or want to keep the source tree pristine, you can
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000257change the build directory with the \longprogramopt{build-base} option.
258For example:
Greg Wardc392caa2000-04-11 02:00:26 +0000259\begin{verbatim}
260python setup.py build --build-base=/tmp/pybuild/foo-1.0
261\end{verbatim}
262(Or you could do this permanently with a directive in your system or
263personal Distutils configuration file; see
Greg Warde78298a2000-04-28 17:12:24 +0000264section~\ref{config-files}.) Normally, this isn't necessary.
Greg Wardc392caa2000-04-11 02:00:26 +0000265
266The default layout for the build tree is as follows:
267\begin{verbatim}
268--- build/ --- lib/
269or
270--- build/ --- lib.<plat>/
271 temp.<plat>/
272\end{verbatim}
273where \code{<plat>} expands to a brief description of the current
274OS/hardware platform. The first form, with just a \file{lib} directory,
275is used for ``pure module distributions''---that is, module
276distributions that include only pure Python modules. If a module
277distribution contains any extensions (modules written in C/C++, or Java
278for JPython), then the second form, with two \code{<plat>} directories,
279is used. In that case, the \file{temp.\filevar{plat}} directory holds
280temporary files generated by the compile/link process that don't
281actually get installed. In either case, the \file{lib} (or
282\file{lib.\filevar{plat}}) directory contains all Python modules (pure
283Python and extensions) that will be installed.
284
285In the future, more directories will be added to handle Python scripts,
286documentation, binary executables, and whatever else is needed to handle
Greg Wardd5faa7e2000-04-12 01:42:19 +0000287the job of installing Python modules and applications.
Greg Wardc392caa2000-04-11 02:00:26 +0000288
289
290\subsection{How installation works}
Greg Ward1ed49ee2000-09-13 00:00:58 +0000291\label{how-install-works}
Greg Wardc392caa2000-04-11 02:00:26 +0000292
293After the \command{build} command runs (whether you run it explicitly,
294or the \command{install} command does it for you), the work of the
295\command{install} command is relatively simple: all it has to do is copy
296everything under \file{build/lib} (or \file{build/lib.\filevar{plat}})
297to your chosen installation directory.
298
299If you don't choose an installation directory---i.e., if you just run
300\code{setup.py install}---then the \command{install} command installs to
301the standard location for third-party Python modules. This location
302varies by platform and by how you built/installed Python itself. On
303Unix and Mac OS, it also depends on whether the module distribution
304being installed is pure Python or contains extensions (``non-pure''):
Greg Wardd5faa7e2000-04-12 01:42:19 +0000305\begin{tableiv}{l|l|l|c}{textrm}%
306 {Platform}{Standard installation location}{Default value}{Notes}
307 \lineiv{Unix (pure)}
Fred Drake01df4532000-06-30 03:36:41 +0000308 {\filenq{\filevar{prefix}/lib/python2.0/site-packages}}
309 {\filenq{/usr/local/lib/python2.0/site-packages}}
Greg Ward502d2b42000-04-12 14:20:15 +0000310 {(1)}
Greg Wardd5faa7e2000-04-12 01:42:19 +0000311 \lineiv{Unix (non-pure)}
Fred Drake01df4532000-06-30 03:36:41 +0000312 {\filenq{\filevar{exec-prefix}/lib/python2.0/site-packages}}
313 {\filenq{/usr/local/lib/python2.0/site-packages}}
Greg Ward502d2b42000-04-12 14:20:15 +0000314 {(1)}
Greg Wardd5faa7e2000-04-12 01:42:19 +0000315 \lineiv{Windows}
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000316 {\filenq{\filevar{prefix}}}
Greg Ward4756e5f2000-04-19 22:40:12 +0000317 {\filenq{C:\textbackslash{}Python}}
Greg Ward502d2b42000-04-12 14:20:15 +0000318 {(2)}
Greg Wardd5faa7e2000-04-12 01:42:19 +0000319 \lineiv{Mac~OS (pure)}
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000320 {\filenq{\filevar{prefix}:Lib}}
Greg Wardd5faa7e2000-04-12 01:42:19 +0000321 {\filenq{Python:Lib} \XXX{???}}
322 {}
323 \lineiv{Mac~OS (non-pure)}
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000324 {\filevar{prefix}:Mac:PlugIns}
Greg Wardd5faa7e2000-04-12 01:42:19 +0000325 {\filenq{Python:Mac:PlugIns}\XXX{???}}
326 {}
327\end{tableiv}
328
329\noindent Notes:
330\begin{description}
Greg Ward502d2b42000-04-12 14:20:15 +0000331\item[(1)] Most Linux distributions include Python as a standard part of
332 the system, so \filevar{prefix} and \filevar{exec-prefix} are usually
333 both \file{/usr} on Linux. If you build Python yourself on Linux (or
334 any Unix-like system), the default \filevar{prefix} and
335 \filevar{exec-prefix} are \file{/usr/local}.
336\item[(2)] The default installation directory on Windows was
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000337 \file{C:\textbackslash{}Program Files\textbackslash{}Python} under
338 Python 1.6a1, 1.5.2, and earlier.
Greg Wardd5faa7e2000-04-12 01:42:19 +0000339\end{description}
340
Greg Wardc392caa2000-04-11 02:00:26 +0000341\filevar{prefix} and \filevar{exec-prefix} stand for the directories
342that Python is installed to, and where it finds its libraries at
343run-time. They are always the same under Windows and Mac~OS, and very
344often the same under Unix. You can find out what your Python
345installation uses for \filevar{prefix} and \filevar{exec-prefix} by
346running Python in interactive mode and typing a few simple commands.
347Under Unix, just type \code{python} at the shell prompt; under Windows,
Fred Drake01df4532000-06-30 03:36:41 +0000348run ``Python 2.0 (interpreter)'' \XXX{right?}; under Mac~OS, \XXX{???}.
349Once the interpreter is started, you type Python code at the
350\samp{>>> } prompt. For example, on my Linux system, I type the three
351Python statements shown below, and get the output as shown, to find
352out my \filevar{prefix} and \filevar{exec-prefix}:
353
Greg Wardc392caa2000-04-11 02:00:26 +0000354\begin{verbatim}
355Python 1.5.2 (#1, Apr 18 1999, 16:03:16) [GCC pgcc-2.91.60 19981201 (egcs-1.1.1 on linux2
356Copyright 1991-1995 Stichting Mathematisch Centrum, Amsterdam
357>>> import sys
358>>> sys.prefix
359'/usr'
360>>> sys.exec_prefix
361'/usr'
362\end{verbatim}
363
364If you don't want to install to the standard location, or if you don't
365have permission to write there, then you need to read about alternate
366installations in the next section.
367
368
369% This rather nasty macro is used to generate the tables that describe
370% each installation scheme. It's nasty because it takes two arguments
371% for each "slot" in an installation scheme, there will soon be more
372% than five of these slots, and TeX has a limit of 10 arguments to a
373% macro. Uh-oh.
374
Greg Ward29576562000-03-18 15:11:50 +0000375\newcommand{\installscheme}[8]
376 {\begin{tableiii}{lll}{textrm}
377 {Type of file}
378 {Installation Directory}
379 {Override option}
380 \lineiii{pure module distribution}
381 {\filevar{#1}\filenq{#2}}
Greg Warda021aca2000-04-19 22:34:11 +0000382 {\longprogramopt{install-purelib}}
Greg Ward29576562000-03-18 15:11:50 +0000383 \lineiii{non-pure module distribution}
384 {\filevar{#3}\filenq{#4}}
Greg Warda021aca2000-04-19 22:34:11 +0000385 {\longprogramopt{install-platlib}}
Greg Ward29576562000-03-18 15:11:50 +0000386 \lineiii{scripts}
387 {\filevar{#5}\filenq{#6}}
Greg Warda021aca2000-04-19 22:34:11 +0000388 {\longprogramopt{install-scripts}}
Greg Ward29576562000-03-18 15:11:50 +0000389 \lineiii{data}
390 {\filevar{#7}\filenq{#8}}
Greg Warda021aca2000-04-19 22:34:11 +0000391 {\longprogramopt{install-data}}
Greg Ward29576562000-03-18 15:11:50 +0000392 \end{tableiii}}
Greg Ward7c1e5f62000-03-10 01:56:58 +0000393
Greg Ward0bc59532000-09-30 21:06:40 +0000394
395\section{Building Extensions: Tips and Tricks}
396\label{building-ext}
397
398(This is the section to read for people doing any sort of interesting
399build. Things to talk about:
400\begin{itemize}
401\item the \file{Setup} file (any platform now, but Unix-biased)
402\item CFLAGS and LDFLAGS (must implement them first!)
403\item using non-MS compilers on Windows (how to convert
404 Python's library, ...)
405\end{itemize}
406
407
408\subsection{Tweaking compiler/linker flags}
409\label{tweak-flags}
410
411
412\subsection{Using non-Microsoft compilers on Windows}
413\label{non-ms-compilers}
414
415\XXX{One place to look: \url{http://www.cyberus.ca/~g_will/pyExtenDL.shtml}}
416
417
418
Greg Ward29576562000-03-18 15:11:50 +0000419\section{Alternate Installation}
Greg Warde78298a2000-04-28 17:12:24 +0000420\label{alt-install}
Greg Ward7c1e5f62000-03-10 01:56:58 +0000421
Greg Ward29576562000-03-18 15:11:50 +0000422Often, it is necessary or desirable to install modules to a location
423other than the standard location for third-party Python modules. For
424example, on a Unix system you might not have permission to write to the
425standard third-party module directory. Or you might wish to try out a
426module before making it a standard part of your local Python
427installation; this is especially true when upgrading a distribution
428already present: you want to make sure your existing base of scripts
429still works with the new version before actually upgrading.
430
431The Distutils \command{install} command is designed to make installing
432module distributions to an alternate location simple and painless. The
433basic idea is that you supply a base directory for the installation, and
434the \command{install} command picks a set of directories (called an
435\emph{installation scheme}) under this base directory in which to
436install files. The details differ across platforms, so read whichever
437of the following section applies to you.
438
439
440\subsection{Alternate installation: Unix (the home scheme)}
Greg Ward1ed49ee2000-09-13 00:00:58 +0000441\label{alt-install-prefix}
Greg Ward29576562000-03-18 15:11:50 +0000442
443Under Unix, there are two ways to perform an alternate installation.
444The ``prefix scheme'' is similar to how alternate installation works
Greg Wardc392caa2000-04-11 02:00:26 +0000445under Windows and Mac~OS, but is not necessarily the most useful way to
Greg Ward29576562000-03-18 15:11:50 +0000446maintain a personal Python library. Hence, we document the more
447convenient and commonly useful ``home scheme'' first.
448
Greg Wardc392caa2000-04-11 02:00:26 +0000449The idea behind the ``home scheme'' is that you build and maintain a
450personal stash of Python modules, probably under your home directory.
451Installing a new module distribution is as simple as
Greg Ward29576562000-03-18 15:11:50 +0000452\begin{verbatim}
453python setup.py install --home=<dir>
454\end{verbatim}
Greg Warda021aca2000-04-19 22:34:11 +0000455where you can supply any directory you like for the \longprogramopt{home}
Greg Ward4756e5f2000-04-19 22:40:12 +0000456option. Lazy typists can just type a tilde (\code{\textasciitilde}); the
Greg Wardc392caa2000-04-11 02:00:26 +0000457\command{install} command will expand this to your home directory:
458\begin{verbatim}
459python setup.py install --home=~
460\end{verbatim}
Greg Ward29576562000-03-18 15:11:50 +0000461
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000462The \longprogramopt{home} option defines the installation base
463directory. Files are installed to the following directories under the
464installation base as follows:
Greg Ward29576562000-03-18 15:11:50 +0000465\installscheme{home}{/lib/python}
466 {home}{/lib/python}
467 {home}{/bin}
468 {home}{/share}
469
470\subsection{Alternate installation: Unix (the prefix scheme)}
Greg Ward1ed49ee2000-09-13 00:00:58 +0000471\label{alt-install-home}
Greg Ward29576562000-03-18 15:11:50 +0000472
473The ``prefix scheme'' is useful when you wish to use one Python
474installation to perform the build/install (i.e., to run the setup
475script), but install modules into the third-party module directory of a
476different Python installation (or something that looks like a different
477Python installation). If this sounds a trifle unusual, it is---that's
478why the ``home scheme'' comes first. However, there are at least two
479known cases where the prefix scheme will be useful.
480
Greg Ward19c67f82000-06-24 01:33:16 +0000481First, consider that many Linux distributions put Python in \file{/usr},
Greg Ward29576562000-03-18 15:11:50 +0000482rather than the more traditional \file{/usr/local}. This is entirely
483appropriate, since in those cases Python is part of ``the system''
484rather than a local add-on. However, if you are installing Python
485modules from source, you probably want them to go in
486\file{/usr/local/lib/python1.\filevar{X}} rather than
487\file{/usr/lib/python1.\filevar{X}}. This can be done with
488\begin{verbatim}
489/usr/bin/python setup.py install --prefix=/usr/local
490\end{verbatim}
491
492Another possibility is a network filesystem where the name used to write
493to a remote directory is different from the name used to read it: for
494example, the Python interpreter accessed as \file{/usr/local/bin/python}
495might search for modules in \file{/usr/local/lib/python1.\filevar{X}},
496but those modules would have to be installed to, say,
497\file{/mnt/\filevar{@server}/export/lib/python1.\filevar{X}}. This
498could be done with
499\begin{verbatim}
500/usr/local/bin/python setup.py install --prefix=/mnt/@server/export
501\end{verbatim}
502
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000503In either case, the \longprogramopt{prefix} option defines the
504installation base, and the \longprogramopt{exec-prefix} option defines
505the platform-specific installation base, which is used for
506platform-specific files. (Currently, this just means non-pure module
507distributions, but could be expanded to C libraries, binary executables,
508etc.) If \longprogramopt{exec-prefix} is not supplied, it defaults to
509\longprogramopt{prefix}. Files are installed as follows:
Greg Ward29576562000-03-18 15:11:50 +0000510
511\installscheme{prefix}{/lib/python1.\filevar{X}/site-packages}
512 {exec-prefix}{/lib/python1.\filevar{X}/site-packages}
513 {prefix}{/bin}
514 {prefix}{/share}
515
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000516There is no requirement that \longprogramopt{prefix} or
517\longprogramopt{exec-prefix} actually point to an alternate Python
518installation; if the directories listed above do not already exist, they
519are created at installation time.
Greg Ward29576562000-03-18 15:11:50 +0000520
521Incidentally, the real reason the prefix scheme is important is simply
522that a standard Unix installation uses the prefix scheme, but with
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000523\longprogramopt{prefix} and \longprogramopt{exec-prefix} supplied by
524Python itself (as \code{sys.prefix} and \code{sys.exec\_prefix}). Thus,
525you might think you'll never use the prefix scheme, but every time you
526run \code{python setup.py install} without any other options, you're
527using it.
Greg Ward29576562000-03-18 15:11:50 +0000528
529Note that installing extensions to an alternate Python installation has
530no effect on how those extensions are built: in particular, the Python
531header files (\file{Python.h} and friends) installed with the Python
532interpreter used to run the setup script will be used in compiling
533extensions. It is your responsibility to ensure that the interpreter
534used to run extensions installed in this way is compatibile with the
Greg Wardc392caa2000-04-11 02:00:26 +0000535interpreter used to build them. The best way to do this is to ensure
536that the two interpreters are the same version of Python (possibly
537different builds, or possibly copies of the same build). (Of course, if
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000538your \longprogramopt{prefix} and \longprogramopt{exec-prefix} don't even
539point to an alternate Python installation, this is immaterial.)
Greg Ward29576562000-03-18 15:11:50 +0000540
541
542\subsection{Alternate installation: Windows}
Greg Ward1ed49ee2000-09-13 00:00:58 +0000543\label{alt-install-windows}
Greg Ward29576562000-03-18 15:11:50 +0000544
545Since Windows has no conception of a user's home directory, and since
546the standard Python installation under Windows is simpler than that
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000547under Unix, there's no point in having separate \longprogramopt{prefix}
548and \longprogramopt{home} options. Just use the \longprogramopt{prefix}
549option to specify a base directory, e.g.
Greg Ward29576562000-03-18 15:11:50 +0000550\begin{verbatim}
Greg Ward8e14f052000-03-22 01:00:23 +0000551python setup.py install --prefix="\Temp\Python"
Greg Ward29576562000-03-18 15:11:50 +0000552\end{verbatim}
Greg Ward4756e5f2000-04-19 22:40:12 +0000553to install modules to the \file{\textbackslash{}Temp} directory on the current
Greg Ward29576562000-03-18 15:11:50 +0000554drive.
555
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000556The installation base is defined by the \longprogramopt{prefix} option;
557the \longprogramopt{exec-prefix} option is not supported under Windows.
558Files are installed as follows:
Greg Ward29576562000-03-18 15:11:50 +0000559\installscheme{prefix}{}
560 {prefix}{}
Greg Ward4756e5f2000-04-19 22:40:12 +0000561 {prefix}{\textbackslash{}Scripts}
562 {prefix}{\textbackslash{}Data}
Greg Ward29576562000-03-18 15:11:50 +0000563
564
Greg Wardc392caa2000-04-11 02:00:26 +0000565\subsection{Alternate installation: Mac~OS}
Greg Ward1ed49ee2000-09-13 00:00:58 +0000566\label{alt-install-macos}
Greg Ward29576562000-03-18 15:11:50 +0000567
Greg Wardc392caa2000-04-11 02:00:26 +0000568Like Windows, Mac~OS has no notion of home directories (or even of
Greg Ward29576562000-03-18 15:11:50 +0000569users), and a fairly simple standard Python installation. Thus, only a
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000570\longprogramopt{prefix} option is needed. It defines the installation
571base, and files are installed under it as follows:
Greg Ward29576562000-03-18 15:11:50 +0000572
Greg Ward8c562592000-09-13 00:12:37 +0000573\installscheme{prefix}{:Lib:site-packages}
574 {prefix}{:Lib:site-packages}
Greg Ward8e14f052000-03-22 01:00:23 +0000575 {prefix}{:Scripts}
576 {prefix}{:Data}
Greg Ward29576562000-03-18 15:11:50 +0000577
Greg Ward8c562592000-09-13 00:12:37 +0000578See section~\ref{platform-variations} for information on supplying
579command-line arguments to the setup script with MacPython.
Greg Ward29576562000-03-18 15:11:50 +0000580
581
582\section{Custom Installation}
Greg Warde78298a2000-04-28 17:12:24 +0000583\label{custom-install}
Greg Ward29576562000-03-18 15:11:50 +0000584
585Sometimes, the alternate installation schemes described in
Greg Warde78298a2000-04-28 17:12:24 +0000586section~\ref{alt-install} just don't do what you want. You might
Greg Ward29576562000-03-18 15:11:50 +0000587want to tweak just one or two directories while keeping everything under
588the same base directory, or you might want to completely redefine the
589installation scheme. In either case, you're creating a \emph{custom
590 installation scheme}.
591
592You probably noticed the column of ``override options'' in the tables
593describing the alternate installation schemes above. Those options are
594how you define a custom installation scheme. These override options can
595be relative, absolute, or explicitly defined in terms of one of the
596installation base directories. (There are two installation base
597directories, and they are normally the same---they only differ when you
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000598use the Unix ``prefix scheme'' and supply different
599\longprogramopt{prefix} and \longprogramopt{exec-prefix} options.)
Greg Ward29576562000-03-18 15:11:50 +0000600
601For example, say you're installing a module distribution to your home
602directory under Unix---but you want scripts to go in
Greg Ward4eaa3bf2000-04-19 22:44:25 +0000603\file{\textasciitilde/scripts} rather than \file{\textasciitilde/bin}.
604As you might expect, you can override this directory with the
605\longprogramopt{install-scripts} option; in this case, it makes most
606sense to supply a relative path, which will be interpreted relative to
607the installation base directory (your home directory, in this case):
Greg Ward29576562000-03-18 15:11:50 +0000608\begin{verbatim}
Greg Ward19c67f82000-06-24 01:33:16 +0000609python setup.py install --home=~ --install-scripts=scripts
Greg Ward29576562000-03-18 15:11:50 +0000610\end{verbatim}
611
612Another Unix example: suppose your Python installation was built and
613installed with a prefix of \file{/usr/local/python}, so under a standard
614installation scripts will wind up in \file{/usr/local/python/bin}. If
615you want them in \file{/usr/local/bin} instead, you would supply this
Greg Warda021aca2000-04-19 22:34:11 +0000616absolute directory for the \longprogramopt{install-scripts} option:
Greg Ward29576562000-03-18 15:11:50 +0000617\begin{verbatim}
618python setup.py install --install-scripts=/usr/local/bin
619\end{verbatim}
620(This performs an installation using the ``prefix scheme,'' where the
621prefix is whatever your Python interpreter was installed with---
622\file{/usr/local/python} in this case.)
623
624If you maintain Python on Windows, you might want third-party modules to
625live in a subdirectory of \filevar{prefix}, rather than right in
626\filevar{prefix} itself. This is almost as easy as customizing the
627script installation directory---you just have to remember that there are
628two types of modules to worry about, pure modules and non-pure modules
629(i.e., modules from a non-pure distribution). For example:
630\begin{verbatim}
631python setup.py install --install-purelib=Site --install-platlib=Site
632\end{verbatim}
633The specified installation directories are relative to \filevar{prefix}.
634Of course, you also have to ensure that these directories are in
635Python's module search path, e.g. by putting a \file{.pth} file in
Greg Ward6002ffc2000-04-09 20:54:50 +0000636\filevar{prefix} (\XXX{should have a section describing .pth files and
637 cross-ref it here}).
Greg Ward29576562000-03-18 15:11:50 +0000638
639If you want to define an entire installation scheme, you just have to
640supply all of the installation directory options. The recommended way
Greg Wardc392caa2000-04-11 02:00:26 +0000641to do this is to supply relative paths; for example, if you want to
642maintain all Python module-related files under \file{python} in your
643home directory, and you want a separate directory for each platform that
644you use your home directory from, you might define the following
Greg Ward29576562000-03-18 15:11:50 +0000645installation scheme:
646\begin{verbatim}
Greg Wardc392caa2000-04-11 02:00:26 +0000647python setup.py install --home=~ \
Greg Ward29576562000-03-18 15:11:50 +0000648 --install-purelib=python/lib \
649 --install-platlib=python/lib.$PLAT \
650 --install-scripts=python/scripts
651 --install-data=python/data
652\end{verbatim}
653or, equivalently,
654\begin{verbatim}
655python setup.py install --home=~/python \
656 --install-purelib=lib \
Greg Ward19c67f82000-06-24 01:33:16 +0000657 --install-platlib='lib.$PLAT' \
Greg Ward29576562000-03-18 15:11:50 +0000658 --install-scripts=scripts
659 --install-data=data
660\end{verbatim}
661\code{\$PLAT} is not (necessarily) an environment variable---it will be
662expanded by the Distutils as it parses your command line options (just
663as it does when parsing your configuration file(s)).
664
665Obviously, specifying the entire installation scheme every time you
666install a new module distribution would be very tedious. Thus, you can
667put these options into your Distutils config file (see
Greg Warde78298a2000-04-28 17:12:24 +0000668section~\ref{config-files}):
Greg Ward169f91b2000-03-10 01:57:51 +0000669\begin{verbatim}
670[install]
Greg Ward29576562000-03-18 15:11:50 +0000671install-base=$HOME
672install-purelib=python/lib
673install-platlib=python/lib.$PLAT
674install-scripts=python/scripts
675install-data=python/data
Greg Ward169f91b2000-03-10 01:57:51 +0000676\end{verbatim}
Greg Ward29576562000-03-18 15:11:50 +0000677or, equivalently,
Greg Ward169f91b2000-03-10 01:57:51 +0000678\begin{verbatim}
679[install]
Greg Ward29576562000-03-18 15:11:50 +0000680install-base=$HOME/python
681install-purelib=lib
682install-platlib=lib.$PLAT
683install-scripts=scripts
684install-data=data
Greg Ward169f91b2000-03-10 01:57:51 +0000685\end{verbatim}
Greg Ward29576562000-03-18 15:11:50 +0000686Note that these two are \emph{not} equivalent if you supply a different
687installation base directory when you run the setup script. For example,
Greg Ward7c1e5f62000-03-10 01:56:58 +0000688\begin{verbatim}
Greg Ward29576562000-03-18 15:11:50 +0000689python setup.py --install-base=/tmp
Greg Ward7c1e5f62000-03-10 01:56:58 +0000690\end{verbatim}
Greg Ward29576562000-03-18 15:11:50 +0000691would install pure modules to \filevar{/tmp/python/lib} in the first
692case, and to \filevar{/tmp/lib} in the second case. (For the second
693case, you probably want to supply an installation base of
694\file{/tmp/python}.)
Greg Ward169f91b2000-03-10 01:57:51 +0000695
Greg Ward29576562000-03-18 15:11:50 +0000696You probably noticed the use of \code{\$HOME} and \code{\$PLAT} in the
697sample configuration file input. These are Distutils configuration
698variables, which bear a strong resemblance to environment variables. In
Greg Wardc392caa2000-04-11 02:00:26 +0000699fact, you can use environment variables in config files---on platforms
700that have such a notion---but the Distutils additionally define a few
701extra variables that may not be in your environment, such as
702\code{\$PLAT}. (And of course, you can only use the configuration
703variables supplied by the Distutils on systems that don't have
704environment variables, such as Mac~OS (\XXX{true?}).) See
Greg Warde78298a2000-04-28 17:12:24 +0000705section~\ref{config-files} for details.
Greg Ward7c1e5f62000-03-10 01:56:58 +0000706
Greg Wardc392caa2000-04-11 02:00:26 +0000707\XXX{need some Windows and Mac~OS examples---when would custom
Greg Ward6002ffc2000-04-09 20:54:50 +0000708 installation schemes be needed on those platforms?}
Greg Ward7c1e5f62000-03-10 01:56:58 +0000709
Greg Ward7c1e5f62000-03-10 01:56:58 +0000710
Greg Ward6002ffc2000-04-09 20:54:50 +0000711\section{Distutils Configuration Files}
Greg Warde78298a2000-04-28 17:12:24 +0000712\label{config-files}
Greg Ward7c1e5f62000-03-10 01:56:58 +0000713
Greg Ward6002ffc2000-04-09 20:54:50 +0000714
715\section{Pre-Distutils Conventions}
Greg Warde78298a2000-04-28 17:12:24 +0000716\label{pre-distutils}
Greg Ward6002ffc2000-04-09 20:54:50 +0000717
718
Greg Wardc392caa2000-04-11 02:00:26 +0000719\subsection{The Makefile.pre.in file}
Greg Warde78298a2000-04-28 17:12:24 +0000720\label{makefile-pre-in}
Greg Ward6002ffc2000-04-09 20:54:50 +0000721
722
723\subsection{Installing modules manually}
Greg Warde78298a2000-04-28 17:12:24 +0000724\label{manual-install}
Greg Ward6002ffc2000-04-09 20:54:50 +0000725
726
727
Greg Ward7c1e5f62000-03-10 01:56:58 +0000728\end{document}