Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 1 | \documentclass{howto} |
| 2 | \usepackage{ltxmarkup} |
| 3 | \usepackage{times} |
Greg Ward | 7593eb3 | 2000-04-09 03:59:15 +0000 | [diff] [blame] | 4 | \usepackage{distutils} |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 5 | |
| 6 | \title{Installing Python Modules} |
| 7 | |
| 8 | % The audience for this document includes people who don't know anything |
| 9 | % about Python and aren't about to learn the language just in order to |
| 10 | % install and maintain it for their users, i.e. system administrators. |
| 11 | % Thus, I have to be sure to explain the basics at some point: |
| 12 | % sys.path and PYTHONPATH at least. Should probably give pointers to |
| 13 | % other docs on "import site", PYTHONSTARTUP, PYTHONHOME, etc. |
| 14 | % |
| 15 | % Also, I need to take into account that most modules out there don't |
| 16 | % (yet) use Distutils: briefly explain the old Makefile.pre.in |
| 17 | % convention (maybe move material from the E&E manual to here?), and |
| 18 | % explain where to copy .py and .so files manually if the distribution |
| 19 | % doesn't provide a mechanism for doing so. |
| 20 | % |
| 21 | % Finally, it might be useful to include all the material from my "Care |
| 22 | % and Feeding of a Python Installation" talk in here somewhere. Yow! |
| 23 | |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 24 | \author{Greg Ward} |
| 25 | \authoraddress{E-mail: \email{gward@python.net}} |
| 26 | |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 27 | |
| 28 | \begin{document} |
| 29 | |
| 30 | \maketitle |
| 31 | |
| 32 | %\begin{abstract} |
| 33 | %\noindent |
| 34 | %Abstract this! |
| 35 | %\end{abstract} |
| 36 | |
| 37 | \tableofcontents |
| 38 | |
| 39 | \section{Introduction} |
| 40 | \label{sec:intro} |
| 41 | |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 42 | Although Python's extensive standard library covers many programming |
| 43 | needs, there often comes a time when you need to add some new |
| 44 | functionality to your Python installation in the form of third-party |
| 45 | modules. This might be necessary to support your own programming, or to |
| 46 | support an application that you want to use and that happens to be |
| 47 | written in Python. |
| 48 | |
| 49 | In the past, there has been little support for adding third-party |
| 50 | modules to an existing Python installation. With the introduction of |
| 51 | the Python Distribution Utilities (Distutils for short) in Python 1.6, |
| 52 | this is starting to change. Not everything will change overnight, |
| 53 | though, so while this document concentrates on installing module |
| 54 | distributions that use the Distutils, we will also spend some time |
| 55 | dealing with the old ways. |
| 56 | |
| 57 | This document is aimed primarily at the people who need to install |
| 58 | third-party Python modules: end-users and system administrators who just |
| 59 | need to get some Python application running, and existing Python |
| 60 | programmers who want to add some new goodies to their toolbox. You |
| 61 | don't need to know Python to read this document; there will be some |
| 62 | brief forays into using Python's interactive mode to explore your |
| 63 | installation, but that's it. If you're looking for information on how |
| 64 | to distribute your own Python modules so that others may use them, see |
| 65 | the ``Distributing Python Modules'' manual. |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 66 | |
| 67 | |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 68 | \subsection{Best case: trivial installation} |
| 69 | \label{sec:trivial-inst} |
| 70 | |
| 71 | In the best case, someone will have prepared a special version of the |
| 72 | module distribution you want to install that is targeted specifically at |
| 73 | your platform and is installed just like any other software on your |
| 74 | platform. For example, the module developer might make an executable |
| 75 | installer available for Windows users, an RPM package for users of |
| 76 | RPM-based Linux systems (Red Hat, SuSE, Mandrake, and many others), a |
| 77 | Debian package for users of Debian-based Linux systems (Debian proper, |
| 78 | Caldera, Corel, etc.), and so forth. |
| 79 | |
| 80 | In that case, you would download the installer appropriate to your |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 81 | platform and do the obvious thing with it: run it if it's an executable |
| 82 | installer, \code{rpm --install} it if it's an RPM, etc. You don't need |
| 83 | to run Python or a setup script, you don't need to compile |
| 84 | anything---you might not even need to read any instructions (although |
| 85 | it's always a good idea to do so anyways). |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 86 | |
| 87 | Of course, things will not always be that easy. You might be interested |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 88 | in a module distribution that doesn't have an easy-to-use installer for |
| 89 | your platform. In that case, you'll have to start with the source |
| 90 | distribution released by the module's author/maintainer. Installing |
| 91 | from a source distribution is not too hard, as long as the modules are |
| 92 | packaged in the standard way. The bulk of this document is about |
| 93 | building and installing modules from standard source distributions. |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 94 | |
| 95 | |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 96 | \subsection{The new standard: Distutils} |
| 97 | \label{sec:new-standard} |
| 98 | |
| 99 | If you download a module source distribution, you can tell pretty |
| 100 | quickly if was packaged and distributed in the standard way, i.e. using |
| 101 | the Distutils. First, the distribution's name and version number will |
| 102 | be featured prominently in the name of the downloaded archive, e.g. |
| 103 | \file{foo-1.0.tar.gz} or \file{widget-0.9.7.zip}. Next, the archive |
| 104 | will unpack into a similarly-named directory: \file{foo-1.0} or |
| 105 | \file{widget-0.9.7}. Additionally, the distribution will contain a |
| 106 | setup script \file{setup.py}, and a \file{README.txt} (or possibly |
| 107 | \file{README}), which should explain that building and installing the |
| 108 | module distribution is a simple matter of running |
| 109 | \begin{verbatim} |
| 110 | python setup.py install |
| 111 | \end{verbatim} |
| 112 | |
| 113 | If all these things are true, then you already know how to build and |
| 114 | install the modules you've just downloaded: run the command above. |
| 115 | Unless you need to install things in a non-standard way or customize the |
| 116 | build process, you don't really need this manual. Or rather, the above |
| 117 | command is everything you need to get out of this manual. |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 118 | |
| 119 | |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 120 | \subsection{The old way: no standards} |
| 121 | \label{sec:old-way} |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 122 | |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 123 | Before the Distutils, there was no infrastructure to support installing |
| 124 | third-party modules in a consistent, standardized way. Thus, it's not |
| 125 | really possible to write a general manual for installing Python modules |
| 126 | that don't use the Distutils; the only truly general statement that can |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 127 | be made is, ``Read the module's own installation instructions.'' |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 128 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 129 | However, if such instructions exists at all, they are often woefully |
| 130 | inadequate and targeted at experienced Python developers. Such users |
| 131 | are already familiar with how the Python library is laid out on their |
| 132 | platform, and know where to copy various files in order for Python to |
| 133 | find them. This document makes no such assumptions, and explains how |
| 134 | the Python library is laid out on three major platforms (Unix, Windows, |
| 135 | and Mac~OS), so that you can understand what happens when the Distutils |
| 136 | do their job \emph{and} know how to install modules manually when the |
| 137 | module author fails to provide a setup script. |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 138 | |
| 139 | Additionally, while there has not previously been a standard |
| 140 | installation mechanism, Python has had some standard machinery for |
| 141 | building extensions on Unix since Python \XXX{version?}. This machinery |
| 142 | (the \file{Makefile.pre.in} file) is superseded by the Distutils, but it |
| 143 | will no doubt live on in older module distributions for a while. This |
| 144 | \file{Makefile.pre.in} mechanism is documented in the ``Extending \& |
| 145 | Embedding Python'' manual, but that manual is aimed at module |
| 146 | developers---hence, we include documentation for builders/installers |
| 147 | here. |
| 148 | |
| 149 | All of the pre-Distutils material is tucked away in |
| 150 | section~\ref{sec:pre-distutils}. |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 151 | |
| 152 | |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 153 | \section{Standard Build and Install} |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 154 | \label{sec:normal-install} |
| 155 | |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 156 | As described in section~\ref{sec:new-standard}, building and installing |
| 157 | a module distribution using the Distutils is usually one simple command: |
| 158 | \begin{verbatim} |
| 159 | python setup.py install |
| 160 | \end{verbatim} |
| 161 | On Unix, you'd run this command from a shell prompt; on Windows, you |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 162 | have to open a command prompt window and do it there; on Mac~OS ... |
| 163 | \XXX{what the heck do you do on Mac~OS?}. |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 164 | |
| 165 | |
| 166 | \subsection{Platform variations} |
| 167 | |
| 168 | You should always run the setup command from the distribution root |
| 169 | directory, i.e. the top-level subdirectory that the module source |
| 170 | distribution unpacks into. For example, if you've just downloaded a |
| 171 | module source distribution \file{foo-1.0.tar.gz} onto a Unix system, the |
| 172 | normal thing to do is: |
| 173 | \begin{verbatim} |
| 174 | gunzip -c foo-1.0.tar.gz | tar xf - # unpacks into directory foo-1.0 |
| 175 | cd foo-1.0 |
| 176 | python setup.py install |
| 177 | \end{verbatim} |
| 178 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 179 | On Windows, you'd probably unpack the archive before opening the command |
| 180 | prompt. If you downloaded the archive file to \file{C:\bslash{}Temp}, |
| 181 | then it probably unpacked (depending on your software) into |
| 182 | \file{C:\bslash{}Temp\bslash{}foo-1.0}; from the command prompt window, |
| 183 | you would then run |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 184 | \begin{verbatim} |
| 185 | cd c:\temp\foo-1.0 |
| 186 | python setup.py install |
| 187 | \end{verbatim} |
| 188 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 189 | On Mac~OS, ... \XXX{again, how do you run Python scripts on Mac~OS?} |
| 190 | |
| 191 | \XXX{arg, my lovely ``bslash'' macro doesn't work in non-tt fonts! help |
| 192 | me \LaTeX, you're my only hope...} |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 193 | |
| 194 | |
| 195 | \subsection{Splitting the job up} |
| 196 | |
| 197 | Running \code{setup.py install} builds and installs all modules in one |
| 198 | fell swoop. If you prefer to work incrementally---especially useful if |
| 199 | you want to customize the build process, or if things are going |
| 200 | wrong---you can use the setup script to do one thing at a time. |
| 201 | |
| 202 | For example, you can build everything in one step, and then install |
| 203 | everything in a second step, by invoking the setup script twice: |
| 204 | \begin{verbatim} |
| 205 | python setup.py build |
| 206 | python setup.py install |
| 207 | \end{verbatim} |
| 208 | (If you do this, you will notice that running the \command{install} |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 209 | command first runs the \command{build} command, which quickly notices |
| 210 | that it has nothing to do, since everything in the \file{build} |
| 211 | directory is up-to-date.) |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 212 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 213 | \XXX{concrete reason for splitting things up?} |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 214 | |
| 215 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 216 | \subsection{How building works} |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 217 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 218 | As implied above, the \command{build} command is responsible for putting |
| 219 | the files to install into a \emph{build directory}. By default, this is |
| 220 | \file{build} under the distribution root; if you're excessively |
| 221 | concerned with speed, or want to keep the source tree pristine, you can |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 222 | change the build directory with the \longprogramopt{build-base} option. For |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 223 | example: |
| 224 | \begin{verbatim} |
| 225 | python setup.py build --build-base=/tmp/pybuild/foo-1.0 |
| 226 | \end{verbatim} |
| 227 | (Or you could do this permanently with a directive in your system or |
| 228 | personal Distutils configuration file; see |
| 229 | section~\ref{sec:config-files}.) Normally, this isn't necessary. |
| 230 | |
| 231 | The default layout for the build tree is as follows: |
| 232 | \begin{verbatim} |
| 233 | --- build/ --- lib/ |
| 234 | or |
| 235 | --- build/ --- lib.<plat>/ |
| 236 | temp.<plat>/ |
| 237 | \end{verbatim} |
| 238 | where \code{<plat>} expands to a brief description of the current |
| 239 | OS/hardware platform. The first form, with just a \file{lib} directory, |
| 240 | is used for ``pure module distributions''---that is, module |
| 241 | distributions that include only pure Python modules. If a module |
| 242 | distribution contains any extensions (modules written in C/C++, or Java |
| 243 | for JPython), then the second form, with two \code{<plat>} directories, |
| 244 | is used. In that case, the \file{temp.\filevar{plat}} directory holds |
| 245 | temporary files generated by the compile/link process that don't |
| 246 | actually get installed. In either case, the \file{lib} (or |
| 247 | \file{lib.\filevar{plat}}) directory contains all Python modules (pure |
| 248 | Python and extensions) that will be installed. |
| 249 | |
| 250 | In the future, more directories will be added to handle Python scripts, |
| 251 | documentation, binary executables, and whatever else is needed to handle |
Greg Ward | d5faa7e | 2000-04-12 01:42:19 +0000 | [diff] [blame] | 252 | the job of installing Python modules and applications. |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 253 | |
| 254 | |
| 255 | \subsection{How installation works} |
| 256 | |
| 257 | After the \command{build} command runs (whether you run it explicitly, |
| 258 | or the \command{install} command does it for you), the work of the |
| 259 | \command{install} command is relatively simple: all it has to do is copy |
| 260 | everything under \file{build/lib} (or \file{build/lib.\filevar{plat}}) |
| 261 | to your chosen installation directory. |
| 262 | |
| 263 | If you don't choose an installation directory---i.e., if you just run |
| 264 | \code{setup.py install}---then the \command{install} command installs to |
| 265 | the standard location for third-party Python modules. This location |
| 266 | varies by platform and by how you built/installed Python itself. On |
| 267 | Unix and Mac OS, it also depends on whether the module distribution |
| 268 | being installed is pure Python or contains extensions (``non-pure''): |
Greg Ward | d5faa7e | 2000-04-12 01:42:19 +0000 | [diff] [blame] | 269 | \begin{tableiv}{l|l|l|c}{textrm}% |
| 270 | {Platform}{Standard installation location}{Default value}{Notes} |
| 271 | \lineiv{Unix (pure)} |
| 272 | {\filenq{\var{prefix}/lib/python1.6/site-packages}} |
| 273 | {\filenq{/usr/local/lib/python1.6/site-packages}} |
Greg Ward | 502d2b4 | 2000-04-12 14:20:15 +0000 | [diff] [blame] | 274 | {(1)} |
Greg Ward | d5faa7e | 2000-04-12 01:42:19 +0000 | [diff] [blame] | 275 | \lineiv{Unix (non-pure)} |
| 276 | {\filenq{\var{exec-prefix}/lib/python1.6/site-packages}} |
| 277 | {\filenq{/usr/local/lib/python1.6/site-packages}} |
Greg Ward | 502d2b4 | 2000-04-12 14:20:15 +0000 | [diff] [blame] | 278 | {(1)} |
Greg Ward | d5faa7e | 2000-04-12 01:42:19 +0000 | [diff] [blame] | 279 | \lineiv{Windows} |
| 280 | {\filenq{\var{prefix}}} |
| 281 | {\filenq{C:\bslash{}Python}} |
Greg Ward | 502d2b4 | 2000-04-12 14:20:15 +0000 | [diff] [blame] | 282 | {(2)} |
Greg Ward | d5faa7e | 2000-04-12 01:42:19 +0000 | [diff] [blame] | 283 | \lineiv{Mac~OS (pure)} |
| 284 | {\filenq{\var{prefix}:Lib}} |
| 285 | {\filenq{Python:Lib} \XXX{???}} |
| 286 | {} |
| 287 | \lineiv{Mac~OS (non-pure)} |
| 288 | {\var{prefix}:Mac:PlugIns} |
| 289 | {\filenq{Python:Mac:PlugIns}\XXX{???}} |
| 290 | {} |
| 291 | \end{tableiv} |
| 292 | |
| 293 | \noindent Notes: |
| 294 | \begin{description} |
Greg Ward | 502d2b4 | 2000-04-12 14:20:15 +0000 | [diff] [blame] | 295 | \item[(1)] Most Linux distributions include Python as a standard part of |
| 296 | the system, so \filevar{prefix} and \filevar{exec-prefix} are usually |
| 297 | both \file{/usr} on Linux. If you build Python yourself on Linux (or |
| 298 | any Unix-like system), the default \filevar{prefix} and |
| 299 | \filevar{exec-prefix} are \file{/usr/local}. |
| 300 | \item[(2)] The default installation directory on Windows was |
Greg Ward | d5faa7e | 2000-04-12 01:42:19 +0000 | [diff] [blame] | 301 | \file{C:\bslash{}Program Files\bslash{}Python} under Python 1.6a1, |
| 302 | 1.5.2, and earlier. |
| 303 | \end{description} |
| 304 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 305 | \filevar{prefix} and \filevar{exec-prefix} stand for the directories |
| 306 | that Python is installed to, and where it finds its libraries at |
| 307 | run-time. They are always the same under Windows and Mac~OS, and very |
| 308 | often the same under Unix. You can find out what your Python |
| 309 | installation uses for \filevar{prefix} and \filevar{exec-prefix} by |
| 310 | running Python in interactive mode and typing a few simple commands. |
| 311 | Under Unix, just type \code{python} at the shell prompt; under Windows, |
| 312 | run ``Python 1.6 (interpreter)'' \XXX{right?}; under Mac~OS, \XXX{???}. |
| 313 | Once the interpreter is started, you type Python code at the \code{>>>} |
| 314 | prompt. For example, on my Linux system, I type the three Python |
| 315 | statements shown below, and get the output as shown, to find out my |
| 316 | \filevar{prefix} and \filevar{exec-prefix}: |
| 317 | \begin{verbatim} |
| 318 | Python 1.5.2 (#1, Apr 18 1999, 16:03:16) [GCC pgcc-2.91.60 19981201 (egcs-1.1.1 on linux2 |
| 319 | Copyright 1991-1995 Stichting Mathematisch Centrum, Amsterdam |
| 320 | >>> import sys |
| 321 | >>> sys.prefix |
| 322 | '/usr' |
| 323 | >>> sys.exec_prefix |
| 324 | '/usr' |
| 325 | \end{verbatim} |
| 326 | |
| 327 | If you don't want to install to the standard location, or if you don't |
| 328 | have permission to write there, then you need to read about alternate |
| 329 | installations in the next section. |
| 330 | |
| 331 | |
| 332 | % This rather nasty macro is used to generate the tables that describe |
| 333 | % each installation scheme. It's nasty because it takes two arguments |
| 334 | % for each "slot" in an installation scheme, there will soon be more |
| 335 | % than five of these slots, and TeX has a limit of 10 arguments to a |
| 336 | % macro. Uh-oh. |
| 337 | |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 338 | \newcommand{\installscheme}[8] |
| 339 | {\begin{tableiii}{lll}{textrm} |
| 340 | {Type of file} |
| 341 | {Installation Directory} |
| 342 | {Override option} |
| 343 | \lineiii{pure module distribution} |
| 344 | {\filevar{#1}\filenq{#2}} |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 345 | {\longprogramopt{install-purelib}} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 346 | \lineiii{non-pure module distribution} |
| 347 | {\filevar{#3}\filenq{#4}} |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 348 | {\longprogramopt{install-platlib}} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 349 | \lineiii{scripts} |
| 350 | {\filevar{#5}\filenq{#6}} |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 351 | {\longprogramopt{install-scripts}} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 352 | \lineiii{data} |
| 353 | {\filevar{#7}\filenq{#8}} |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 354 | {\longprogramopt{install-data}} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 355 | \end{tableiii}} |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 356 | |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 357 | \section{Alternate Installation} |
| 358 | \label{sec:alt-install} |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 359 | |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 360 | Often, it is necessary or desirable to install modules to a location |
| 361 | other than the standard location for third-party Python modules. For |
| 362 | example, on a Unix system you might not have permission to write to the |
| 363 | standard third-party module directory. Or you might wish to try out a |
| 364 | module before making it a standard part of your local Python |
| 365 | installation; this is especially true when upgrading a distribution |
| 366 | already present: you want to make sure your existing base of scripts |
| 367 | still works with the new version before actually upgrading. |
| 368 | |
| 369 | The Distutils \command{install} command is designed to make installing |
| 370 | module distributions to an alternate location simple and painless. The |
| 371 | basic idea is that you supply a base directory for the installation, and |
| 372 | the \command{install} command picks a set of directories (called an |
| 373 | \emph{installation scheme}) under this base directory in which to |
| 374 | install files. The details differ across platforms, so read whichever |
| 375 | of the following section applies to you. |
| 376 | |
| 377 | |
| 378 | \subsection{Alternate installation: Unix (the home scheme)} |
| 379 | \label{sec:alt-unix-prefix} |
| 380 | |
| 381 | Under Unix, there are two ways to perform an alternate installation. |
| 382 | The ``prefix scheme'' is similar to how alternate installation works |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 383 | under Windows and Mac~OS, but is not necessarily the most useful way to |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 384 | maintain a personal Python library. Hence, we document the more |
| 385 | convenient and commonly useful ``home scheme'' first. |
| 386 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 387 | The idea behind the ``home scheme'' is that you build and maintain a |
| 388 | personal stash of Python modules, probably under your home directory. |
| 389 | Installing a new module distribution is as simple as |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 390 | \begin{verbatim} |
| 391 | python setup.py install --home=<dir> |
| 392 | \end{verbatim} |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 393 | where you can supply any directory you like for the \longprogramopt{home} |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 394 | option. Lazy typists can just type a tilde (\code{\tilde}); the |
| 395 | \command{install} command will expand this to your home directory: |
| 396 | \begin{verbatim} |
| 397 | python setup.py install --home=~ |
| 398 | \end{verbatim} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 399 | |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 400 | The \longprogramopt{home} option defines the installation base directory. Files |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 401 | are installed to the following directories under the installation base |
| 402 | as follows: |
| 403 | \installscheme{home}{/lib/python} |
| 404 | {home}{/lib/python} |
| 405 | {home}{/bin} |
| 406 | {home}{/share} |
| 407 | |
| 408 | \subsection{Alternate installation: Unix (the prefix scheme)} |
| 409 | \label{sec:alt-unix-home} |
| 410 | |
| 411 | The ``prefix scheme'' is useful when you wish to use one Python |
| 412 | installation to perform the build/install (i.e., to run the setup |
| 413 | script), but install modules into the third-party module directory of a |
| 414 | different Python installation (or something that looks like a different |
| 415 | Python installation). If this sounds a trifle unusual, it is---that's |
| 416 | why the ``home scheme'' comes first. However, there are at least two |
| 417 | known cases where the prefix scheme will be useful. |
| 418 | |
| 419 | First, consider that many Linux distribution put Python in \file{/usr}, |
| 420 | rather than the more traditional \file{/usr/local}. This is entirely |
| 421 | appropriate, since in those cases Python is part of ``the system'' |
| 422 | rather than a local add-on. However, if you are installing Python |
| 423 | modules from source, you probably want them to go in |
| 424 | \file{/usr/local/lib/python1.\filevar{X}} rather than |
| 425 | \file{/usr/lib/python1.\filevar{X}}. This can be done with |
| 426 | \begin{verbatim} |
| 427 | /usr/bin/python setup.py install --prefix=/usr/local |
| 428 | \end{verbatim} |
| 429 | |
| 430 | Another possibility is a network filesystem where the name used to write |
| 431 | to a remote directory is different from the name used to read it: for |
| 432 | example, the Python interpreter accessed as \file{/usr/local/bin/python} |
| 433 | might search for modules in \file{/usr/local/lib/python1.\filevar{X}}, |
| 434 | but those modules would have to be installed to, say, |
| 435 | \file{/mnt/\filevar{@server}/export/lib/python1.\filevar{X}}. This |
| 436 | could be done with |
| 437 | \begin{verbatim} |
| 438 | /usr/local/bin/python setup.py install --prefix=/mnt/@server/export |
| 439 | \end{verbatim} |
| 440 | |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 441 | In either case, the \longprogramopt{prefix} option defines the installation |
| 442 | base, and the \longprogramopt{exec-prefix} option defines the platform-specific |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 443 | installation base, which is used for platform-specific files. |
| 444 | (Currently, this just means non-pure module distributions, but could be |
| 445 | expanded to C libraries, binary executables, etc.) If |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 446 | \longprogramopt{exec-prefix} is not supplied, it defaults to \longprogramopt{prefix}. |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 447 | Files are installed as follows: |
| 448 | |
| 449 | \installscheme{prefix}{/lib/python1.\filevar{X}/site-packages} |
| 450 | {exec-prefix}{/lib/python1.\filevar{X}/site-packages} |
| 451 | {prefix}{/bin} |
| 452 | {prefix}{/share} |
| 453 | |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 454 | There is no requirement that \longprogramopt{prefix} or \longprogramopt{exec-prefix} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 455 | actually point to an alternate Python installation; if the directories |
| 456 | listed above do not already exist, they are created at installation |
| 457 | time. |
| 458 | |
| 459 | Incidentally, the real reason the prefix scheme is important is simply |
| 460 | that a standard Unix installation uses the prefix scheme, but with |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 461 | \longprogramopt{prefix} and \longprogramopt{exec-prefix} supplied by Python itself (as |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 462 | \code{sys.prefix} and \code{sys.exec\_prefix}). Thus, you might think |
| 463 | you'll never use the prefix scheme, but every time you run \code{python |
| 464 | setup.py install} without any other options, you're using it. |
| 465 | |
| 466 | Note that installing extensions to an alternate Python installation has |
| 467 | no effect on how those extensions are built: in particular, the Python |
| 468 | header files (\file{Python.h} and friends) installed with the Python |
| 469 | interpreter used to run the setup script will be used in compiling |
| 470 | extensions. It is your responsibility to ensure that the interpreter |
| 471 | used to run extensions installed in this way is compatibile with the |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 472 | interpreter used to build them. The best way to do this is to ensure |
| 473 | that the two interpreters are the same version of Python (possibly |
| 474 | different builds, or possibly copies of the same build). (Of course, if |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 475 | your \longprogramopt{prefix} and \longprogramopt{exec-prefix} don't even point to an |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 476 | alternate Python installation, this is immaterial.) |
| 477 | |
| 478 | |
| 479 | \subsection{Alternate installation: Windows} |
| 480 | \label{sec:alt-windows} |
| 481 | |
| 482 | Since Windows has no conception of a user's home directory, and since |
| 483 | the standard Python installation under Windows is simpler than that |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 484 | under Unix, there's no point in having separate \longprogramopt{prefix} and |
| 485 | \longprogramopt{home} options. Just use the \longprogramopt{prefix} option to specify |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 486 | a base directory, e.g. |
| 487 | \begin{verbatim} |
Greg Ward | 8e14f05 | 2000-03-22 01:00:23 +0000 | [diff] [blame] | 488 | python setup.py install --prefix="\Temp\Python" |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 489 | \end{verbatim} |
| 490 | to install modules to the \file{\bslash{}Temp} directory on the current |
| 491 | drive. |
| 492 | |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 493 | The installation base is defined by the \longprogramopt{prefix} option; the |
| 494 | \longprogramopt{exec-prefix} option is not supported under Windows. Files are |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 495 | installed as follows: |
| 496 | \installscheme{prefix}{} |
| 497 | {prefix}{} |
| 498 | {prefix}{\bslash{}Scripts} |
| 499 | {prefix}{\bslash{}Data} |
| 500 | |
| 501 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 502 | \subsection{Alternate installation: Mac~OS} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 503 | \label{sec:alt-macos} |
| 504 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 505 | Like Windows, Mac~OS has no notion of home directories (or even of |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 506 | users), and a fairly simple standard Python installation. Thus, only a |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 507 | \longprogramopt{prefix} option is needed. It defines the installation base, and |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 508 | files are installed under it as follows: |
| 509 | |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 510 | \XXX{how do MacPython users run the interpreter with command-line args?} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 511 | |
| 512 | \installscheme{prefix}{:Lib} |
| 513 | {prefix}{:Mac:PlugIns} |
Greg Ward | 8e14f05 | 2000-03-22 01:00:23 +0000 | [diff] [blame] | 514 | {prefix}{:Scripts} |
| 515 | {prefix}{:Data} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 516 | |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 517 | \XXX{Corran Webster says: ``Modules are found in either \file{:Lib} or |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 518 | \file{:Mac:Lib}, while extensions usually go in |
| 519 | \file{:Mac:PlugIns}''---does this mean that non-pure distributions should |
| 520 | be divided between \file{:Mac:PlugIns} and \file{:Mac:Lib}? If so, that |
| 521 | changes the granularity at which we care about modules: instead of |
| 522 | ``modules from pure distributions'' and ``modules from non-pure |
| 523 | distributions'', it becomes ``modules from pure distributions'', |
| 524 | ``Python modules from non-pure distributions'', and ``extensions from |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 525 | non-pure distributions''. Is this necessary?!?} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 526 | |
| 527 | |
| 528 | \section{Custom Installation} |
| 529 | \label{sec:custom-install} |
| 530 | |
| 531 | Sometimes, the alternate installation schemes described in |
| 532 | section~\ref{sec:alt-install} just don't do what you want. You might |
| 533 | want to tweak just one or two directories while keeping everything under |
| 534 | the same base directory, or you might want to completely redefine the |
| 535 | installation scheme. In either case, you're creating a \emph{custom |
| 536 | installation scheme}. |
| 537 | |
| 538 | You probably noticed the column of ``override options'' in the tables |
| 539 | describing the alternate installation schemes above. Those options are |
| 540 | how you define a custom installation scheme. These override options can |
| 541 | be relative, absolute, or explicitly defined in terms of one of the |
| 542 | installation base directories. (There are two installation base |
| 543 | directories, and they are normally the same---they only differ when you |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 544 | use the Unix ``prefix scheme'' and supply different \longprogramopt{prefix} and |
| 545 | \longprogramopt{exec-prefix} options.) |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 546 | |
| 547 | For example, say you're installing a module distribution to your home |
| 548 | directory under Unix---but you want scripts to go in |
| 549 | \file{\tilde/scripts} rather than \file{\tilde/bin}. As you might |
| 550 | expect, you can override this directory with the |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 551 | \longprogramopt{install-scripts} option; in this case, it makes most sense to |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 552 | supply a relative path, which will be interpreted relative to the |
| 553 | installation base directory (your home directory, in this case): |
| 554 | \begin{verbatim} |
| 555 | python setup.py install --home --install-scripts=scripts |
| 556 | \end{verbatim} |
| 557 | |
| 558 | Another Unix example: suppose your Python installation was built and |
| 559 | installed with a prefix of \file{/usr/local/python}, so under a standard |
| 560 | installation scripts will wind up in \file{/usr/local/python/bin}. If |
| 561 | you want them in \file{/usr/local/bin} instead, you would supply this |
Greg Ward | a021aca | 2000-04-19 22:34:11 +0000 | [diff] [blame^] | 562 | absolute directory for the \longprogramopt{install-scripts} option: |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 563 | \begin{verbatim} |
| 564 | python setup.py install --install-scripts=/usr/local/bin |
| 565 | \end{verbatim} |
| 566 | (This performs an installation using the ``prefix scheme,'' where the |
| 567 | prefix is whatever your Python interpreter was installed with--- |
| 568 | \file{/usr/local/python} in this case.) |
| 569 | |
| 570 | If you maintain Python on Windows, you might want third-party modules to |
| 571 | live in a subdirectory of \filevar{prefix}, rather than right in |
| 572 | \filevar{prefix} itself. This is almost as easy as customizing the |
| 573 | script installation directory---you just have to remember that there are |
| 574 | two types of modules to worry about, pure modules and non-pure modules |
| 575 | (i.e., modules from a non-pure distribution). For example: |
| 576 | \begin{verbatim} |
| 577 | python setup.py install --install-purelib=Site --install-platlib=Site |
| 578 | \end{verbatim} |
| 579 | The specified installation directories are relative to \filevar{prefix}. |
| 580 | Of course, you also have to ensure that these directories are in |
| 581 | Python's module search path, e.g. by putting a \file{.pth} file in |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 582 | \filevar{prefix} (\XXX{should have a section describing .pth files and |
| 583 | cross-ref it here}). |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 584 | |
| 585 | If you want to define an entire installation scheme, you just have to |
| 586 | supply all of the installation directory options. The recommended way |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 587 | to do this is to supply relative paths; for example, if you want to |
| 588 | maintain all Python module-related files under \file{python} in your |
| 589 | home directory, and you want a separate directory for each platform that |
| 590 | you use your home directory from, you might define the following |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 591 | installation scheme: |
| 592 | \begin{verbatim} |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 593 | python setup.py install --home=~ \ |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 594 | --install-purelib=python/lib \ |
| 595 | --install-platlib=python/lib.$PLAT \ |
| 596 | --install-scripts=python/scripts |
| 597 | --install-data=python/data |
| 598 | \end{verbatim} |
| 599 | or, equivalently, |
| 600 | \begin{verbatim} |
| 601 | python setup.py install --home=~/python \ |
| 602 | --install-purelib=lib \ |
| 603 | --install-platlib=lib.$PLAT \ |
| 604 | --install-scripts=scripts |
| 605 | --install-data=data |
| 606 | \end{verbatim} |
| 607 | \code{\$PLAT} is not (necessarily) an environment variable---it will be |
| 608 | expanded by the Distutils as it parses your command line options (just |
| 609 | as it does when parsing your configuration file(s)). |
| 610 | |
| 611 | Obviously, specifying the entire installation scheme every time you |
| 612 | install a new module distribution would be very tedious. Thus, you can |
| 613 | put these options into your Distutils config file (see |
| 614 | section~\ref{sec:config-files}): |
Greg Ward | 169f91b | 2000-03-10 01:57:51 +0000 | [diff] [blame] | 615 | \begin{verbatim} |
| 616 | [install] |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 617 | install-base=$HOME |
| 618 | install-purelib=python/lib |
| 619 | install-platlib=python/lib.$PLAT |
| 620 | install-scripts=python/scripts |
| 621 | install-data=python/data |
Greg Ward | 169f91b | 2000-03-10 01:57:51 +0000 | [diff] [blame] | 622 | \end{verbatim} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 623 | or, equivalently, |
Greg Ward | 169f91b | 2000-03-10 01:57:51 +0000 | [diff] [blame] | 624 | \begin{verbatim} |
| 625 | [install] |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 626 | install-base=$HOME/python |
| 627 | install-purelib=lib |
| 628 | install-platlib=lib.$PLAT |
| 629 | install-scripts=scripts |
| 630 | install-data=data |
Greg Ward | 169f91b | 2000-03-10 01:57:51 +0000 | [diff] [blame] | 631 | \end{verbatim} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 632 | Note that these two are \emph{not} equivalent if you supply a different |
| 633 | installation base directory when you run the setup script. For example, |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 634 | \begin{verbatim} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 635 | python setup.py --install-base=/tmp |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 636 | \end{verbatim} |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 637 | would install pure modules to \filevar{/tmp/python/lib} in the first |
| 638 | case, and to \filevar{/tmp/lib} in the second case. (For the second |
| 639 | case, you probably want to supply an installation base of |
| 640 | \file{/tmp/python}.) |
Greg Ward | 169f91b | 2000-03-10 01:57:51 +0000 | [diff] [blame] | 641 | |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 642 | You probably noticed the use of \code{\$HOME} and \code{\$PLAT} in the |
| 643 | sample configuration file input. These are Distutils configuration |
| 644 | variables, which bear a strong resemblance to environment variables. In |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 645 | fact, you can use environment variables in config files---on platforms |
| 646 | that have such a notion---but the Distutils additionally define a few |
| 647 | extra variables that may not be in your environment, such as |
| 648 | \code{\$PLAT}. (And of course, you can only use the configuration |
| 649 | variables supplied by the Distutils on systems that don't have |
| 650 | environment variables, such as Mac~OS (\XXX{true?}).) See |
Greg Ward | 2957656 | 2000-03-18 15:11:50 +0000 | [diff] [blame] | 651 | section~\ref{sec:config-files} for details. |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 652 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 653 | \XXX{need some Windows and Mac~OS examples---when would custom |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 654 | installation schemes be needed on those platforms?} |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 655 | |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 656 | |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 657 | \section{Distutils Configuration Files} |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 658 | \label{sec:config-files} |
| 659 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 660 | \XXX{not even implemented yet, much less documented!} |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 661 | |
| 662 | |
| 663 | \section{Pre-Distutils Conventions} |
| 664 | \label{sec:pre-distutils} |
| 665 | |
| 666 | |
Greg Ward | c392caa | 2000-04-11 02:00:26 +0000 | [diff] [blame] | 667 | \subsection{The Makefile.pre.in file} |
Greg Ward | 6002ffc | 2000-04-09 20:54:50 +0000 | [diff] [blame] | 668 | \label{sec:makefile-pre-in} |
| 669 | |
| 670 | |
| 671 | \subsection{Installing modules manually} |
| 672 | \label{sec:manual-install} |
| 673 | |
| 674 | |
| 675 | |
Greg Ward | 7c1e5f6 | 2000-03-10 01:56:58 +0000 | [diff] [blame] | 676 | \end{document} |