blob: e3f22325c4f793661821c615408bfb4c6b57baa3 [file] [log] [blame]
Fred Drake6659c301998-03-03 22:02:19 +00001\documentclass{manual}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002
Guido van Rossum9faf4c51997-10-07 14:38:54 +00003\title{Python/C API Reference Manual}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00004
5\input{boilerplate}
6
Marc-André Lemburga544ea22001-01-17 18:04:31 +00007\makeindex % tell \index to actually write the .idx file
Guido van Rossum9231c8f1997-05-15 21:43:21 +00008
9
10\begin{document}
11
Guido van Rossum9231c8f1997-05-15 21:43:21 +000012\maketitle
13
Fred Drake9f86b661998-07-28 21:55:19 +000014\ifhtml
15\chapter*{Front Matter\label{front}}
16\fi
17
Guido van Rossum9231c8f1997-05-15 21:43:21 +000018\input{copyright}
19
20\begin{abstract}
21
22\noindent
Fred Drake659ebfa2000-04-03 15:42:13 +000023This manual documents the API used by C and \Cpp{} programmers who
Fred Drakee058b4f1998-02-16 06:15:35 +000024want to write extension modules or embed Python. It is a companion to
Fred Drakebe486461999-11-09 17:03:03 +000025\citetitle[../ext/ext.html]{Extending and Embedding the Python
26Interpreter}, which describes the general principles of extension
27writing but does not document the API functions in detail.
Guido van Rossum9231c8f1997-05-15 21:43:21 +000028
Guido van Rossum5b8a5231997-12-30 04:38:44 +000029\strong{Warning:} The current version of this document is incomplete.
30I hope that it is nevertheless useful. I will continue to work on it,
31and release new versions from time to time, independent from Python
32source code releases.
33
Guido van Rossum9231c8f1997-05-15 21:43:21 +000034\end{abstract}
35
Fred Drake4d4f9e71998-01-13 22:25:02 +000036\tableofcontents
Guido van Rossum9231c8f1997-05-15 21:43:21 +000037
Guido van Rossum5060b3b1997-08-17 18:02:23 +000038% XXX Consider moving all this back to ext.tex and giving api.tex
39% XXX a *really* short intro only.
Guido van Rossum9231c8f1997-05-15 21:43:21 +000040
Fred Drakeefd146c1999-02-15 15:30:45 +000041\chapter{Introduction \label{intro}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +000042
Fred Drake659ebfa2000-04-03 15:42:13 +000043The Application Programmer's Interface to Python gives C and
44\Cpp{} programmers access to the Python interpreter at a variety of
45levels. The API is equally usable from \Cpp{}, but for brevity it is
46generally referred to as the Python/C API. There are two
47fundamentally different reasons for using the Python/C API. The first
48reason is to write \emph{extension modules} for specific purposes;
49these are C modules that extend the Python interpreter. This is
50probably the most common use. The second reason is to use Python as a
51component in a larger application; this technique is generally
52referred to as \dfn{embedding} Python in an application.
Guido van Rossum59a61351997-08-14 20:34:33 +000053
Guido van Rossum4a944d71997-08-14 20:35:38 +000054Writing an extension module is a relatively well-understood process,
55where a ``cookbook'' approach works well. There are several tools
56that automate the process to some extent. While people have embedded
57Python in other applications since its early existence, the process of
Fred Drakefc43d002001-05-21 15:03:35 +000058embedding Python is less straightforward than writing an extension.
Guido van Rossum59a61351997-08-14 20:34:33 +000059
Guido van Rossum4a944d71997-08-14 20:35:38 +000060Many API functions are useful independent of whether you're embedding
61or extending Python; moreover, most applications that embed Python
62will need to provide a custom extension as well, so it's probably a
63good idea to become familiar with writing an extension before
Guido van Rossum59a61351997-08-14 20:34:33 +000064attempting to embed Python in a real application.
65
Fred Drakeefd146c1999-02-15 15:30:45 +000066
67\section{Include Files \label{includes}}
Guido van Rossum580aa8d1997-11-25 15:34:51 +000068
69All function, type and macro definitions needed to use the Python/C
70API are included in your code by the following line:
71
Fred Drakee058b4f1998-02-16 06:15:35 +000072\begin{verbatim}
73#include "Python.h"
74\end{verbatim}
Guido van Rossum580aa8d1997-11-25 15:34:51 +000075
Fred Drakee058b4f1998-02-16 06:15:35 +000076This implies inclusion of the following standard headers:
Fred Drake0b71cea2000-09-26 05:51:50 +000077\code{<stdio.h>}, \code{<string.h>}, \code{<errno.h>},
78\code{<limits.h>}, and \code{<stdlib.h>} (if available).
Guido van Rossum580aa8d1997-11-25 15:34:51 +000079
80All user visible names defined by Python.h (except those defined by
Fred Drakee058b4f1998-02-16 06:15:35 +000081the included standard headers) have one of the prefixes \samp{Py} or
Fred Drake659ebfa2000-04-03 15:42:13 +000082\samp{_Py}. Names beginning with \samp{_Py} are for internal use by
83the Python implementation and should not be used by extension writers.
84Structure member names do not have a reserved prefix.
Guido van Rossum580aa8d1997-11-25 15:34:51 +000085
Fred Drakee058b4f1998-02-16 06:15:35 +000086\strong{Important:} user code should never define names that begin
87with \samp{Py} or \samp{_Py}. This confuses the reader, and
88jeopardizes the portability of the user code to future Python
89versions, which may define additional names beginning with one of
90these prefixes.
Guido van Rossum580aa8d1997-11-25 15:34:51 +000091
Fred Drake659ebfa2000-04-03 15:42:13 +000092The header files are typically installed with Python. On \UNIX, these
93are located in the directories
94\file{\envvar{prefix}/include/python\var{version}/} and
95\file{\envvar{exec_prefix}/include/python\var{version}/}, where
96\envvar{prefix} and \envvar{exec_prefix} are defined by the
97corresponding parameters to Python's \program{configure} script and
98\var{version} is \code{sys.version[:3]}. On Windows, the headers are
99installed in \file{\envvar{prefix}/include}, where \envvar{prefix} is
100the installation directory specified to the installer.
101
102To include the headers, place both directories (if different) on your
103compiler's search path for includes. Do \emph{not} place the parent
104directories on the search path and then use
Fred Draked5d04352000-09-14 20:24:17 +0000105\samp{\#include <python\shortversion/Python.h>}; this will break on
Fred Drake659ebfa2000-04-03 15:42:13 +0000106multi-platform builds since the platform independent headers under
107\envvar{prefix} include the platform specific headers from
108\envvar{exec_prefix}.
109
Fred Drakebab29652001-07-10 16:10:08 +0000110\Cpp{} users should note that though the API is defined entirely using
111C, the header files do properly declare the entry points to be
112\code{extern "C"}, so there is no need to do anything special to use
113the API from \Cpp.
114
Fred Drakeefd146c1999-02-15 15:30:45 +0000115
116\section{Objects, Types and Reference Counts \label{objects}}
Guido van Rossum59a61351997-08-14 20:34:33 +0000117
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000118Most Python/C API functions have one or more arguments as well as a
Fred Drake659ebfa2000-04-03 15:42:13 +0000119return value of type \ctype{PyObject*}. This type is a pointer
Fred Drakee058b4f1998-02-16 06:15:35 +0000120to an opaque data type representing an arbitrary Python
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000121object. Since all Python object types are treated the same way by the
122Python language in most situations (e.g., assignments, scope rules,
123and argument passing), it is only fitting that they should be
Fred Drake659ebfa2000-04-03 15:42:13 +0000124represented by a single C type. Almost all Python objects live on the
125heap: you never declare an automatic or static variable of type
126\ctype{PyObject}, only pointer variables of type \ctype{PyObject*} can
127be declared. The sole exception are the type objects\obindex{type};
128since these must never be deallocated, they are typically static
129\ctype{PyTypeObject} objects.
Guido van Rossum59a61351997-08-14 20:34:33 +0000130
Fred Drakee058b4f1998-02-16 06:15:35 +0000131All Python objects (even Python integers) have a \dfn{type} and a
132\dfn{reference count}. An object's type determines what kind of object
Guido van Rossum4a944d71997-08-14 20:35:38 +0000133it is (e.g., an integer, a list, or a user-defined function; there are
Fred Drakebe486461999-11-09 17:03:03 +0000134many more as explained in the \citetitle[../ref/ref.html]{Python
135Reference Manual}). For each of the well-known types there is a macro
136to check whether an object is of that type; for instance,
Fred Drake659ebfa2000-04-03 15:42:13 +0000137\samp{PyList_Check(\var{a})} is true if (and only if) the object
138pointed to by \var{a} is a Python list.
Guido van Rossum59a61351997-08-14 20:34:33 +0000139
Fred Drakeefd146c1999-02-15 15:30:45 +0000140
141\subsection{Reference Counts \label{refcounts}}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000142
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000143The reference count is important because today's computers have a
Fred Drake003d8da1998-04-13 00:53:42 +0000144finite (and often severely limited) memory size; it counts how many
Guido van Rossum4a944d71997-08-14 20:35:38 +0000145different places there are that have a reference to an object. Such a
Fred Drake659ebfa2000-04-03 15:42:13 +0000146place could be another object, or a global (or static) C variable, or
147a local variable in some C function. When an object's reference count
Guido van Rossum4a944d71997-08-14 20:35:38 +0000148becomes zero, the object is deallocated. If it contains references to
149other objects, their reference count is decremented. Those other
150objects may be deallocated in turn, if this decrement makes their
151reference count become zero, and so on. (There's an obvious problem
152with objects that reference each other here; for now, the solution is
Fred Drake659ebfa2000-04-03 15:42:13 +0000153``don't do that.'')
Guido van Rossum59a61351997-08-14 20:34:33 +0000154
Guido van Rossum4a944d71997-08-14 20:35:38 +0000155Reference counts are always manipulated explicitly. The normal way is
Fred Drake659ebfa2000-04-03 15:42:13 +0000156to use the macro \cfunction{Py_INCREF()}\ttindex{Py_INCREF()} to
157increment an object's reference count by one, and
158\cfunction{Py_DECREF()}\ttindex{Py_DECREF()} to decrement it by
159one. The \cfunction{Py_DECREF()} macro is considerably more complex
160than the incref one, since it must check whether the reference count
161becomes zero and then cause the object's deallocator to be called.
162The deallocator is a function pointer contained in the object's type
163structure. The type-specific deallocator takes care of decrementing
164the reference counts for other objects contained in the object if this
165is a compound object type, such as a list, as well as performing any
166additional finalization that's needed. There's no chance that the
167reference count can overflow; at least as many bits are used to hold
168the reference count as there are distinct memory locations in virtual
169memory (assuming \code{sizeof(long) >= sizeof(char*)}). Thus, the
170reference count increment is a simple operation.
Guido van Rossum59a61351997-08-14 20:34:33 +0000171
Guido van Rossum4a944d71997-08-14 20:35:38 +0000172It is not necessary to increment an object's reference count for every
173local variable that contains a pointer to an object. In theory, the
Fred Drakee058b4f1998-02-16 06:15:35 +0000174object's reference count goes up by one when the variable is made to
Guido van Rossum4a944d71997-08-14 20:35:38 +0000175point to it and it goes down by one when the variable goes out of
176scope. However, these two cancel each other out, so at the end the
177reference count hasn't changed. The only real reason to use the
178reference count is to prevent the object from being deallocated as
179long as our variable is pointing to it. If we know that there is at
180least one other reference to the object that lives at least as long as
181our variable, there is no need to increment the reference count
182temporarily. An important situation where this arises is in objects
Fred Drake659ebfa2000-04-03 15:42:13 +0000183that are passed as arguments to C functions in an extension module
Guido van Rossum4a944d71997-08-14 20:35:38 +0000184that are called from Python; the call mechanism guarantees to hold a
Guido van Rossum59a61351997-08-14 20:34:33 +0000185reference to every argument for the duration of the call.
186
Fred Drakee058b4f1998-02-16 06:15:35 +0000187However, a common pitfall is to extract an object from a list and
188hold on to it for a while without incrementing its reference count.
189Some other operation might conceivably remove the object from the
190list, decrementing its reference count and possible deallocating it.
191The real danger is that innocent-looking operations may invoke
192arbitrary Python code which could do this; there is a code path which
193allows control to flow back to the user from a \cfunction{Py_DECREF()},
194so almost any operation is potentially dangerous.
Guido van Rossum59a61351997-08-14 20:34:33 +0000195
Guido van Rossum4a944d71997-08-14 20:35:38 +0000196A safe approach is to always use the generic operations (functions
Fred Drake659ebfa2000-04-03 15:42:13 +0000197whose name begins with \samp{PyObject_}, \samp{PyNumber_},
198\samp{PySequence_} or \samp{PyMapping_}). These operations always
199increment the reference count of the object they return. This leaves
200the caller with the responsibility to call
201\cfunction{Py_DECREF()} when they are done with the result; this soon
202becomes second nature.
Guido van Rossum59a61351997-08-14 20:34:33 +0000203
Fred Drakeefd146c1999-02-15 15:30:45 +0000204
205\subsubsection{Reference Count Details \label{refcountDetails}}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000206
207The reference count behavior of functions in the Python/C API is best
Fred Drake659ebfa2000-04-03 15:42:13 +0000208explained in terms of \emph{ownership of references}. Note that we
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000209talk of owning references, never of owning objects; objects are always
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000210shared! When a function owns a reference, it has to dispose of it
Fred Drakee058b4f1998-02-16 06:15:35 +0000211properly --- either by passing ownership on (usually to its caller) or
212by calling \cfunction{Py_DECREF()} or \cfunction{Py_XDECREF()}. When
213a function passes ownership of a reference on to its caller, the
214caller is said to receive a \emph{new} reference. When no ownership
215is transferred, the caller is said to \emph{borrow} the reference.
216Nothing needs to be done for a borrowed reference.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000217
Fred Drakea8455ab2000-06-16 19:58:42 +0000218Conversely, when a calling function passes it a reference to an
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000219object, there are two possibilities: the function \emph{steals} a
220reference to the object, or it does not. Few functions steal
Fred Drakee058b4f1998-02-16 06:15:35 +0000221references; the two notable exceptions are
Fred Drake659ebfa2000-04-03 15:42:13 +0000222\cfunction{PyList_SetItem()}\ttindex{PyList_SetItem()} and
223\cfunction{PyTuple_SetItem()}\ttindex{PyTuple_SetItem()}, which
Fred Drakee058b4f1998-02-16 06:15:35 +0000224steal a reference to the item (but not to the tuple or list into which
Fred Drake003d8da1998-04-13 00:53:42 +0000225the item is put!). These functions were designed to steal a reference
Fred Drakee058b4f1998-02-16 06:15:35 +0000226because of a common idiom for populating a tuple or list with newly
227created objects; for example, the code to create the tuple \code{(1,
2282, "three")} could look like this (forgetting about error handling for
Fred Drake659ebfa2000-04-03 15:42:13 +0000229the moment; a better way to code this is shown below):
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000230
231\begin{verbatim}
232PyObject *t;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000233
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000234t = PyTuple_New(3);
235PyTuple_SetItem(t, 0, PyInt_FromLong(1L));
236PyTuple_SetItem(t, 1, PyInt_FromLong(2L));
237PyTuple_SetItem(t, 2, PyString_FromString("three"));
238\end{verbatim}
239
Fred Drakee058b4f1998-02-16 06:15:35 +0000240Incidentally, \cfunction{PyTuple_SetItem()} is the \emph{only} way to
241set tuple items; \cfunction{PySequence_SetItem()} and
242\cfunction{PyObject_SetItem()} refuse to do this since tuples are an
243immutable data type. You should only use
244\cfunction{PyTuple_SetItem()} for tuples that you are creating
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000245yourself.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000246
247Equivalent code for populating a list can be written using
Fred Drakee058b4f1998-02-16 06:15:35 +0000248\cfunction{PyList_New()} and \cfunction{PyList_SetItem()}. Such code
249can also use \cfunction{PySequence_SetItem()}; this illustrates the
250difference between the two (the extra \cfunction{Py_DECREF()} calls):
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000251
252\begin{verbatim}
253PyObject *l, *x;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000254
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000255l = PyList_New(3);
256x = PyInt_FromLong(1L);
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000257PySequence_SetItem(l, 0, x); Py_DECREF(x);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000258x = PyInt_FromLong(2L);
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000259PySequence_SetItem(l, 1, x); Py_DECREF(x);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000260x = PyString_FromString("three");
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000261PySequence_SetItem(l, 2, x); Py_DECREF(x);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000262\end{verbatim}
263
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000264You might find it strange that the ``recommended'' approach takes more
265code. However, in practice, you will rarely use these ways of
266creating and populating a tuple or list. There's a generic function,
Fred Drakee058b4f1998-02-16 06:15:35 +0000267\cfunction{Py_BuildValue()}, that can create most common objects from
Fred Drake659ebfa2000-04-03 15:42:13 +0000268C values, directed by a \dfn{format string}. For example, the
Fred Drakee058b4f1998-02-16 06:15:35 +0000269above two blocks of code could be replaced by the following (which
270also takes care of the error checking):
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000271
272\begin{verbatim}
273PyObject *t, *l;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000274
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000275t = Py_BuildValue("(iis)", 1, 2, "three");
276l = Py_BuildValue("[iis]", 1, 2, "three");
277\end{verbatim}
278
Fred Drakee058b4f1998-02-16 06:15:35 +0000279It is much more common to use \cfunction{PyObject_SetItem()} and
280friends with items whose references you are only borrowing, like
281arguments that were passed in to the function you are writing. In
282that case, their behaviour regarding reference counts is much saner,
283since you don't have to increment a reference count so you can give a
284reference away (``have it be stolen''). For example, this function
285sets all items of a list (actually, any mutable sequence) to a given
286item:
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000287
288\begin{verbatim}
289int set_all(PyObject *target, PyObject *item)
290{
291 int i, n;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000292
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000293 n = PyObject_Length(target);
294 if (n < 0)
295 return -1;
296 for (i = 0; i < n; i++) {
297 if (PyObject_SetItem(target, i, item) < 0)
298 return -1;
299 }
300 return 0;
301}
302\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000303\ttindex{set_all()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000304
305The situation is slightly different for function return values.
306While passing a reference to most functions does not change your
307ownership responsibilities for that reference, many functions that
308return a referece to an object give you ownership of the reference.
309The reason is simple: in many cases, the returned object is created
310on the fly, and the reference you get is the only reference to the
Fred Drakee058b4f1998-02-16 06:15:35 +0000311object. Therefore, the generic functions that return object
312references, like \cfunction{PyObject_GetItem()} and
Fred Drakebab29652001-07-10 16:10:08 +0000313\cfunction{PySequence_GetItem()}, always return a new reference (the
314caller becomes the owner of the reference).
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000315
316It is important to realize that whether you own a reference returned
Fred Drakee058b4f1998-02-16 06:15:35 +0000317by a function depends on which function you call only --- \emph{the
Fred Drakebab29652001-07-10 16:10:08 +0000318plumage} (the type of the type of the object passed as an
Fred Drakee058b4f1998-02-16 06:15:35 +0000319argument to the function) \emph{doesn't enter into it!} Thus, if you
320extract an item from a list using \cfunction{PyList_GetItem()}, you
321don't own the reference --- but if you obtain the same item from the
322same list using \cfunction{PySequence_GetItem()} (which happens to
323take exactly the same arguments), you do own a reference to the
324returned object.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000325
Fred Drakee058b4f1998-02-16 06:15:35 +0000326Here is an example of how you could write a function that computes the
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000327sum of the items in a list of integers; once using
Fred Drake659ebfa2000-04-03 15:42:13 +0000328\cfunction{PyList_GetItem()}\ttindex{PyList_GetItem()}, and once using
329\cfunction{PySequence_GetItem()}\ttindex{PySequence_GetItem()}.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000330
331\begin{verbatim}
332long sum_list(PyObject *list)
333{
334 int i, n;
335 long total = 0;
336 PyObject *item;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000337
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000338 n = PyList_Size(list);
339 if (n < 0)
340 return -1; /* Not a list */
341 for (i = 0; i < n; i++) {
342 item = PyList_GetItem(list, i); /* Can't fail */
343 if (!PyInt_Check(item)) continue; /* Skip non-integers */
344 total += PyInt_AsLong(item);
345 }
346 return total;
347}
348\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000349\ttindex{sum_list()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000350
351\begin{verbatim}
352long sum_sequence(PyObject *sequence)
353{
354 int i, n;
355 long total = 0;
356 PyObject *item;
Fred Drake659ebfa2000-04-03 15:42:13 +0000357 n = PySequence_Length(sequence);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000358 if (n < 0)
359 return -1; /* Has no length */
360 for (i = 0; i < n; i++) {
Fred Drake659ebfa2000-04-03 15:42:13 +0000361 item = PySequence_GetItem(sequence, i);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000362 if (item == NULL)
363 return -1; /* Not a sequence, or other failure */
364 if (PyInt_Check(item))
365 total += PyInt_AsLong(item);
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000366 Py_DECREF(item); /* Discard reference ownership */
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000367 }
368 return total;
369}
370\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000371\ttindex{sum_sequence()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000372
Fred Drakeefd146c1999-02-15 15:30:45 +0000373
374\subsection{Types \label{types}}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000375
376There are few other data types that play a significant role in
Fred Drake659ebfa2000-04-03 15:42:13 +0000377the Python/C API; most are simple C types such as \ctype{int},
378\ctype{long}, \ctype{double} and \ctype{char*}. A few structure types
Guido van Rossum4a944d71997-08-14 20:35:38 +0000379are used to describe static tables used to list the functions exported
Fred Drake659ebfa2000-04-03 15:42:13 +0000380by a module or the data attributes of a new object type, and another
381is used to describe the value of a complex number. These will
Guido van Rossum59a61351997-08-14 20:34:33 +0000382be discussed together with the functions that use them.
383
Fred Drakeefd146c1999-02-15 15:30:45 +0000384
385\section{Exceptions \label{exceptions}}
Guido van Rossum59a61351997-08-14 20:34:33 +0000386
Guido van Rossum4a944d71997-08-14 20:35:38 +0000387The Python programmer only needs to deal with exceptions if specific
388error handling is required; unhandled exceptions are automatically
Fred Drake659ebfa2000-04-03 15:42:13 +0000389propagated to the caller, then to the caller's caller, and so on, until
Guido van Rossum4a944d71997-08-14 20:35:38 +0000390they reach the top-level interpreter, where they are reported to the
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000391user accompanied by a stack traceback.
Guido van Rossum59a61351997-08-14 20:34:33 +0000392
Fred Drake659ebfa2000-04-03 15:42:13 +0000393For C programmers, however, error checking always has to be explicit.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000394All functions in the Python/C API can raise exceptions, unless an
395explicit claim is made otherwise in a function's documentation. In
396general, when a function encounters an error, it sets an exception,
397discards any object references that it owns, and returns an
Fred Drakee058b4f1998-02-16 06:15:35 +0000398error indicator --- usually \NULL{} or \code{-1}. A few functions
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000399return a Boolean true/false result, with false indicating an error.
400Very few functions return no explicit error indicator or have an
401ambiguous return value, and require explicit testing for errors with
Fred Drake659ebfa2000-04-03 15:42:13 +0000402\cfunction{PyErr_Occurred()}\ttindex{PyErr_Occurred()}.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000403
404Exception state is maintained in per-thread storage (this is
405equivalent to using global storage in an unthreaded application). A
Fred Drakec6fa34e1998-04-02 06:47:24 +0000406thread can be in one of two states: an exception has occurred, or not.
Fred Drakee058b4f1998-02-16 06:15:35 +0000407The function \cfunction{PyErr_Occurred()} can be used to check for
408this: it returns a borrowed reference to the exception type object
409when an exception has occurred, and \NULL{} otherwise. There are a
410number of functions to set the exception state:
Fred Drake659ebfa2000-04-03 15:42:13 +0000411\cfunction{PyErr_SetString()}\ttindex{PyErr_SetString()} is the most
412common (though not the most general) function to set the exception
413state, and \cfunction{PyErr_Clear()}\ttindex{PyErr_Clear()} clears the
414exception state.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000415
416The full exception state consists of three objects (all of which can
Fred Drakee058b4f1998-02-16 06:15:35 +0000417be \NULL{}): the exception type, the corresponding exception
Fred Drake659ebfa2000-04-03 15:42:13 +0000418value, and the traceback. These have the same meanings as the Python
419\withsubitem{(in module sys)}{
420 \ttindex{exc_type}\ttindex{exc_value}\ttindex{exc_traceback}}
421objects \code{sys.exc_type}, \code{sys.exc_value}, and
422\code{sys.exc_traceback}; however, they are not the same: the Python
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000423objects represent the last exception being handled by a Python
Fred Drake659ebfa2000-04-03 15:42:13 +0000424\keyword{try} \ldots\ \keyword{except} statement, while the C level
Fred Drakee058b4f1998-02-16 06:15:35 +0000425exception state only exists while an exception is being passed on
Fred Drake659ebfa2000-04-03 15:42:13 +0000426between C functions until it reaches the Python bytecode interpreter's
427main loop, which takes care of transferring it to \code{sys.exc_type}
428and friends.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000429
Fred Drakec6fa34e1998-04-02 06:47:24 +0000430Note that starting with Python 1.5, the preferred, thread-safe way to
Fred Drake659ebfa2000-04-03 15:42:13 +0000431access the exception state from Python code is to call the function
432\withsubitem{(in module sys)}{\ttindex{exc_info()}}
Fred Drakee058b4f1998-02-16 06:15:35 +0000433\function{sys.exc_info()}, which returns the per-thread exception state
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000434for Python code. Also, the semantics of both ways to access the
435exception state have changed so that a function which catches an
436exception will save and restore its thread's exception state so as to
437preserve the exception state of its caller. This prevents common bugs
438in exception handling code caused by an innocent-looking function
439overwriting the exception being handled; it also reduces the often
440unwanted lifetime extension for objects that are referenced by the
Fred Drakec6fa34e1998-04-02 06:47:24 +0000441stack frames in the traceback.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000442
443As a general principle, a function that calls another function to
444perform some task should check whether the called function raised an
445exception, and if so, pass the exception state on to its caller. It
Fred Drake659ebfa2000-04-03 15:42:13 +0000446should discard any object references that it owns, and return an
Fred Drakee058b4f1998-02-16 06:15:35 +0000447error indicator, but it should \emph{not} set another exception ---
448that would overwrite the exception that was just raised, and lose
449important information about the exact cause of the error.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000450
Fred Drake659ebfa2000-04-03 15:42:13 +0000451A simple example of detecting exceptions and passing them on is shown
452in the \cfunction{sum_sequence()}\ttindex{sum_sequence()} example
453above. It so happens that that example doesn't need to clean up any
454owned references when it detects an error. The following example
455function shows some error cleanup. First, to remind you why you like
456Python, we show the equivalent Python code:
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000457
458\begin{verbatim}
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000459def incr_item(dict, key):
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000460 try:
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000461 item = dict[key]
462 except KeyError:
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000463 item = 0
Fred Drake6b3f3f22000-11-29 15:48:22 +0000464 dict[key] = item + 1
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000465\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000466\ttindex{incr_item()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000467
Fred Drake659ebfa2000-04-03 15:42:13 +0000468Here is the corresponding C code, in all its glory:
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000469
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000470\begin{verbatim}
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000471int incr_item(PyObject *dict, PyObject *key)
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000472{
473 /* Objects all initialized to NULL for Py_XDECREF */
474 PyObject *item = NULL, *const_one = NULL, *incremented_item = NULL;
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000475 int rv = -1; /* Return value initialized to -1 (failure) */
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000476
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000477 item = PyObject_GetItem(dict, key);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000478 if (item == NULL) {
Fred Drakec6fa34e1998-04-02 06:47:24 +0000479 /* Handle KeyError only: */
Fred Drake6b3f3f22000-11-29 15:48:22 +0000480 if (!PyErr_ExceptionMatches(PyExc_KeyError))
481 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000482
483 /* Clear the error and use zero: */
484 PyErr_Clear();
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000485 item = PyInt_FromLong(0L);
Fred Drake6b3f3f22000-11-29 15:48:22 +0000486 if (item == NULL)
487 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000488 }
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000489 const_one = PyInt_FromLong(1L);
Fred Drake6b3f3f22000-11-29 15:48:22 +0000490 if (const_one == NULL)
491 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000492
493 incremented_item = PyNumber_Add(item, const_one);
Fred Drake6b3f3f22000-11-29 15:48:22 +0000494 if (incremented_item == NULL)
495 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000496
Fred Drake6b3f3f22000-11-29 15:48:22 +0000497 if (PyObject_SetItem(dict, key, incremented_item) < 0)
498 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000499 rv = 0; /* Success */
500 /* Continue with cleanup code */
501
502 error:
503 /* Cleanup code, shared by success and failure path */
504
505 /* Use Py_XDECREF() to ignore NULL references */
506 Py_XDECREF(item);
507 Py_XDECREF(const_one);
508 Py_XDECREF(incremented_item);
509
510 return rv; /* -1 for error, 0 for success */
511}
512\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000513\ttindex{incr_item()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000514
Fred Drakef8830d11998-04-23 14:06:01 +0000515This example represents an endorsed use of the \keyword{goto} statement
Fred Drake659ebfa2000-04-03 15:42:13 +0000516in C! It illustrates the use of
517\cfunction{PyErr_ExceptionMatches()}\ttindex{PyErr_ExceptionMatches()} and
518\cfunction{PyErr_Clear()}\ttindex{PyErr_Clear()} to
519handle specific exceptions, and the use of
520\cfunction{Py_XDECREF()}\ttindex{Py_XDECREF()} to
521dispose of owned references that may be \NULL{} (note the
522\character{X} in the name; \cfunction{Py_DECREF()} would crash when
523confronted with a \NULL{} reference). It is important that the
524variables used to hold owned references are initialized to \NULL{} for
525this to work; likewise, the proposed return value is initialized to
526\code{-1} (failure) and only set to success after the final call made
527is successful.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000528
Guido van Rossum59a61351997-08-14 20:34:33 +0000529
Fred Drakeefd146c1999-02-15 15:30:45 +0000530\section{Embedding Python \label{embedding}}
Guido van Rossum59a61351997-08-14 20:34:33 +0000531
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000532The one important task that only embedders (as opposed to extension
533writers) of the Python interpreter have to worry about is the
534initialization, and possibly the finalization, of the Python
535interpreter. Most functionality of the interpreter can only be used
536after the interpreter has been initialized.
Guido van Rossum59a61351997-08-14 20:34:33 +0000537
Fred Drake659ebfa2000-04-03 15:42:13 +0000538The basic initialization function is
539\cfunction{Py_Initialize()}\ttindex{Py_Initialize()}.
Fred Drakee058b4f1998-02-16 06:15:35 +0000540This initializes the table of loaded modules, and creates the
Fred Drake4de05a91998-02-16 14:25:26 +0000541fundamental modules \module{__builtin__}\refbimodindex{__builtin__},
542\module{__main__}\refbimodindex{__main__} and
543\module{sys}\refbimodindex{sys}. It also initializes the module
Fred Drakec6fa34e1998-04-02 06:47:24 +0000544search path (\code{sys.path}).%
545\indexiii{module}{search}{path}
Fred Drake659ebfa2000-04-03 15:42:13 +0000546\withsubitem{(in module sys)}{\ttindex{path}}
Guido van Rossum59a61351997-08-14 20:34:33 +0000547
Fred Drakee058b4f1998-02-16 06:15:35 +0000548\cfunction{Py_Initialize()} does not set the ``script argument list''
Guido van Rossum4a944d71997-08-14 20:35:38 +0000549(\code{sys.argv}). If this variable is needed by Python code that
550will be executed later, it must be set explicitly with a call to
Fred Drake659ebfa2000-04-03 15:42:13 +0000551\code{PySys_SetArgv(\var{argc},
552\var{argv})}\ttindex{PySys_SetArgv()} subsequent to the call to
553\cfunction{Py_Initialize()}.
Guido van Rossum59a61351997-08-14 20:34:33 +0000554
Fred Drakeb0a78731998-01-13 18:51:10 +0000555On most systems (in particular, on \UNIX{} and Windows, although the
Fred Drake659ebfa2000-04-03 15:42:13 +0000556details are slightly different),
557\cfunction{Py_Initialize()} calculates the module search path based
558upon its best guess for the location of the standard Python
559interpreter executable, assuming that the Python library is found in a
560fixed location relative to the Python interpreter executable. In
561particular, it looks for a directory named
Fred Draked5d04352000-09-14 20:24:17 +0000562\file{lib/python\shortversion} relative to the parent directory where
563the executable named \file{python} is found on the shell command
564search path (the environment variable \envvar{PATH}).
Guido van Rossum42cefd01997-10-05 15:27:29 +0000565
566For instance, if the Python executable is found in
Fred Drakee058b4f1998-02-16 06:15:35 +0000567\file{/usr/local/bin/python}, it will assume that the libraries are in
Fred Draked5d04352000-09-14 20:24:17 +0000568\file{/usr/local/lib/python\shortversion}. (In fact, this particular path
Fred Drakee058b4f1998-02-16 06:15:35 +0000569is also the ``fallback'' location, used when no executable file named
Fred Drakec6fa34e1998-04-02 06:47:24 +0000570\file{python} is found along \envvar{PATH}.) The user can override
571this behavior by setting the environment variable \envvar{PYTHONHOME},
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000572or insert additional directories in front of the standard path by
Fred Drakec6fa34e1998-04-02 06:47:24 +0000573setting \envvar{PYTHONPATH}.
Guido van Rossum59a61351997-08-14 20:34:33 +0000574
Guido van Rossum4a944d71997-08-14 20:35:38 +0000575The embedding application can steer the search by calling
Fred Drake659ebfa2000-04-03 15:42:13 +0000576\code{Py_SetProgramName(\var{file})}\ttindex{Py_SetProgramName()} \emph{before} calling
Fred Drakec6fa34e1998-04-02 06:47:24 +0000577\cfunction{Py_Initialize()}. Note that \envvar{PYTHONHOME} still
578overrides this and \envvar{PYTHONPATH} is still inserted in front of
Fred Drakee058b4f1998-02-16 06:15:35 +0000579the standard path. An application that requires total control has to
Fred Drake659ebfa2000-04-03 15:42:13 +0000580provide its own implementation of
581\cfunction{Py_GetPath()}\ttindex{Py_GetPath()},
582\cfunction{Py_GetPrefix()}\ttindex{Py_GetPrefix()},
583\cfunction{Py_GetExecPrefix()}\ttindex{Py_GetExecPrefix()}, and
584\cfunction{Py_GetProgramFullPath()}\ttindex{Py_GetProgramFullPath()} (all
585defined in \file{Modules/getpath.c}).
Guido van Rossum59a61351997-08-14 20:34:33 +0000586
Guido van Rossum4a944d71997-08-14 20:35:38 +0000587Sometimes, it is desirable to ``uninitialize'' Python. For instance,
588the application may want to start over (make another call to
Fred Drakee058b4f1998-02-16 06:15:35 +0000589\cfunction{Py_Initialize()}) or the application is simply done with its
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000590use of Python and wants to free all memory allocated by Python. This
Fred Drakee058b4f1998-02-16 06:15:35 +0000591can be accomplished by calling \cfunction{Py_Finalize()}. The function
Fred Drake659ebfa2000-04-03 15:42:13 +0000592\cfunction{Py_IsInitialized()}\ttindex{Py_IsInitialized()} returns
593true if Python is currently in the initialized state. More
594information about these functions is given in a later chapter.
Guido van Rossum59a61351997-08-14 20:34:33 +0000595
Guido van Rossum4a944d71997-08-14 20:35:38 +0000596
Fred Drakeefd146c1999-02-15 15:30:45 +0000597\chapter{The Very High Level Layer \label{veryhigh}}
Guido van Rossum4a944d71997-08-14 20:35:38 +0000598
Fred Drakee5bf8b21998-02-12 21:22:28 +0000599The functions in this chapter will let you execute Python source code
600given in a file or a buffer, but they will not let you interact in a
601more detailed way with the interpreter.
Guido van Rossum4a944d71997-08-14 20:35:38 +0000602
Fred Drake659ebfa2000-04-03 15:42:13 +0000603Several of these functions accept a start symbol from the grammar as a
604parameter. The available start symbols are \constant{Py_eval_input},
605\constant{Py_file_input}, and \constant{Py_single_input}. These are
606described following the functions which accept them as parameters.
607
Fred Drake510d08b2000-08-14 02:50:21 +0000608Note also that several of these functions take \ctype{FILE*}
609parameters. On particular issue which needs to be handled carefully
610is that the \ctype{FILE} structure for different C libraries can be
611different and incompatible. Under Windows (at least), it is possible
612for dynamically linked extensions to actually use different libraries,
613so care should be taken that \ctype{FILE*} parameters are only passed
614to these functions if it is certain that they were created by the same
615library that the Python runtime is using.
616
Fred Drake24e62192001-05-21 15:56:55 +0000617\begin{cfuncdesc}{int}{Py_Main}{int argc, char **argv}
618 The main program for the standard interpreter. This is made
619 available for programs which embed Python. The \var{argc} and
620 \var{argv} parameters should be prepared exactly as those which are
621 passed to a C program's \cfunction{main()} function. It is
622 important to note that the argument list may be modified (but the
623 contents of the strings pointed to by the argument list are not).
624 The return value will be the integer passed to the
625 \function{sys.exit()} function, \code{1} if the interpreter exits
626 due to an exception, or \code{2} if the parameter list does not
627 represent a valid Python command line.
628\end{cfuncdesc}
629
Fred Drakec6fa34e1998-04-02 06:47:24 +0000630\begin{cfuncdesc}{int}{PyRun_AnyFile}{FILE *fp, char *filename}
Fred Drake0041a941999-04-29 04:20:46 +0000631 If \var{fp} refers to a file associated with an interactive device
632 (console or terminal input or \UNIX{} pseudo-terminal), return the
633 value of \cfunction{PyRun_InteractiveLoop()}, otherwise return the
634 result of \cfunction{PyRun_SimpleFile()}. If \var{filename} is
Fred Drakea8d73412000-08-11 20:39:29 +0000635 \NULL{}, this function uses \code{"???"} as the filename.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000636\end{cfuncdesc}
637
Fred Drakec6fa34e1998-04-02 06:47:24 +0000638\begin{cfuncdesc}{int}{PyRun_SimpleString}{char *command}
Fred Drake0041a941999-04-29 04:20:46 +0000639 Executes the Python source code from \var{command} in the
640 \module{__main__} module. If \module{__main__} does not already
641 exist, it is created. Returns \code{0} on success or \code{-1} if
642 an exception was raised. If there was an error, there is no way to
643 get the exception information.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000644\end{cfuncdesc}
645
Fred Drakec6fa34e1998-04-02 06:47:24 +0000646\begin{cfuncdesc}{int}{PyRun_SimpleFile}{FILE *fp, char *filename}
Fred Drake0041a941999-04-29 04:20:46 +0000647 Similar to \cfunction{PyRun_SimpleString()}, but the Python source
648 code is read from \var{fp} instead of an in-memory string.
649 \var{filename} should be the name of the file.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000650\end{cfuncdesc}
651
Fred Drakec6fa34e1998-04-02 06:47:24 +0000652\begin{cfuncdesc}{int}{PyRun_InteractiveOne}{FILE *fp, char *filename}
Fred Drakea8d73412000-08-11 20:39:29 +0000653 Read and execute a single statement from a file associated with an
654 interactive device. If \var{filename} is \NULL, \code{"???"} is
655 used instead. The user will be prompted using \code{sys.ps1} and
656 \code{sys.ps2}. Returns \code{0} when the input was executed
657 successfully, \code{-1} if there was an exception, or an error code
658 from the \file{errcode.h} include file distributed as part of Python
659 in case of a parse error. (Note that \file{errcode.h} is not
660 included by \file{Python.h}, so must be included specifically if
661 needed.)
Fred Drakee5bf8b21998-02-12 21:22:28 +0000662\end{cfuncdesc}
663
Fred Drakec6fa34e1998-04-02 06:47:24 +0000664\begin{cfuncdesc}{int}{PyRun_InteractiveLoop}{FILE *fp, char *filename}
Fred Drakea8d73412000-08-11 20:39:29 +0000665 Read and execute statements from a file associated with an
666 interactive device until \EOF{} is reached. If \var{filename} is
667 \NULL, \code{"???"} is used instead. The user will be prompted
668 using \code{sys.ps1} and \code{sys.ps2}. Returns \code{0} at \EOF.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000669\end{cfuncdesc}
670
Fred Drakec6fa34e1998-04-02 06:47:24 +0000671\begin{cfuncdesc}{struct _node*}{PyParser_SimpleParseString}{char *str,
672 int start}
Fred Drake0041a941999-04-29 04:20:46 +0000673 Parse Python source code from \var{str} using the start token
674 \var{start}. The result can be used to create a code object which
675 can be evaluated efficiently. This is useful if a code fragment
676 must be evaluated many times.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000677\end{cfuncdesc}
678
Fred Drakec6fa34e1998-04-02 06:47:24 +0000679\begin{cfuncdesc}{struct _node*}{PyParser_SimpleParseFile}{FILE *fp,
680 char *filename, int start}
Fred Drake0041a941999-04-29 04:20:46 +0000681 Similar to \cfunction{PyParser_SimpleParseString()}, but the Python
682 source code is read from \var{fp} instead of an in-memory string.
683 \var{filename} should be the name of the file.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000684\end{cfuncdesc}
685
Fred Drakec6fa34e1998-04-02 06:47:24 +0000686\begin{cfuncdesc}{PyObject*}{PyRun_String}{char *str, int start,
687 PyObject *globals,
688 PyObject *locals}
Fred Drake0041a941999-04-29 04:20:46 +0000689 Execute Python source code from \var{str} in the context specified
690 by the dictionaries \var{globals} and \var{locals}. The parameter
691 \var{start} specifies the start token that should be used to parse
692 the source code.
693
694 Returns the result of executing the code as a Python object, or
695 \NULL{} if an exception was raised.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000696\end{cfuncdesc}
697
Fred Drakec6fa34e1998-04-02 06:47:24 +0000698\begin{cfuncdesc}{PyObject*}{PyRun_File}{FILE *fp, char *filename,
699 int start, PyObject *globals,
700 PyObject *locals}
Fred Drake0041a941999-04-29 04:20:46 +0000701 Similar to \cfunction{PyRun_String()}, but the Python source code is
Fred Drake659ebfa2000-04-03 15:42:13 +0000702 read from \var{fp} instead of an in-memory string.
703 \var{filename} should be the name of the file.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000704\end{cfuncdesc}
705
Fred Drakec6fa34e1998-04-02 06:47:24 +0000706\begin{cfuncdesc}{PyObject*}{Py_CompileString}{char *str, char *filename,
707 int start}
Fred Drake0041a941999-04-29 04:20:46 +0000708 Parse and compile the Python source code in \var{str}, returning the
709 resulting code object. The start token is given by \var{start};
Fred Drakec924b8d1999-08-23 18:57:25 +0000710 this can be used to constrain the code which can be compiled and should
711 be \constant{Py_eval_input}, \constant{Py_file_input}, or
712 \constant{Py_single_input}. The filename specified by
713 \var{filename} is used to construct the code object and may appear
714 in tracebacks or \exception{SyntaxError} exception messages. This
715 returns \NULL{} if the code cannot be parsed or compiled.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000716\end{cfuncdesc}
717
Fred Drakec924b8d1999-08-23 18:57:25 +0000718\begin{cvardesc}{int}{Py_eval_input}
719 The start symbol from the Python grammar for isolated expressions;
Fred Drake659ebfa2000-04-03 15:42:13 +0000720 for use with \cfunction{Py_CompileString()}\ttindex{Py_CompileString()}.
Fred Drakec924b8d1999-08-23 18:57:25 +0000721\end{cvardesc}
722
723\begin{cvardesc}{int}{Py_file_input}
724 The start symbol from the Python grammar for sequences of statements
725 as read from a file or other source; for use with
Fred Drake659ebfa2000-04-03 15:42:13 +0000726 \cfunction{Py_CompileString()}\ttindex{Py_CompileString()}. This is
727 the symbol to use when compiling arbitrarily long Python source code.
Fred Drakec924b8d1999-08-23 18:57:25 +0000728\end{cvardesc}
729
730\begin{cvardesc}{int}{Py_single_input}
731 The start symbol from the Python grammar for a single statement; for
Fred Drake659ebfa2000-04-03 15:42:13 +0000732 use with \cfunction{Py_CompileString()}\ttindex{Py_CompileString()}.
733 This is the symbol used for the interactive interpreter loop.
Fred Drakec924b8d1999-08-23 18:57:25 +0000734\end{cvardesc}
735
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000736
Fred Drakeefd146c1999-02-15 15:30:45 +0000737\chapter{Reference Counting \label{countingRefs}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000738
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000739The macros in this section are used for managing reference counts
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000740of Python objects.
741
742\begin{cfuncdesc}{void}{Py_INCREF}{PyObject *o}
Fred Drakec6fa34e1998-04-02 06:47:24 +0000743Increment the reference count for object \var{o}. The object must
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000744not be \NULL{}; if you aren't sure that it isn't \NULL{}, use
Fred Drakee058b4f1998-02-16 06:15:35 +0000745\cfunction{Py_XINCREF()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000746\end{cfuncdesc}
747
748\begin{cfuncdesc}{void}{Py_XINCREF}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +0000749Increment the reference count for object \var{o}. The object may be
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000750\NULL{}, in which case the macro has no effect.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000751\end{cfuncdesc}
752
753\begin{cfuncdesc}{void}{Py_DECREF}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +0000754Decrement the reference count for object \var{o}. The object must
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000755not be \NULL{}; if you aren't sure that it isn't \NULL{}, use
Fred Drakee058b4f1998-02-16 06:15:35 +0000756\cfunction{Py_XDECREF()}. If the reference count reaches zero, the
757object's type's deallocation function (which must not be \NULL{}) is
758invoked.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000759
760\strong{Warning:} The deallocation function can cause arbitrary Python
Fred Drake659ebfa2000-04-03 15:42:13 +0000761code to be invoked (e.g. when a class instance with a
762\method{__del__()} method is deallocated). While exceptions in such
763code are not propagated, the executed code has free access to all
764Python global variables. This means that any object that is reachable
765from a global variable should be in a consistent state before
766\cfunction{Py_DECREF()} is invoked. For example, code to delete an
767object from a list should copy a reference to the deleted object in a
768temporary variable, update the list data structure, and then call
769\cfunction{Py_DECREF()} for the temporary variable.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000770\end{cfuncdesc}
771
772\begin{cfuncdesc}{void}{Py_XDECREF}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +0000773Decrement the reference count for object \var{o}. The object may be
774\NULL{}, in which case the macro has no effect; otherwise the effect
775is the same as for \cfunction{Py_DECREF()}, and the same warning
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000776applies.
777\end{cfuncdesc}
778
Fred Drake659ebfa2000-04-03 15:42:13 +0000779The following functions or macros are only for use within the
780interpreter core: \cfunction{_Py_Dealloc()},
781\cfunction{_Py_ForgetReference()}, \cfunction{_Py_NewReference()}, as
782well as the global variable \cdata{_Py_RefTotal}.
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000783
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000784
Fred Drakeefd146c1999-02-15 15:30:45 +0000785\chapter{Exception Handling \label{exceptionHandling}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000786
Fred Drake659ebfa2000-04-03 15:42:13 +0000787The functions described in this chapter will let you handle and raise Python
Guido van Rossumae110af1997-05-22 20:11:52 +0000788exceptions. It is important to understand some of the basics of
Fred Drake659ebfa2000-04-03 15:42:13 +0000789Python exception handling. It works somewhat like the
790\UNIX{} \cdata{errno} variable: there is a global indicator (per
791thread) of the last error that occurred. Most functions don't clear
792this on success, but will set it to indicate the cause of the error on
793failure. Most functions also return an error indicator, usually
794\NULL{} if they are supposed to return a pointer, or \code{-1} if they
795return an integer (exception: the \cfunction{PyArg_Parse*()} functions
796return \code{1} for success and \code{0} for failure). When a
797function must fail because some function it called failed, it
798generally doesn't set the error indicator; the function it called
799already set it.
Guido van Rossumae110af1997-05-22 20:11:52 +0000800
801The error indicator consists of three Python objects corresponding to
Fred Drake659ebfa2000-04-03 15:42:13 +0000802\withsubitem{(in module sys)}{
803 \ttindex{exc_type}\ttindex{exc_value}\ttindex{exc_traceback}}
Guido van Rossumae110af1997-05-22 20:11:52 +0000804the Python variables \code{sys.exc_type}, \code{sys.exc_value} and
805\code{sys.exc_traceback}. API functions exist to interact with the
806error indicator in various ways. There is a separate error indicator
807for each thread.
808
809% XXX Order of these should be more thoughtful.
810% Either alphabetical or some kind of structure.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000811
812\begin{cfuncdesc}{void}{PyErr_Print}{}
Guido van Rossumae110af1997-05-22 20:11:52 +0000813Print a standard traceback to \code{sys.stderr} and clear the error
814indicator. Call this function only when the error indicator is set.
815(Otherwise it will cause a fatal error!)
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000816\end{cfuncdesc}
817
Fred Drakec6fa34e1998-04-02 06:47:24 +0000818\begin{cfuncdesc}{PyObject*}{PyErr_Occurred}{}
Guido van Rossumae110af1997-05-22 20:11:52 +0000819Test whether the error indicator is set. If set, return the exception
Fred Drakee058b4f1998-02-16 06:15:35 +0000820\emph{type} (the first argument to the last call to one of the
Fred Drakef8830d11998-04-23 14:06:01 +0000821\cfunction{PyErr_Set*()} functions or to \cfunction{PyErr_Restore()}). If
Fred Drakee058b4f1998-02-16 06:15:35 +0000822not set, return \NULL{}. You do not own a reference to the return
823value, so you do not need to \cfunction{Py_DECREF()} it.
Fred Drake659ebfa2000-04-03 15:42:13 +0000824\strong{Note:} Do not compare the return value to a specific
Fred Drakee058b4f1998-02-16 06:15:35 +0000825exception; use \cfunction{PyErr_ExceptionMatches()} instead, shown
Fred Drake659ebfa2000-04-03 15:42:13 +0000826below. (The comparison could easily fail since the exception may be
827an instance instead of a class, in the case of a class exception, or
828it may the a subclass of the expected exception.)
Guido van Rossum42cefd01997-10-05 15:27:29 +0000829\end{cfuncdesc}
830
831\begin{cfuncdesc}{int}{PyErr_ExceptionMatches}{PyObject *exc}
Guido van Rossum42cefd01997-10-05 15:27:29 +0000832Equivalent to
Fred Drakee058b4f1998-02-16 06:15:35 +0000833\samp{PyErr_GivenExceptionMatches(PyErr_Occurred(), \var{exc})}.
Fred Drake659ebfa2000-04-03 15:42:13 +0000834This should only be called when an exception is actually set; a memory
835access violation will occur if no exception has been raised.
Guido van Rossum42cefd01997-10-05 15:27:29 +0000836\end{cfuncdesc}
837
838\begin{cfuncdesc}{int}{PyErr_GivenExceptionMatches}{PyObject *given, PyObject *exc}
Guido van Rossum42cefd01997-10-05 15:27:29 +0000839Return true if the \var{given} exception matches the exception in
840\var{exc}. If \var{exc} is a class object, this also returns true
Fred Drake659ebfa2000-04-03 15:42:13 +0000841when \var{given} is an instance of a subclass. If \var{exc} is a tuple, all
Guido van Rossum42cefd01997-10-05 15:27:29 +0000842exceptions in the tuple (and recursively in subtuples) are searched
Fred Drake659ebfa2000-04-03 15:42:13 +0000843for a match. If \var{given} is \NULL, a memory access violation will
844occur.
Guido van Rossum42cefd01997-10-05 15:27:29 +0000845\end{cfuncdesc}
846
847\begin{cfuncdesc}{void}{PyErr_NormalizeException}{PyObject**exc, PyObject**val, PyObject**tb}
Guido van Rossum42cefd01997-10-05 15:27:29 +0000848Under certain circumstances, the values returned by
Fred Drakee058b4f1998-02-16 06:15:35 +0000849\cfunction{PyErr_Fetch()} below can be ``unnormalized'', meaning that
850\code{*\var{exc}} is a class object but \code{*\var{val}} is not an
851instance of the same class. This function can be used to instantiate
852the class in that case. If the values are already normalized, nothing
Fred Drake659ebfa2000-04-03 15:42:13 +0000853happens. The delayed normalization is implemented to improve
854performance.
Guido van Rossumae110af1997-05-22 20:11:52 +0000855\end{cfuncdesc}
856
857\begin{cfuncdesc}{void}{PyErr_Clear}{}
858Clear the error indicator. If the error indicator is not set, there
859is no effect.
860\end{cfuncdesc}
861
Fred Drake659ebfa2000-04-03 15:42:13 +0000862\begin{cfuncdesc}{void}{PyErr_Fetch}{PyObject **ptype, PyObject **pvalue,
863 PyObject **ptraceback}
Guido van Rossumae110af1997-05-22 20:11:52 +0000864Retrieve the error indicator into three variables whose addresses are
865passed. If the error indicator is not set, set all three variables to
866\NULL{}. If it is set, it will be cleared and you own a reference to
Fred Drake659ebfa2000-04-03 15:42:13 +0000867each object retrieved. The value and traceback object may be
868\NULL{} even when the type object is not. \strong{Note:} This
869function is normally only used by code that needs to handle exceptions
870or by code that needs to save and restore the error indicator
871temporarily.
Guido van Rossumae110af1997-05-22 20:11:52 +0000872\end{cfuncdesc}
873
Fred Drake17e63432000-08-31 05:50:40 +0000874\begin{cfuncdesc}{void}{PyErr_Restore}{PyObject *type, PyObject *value,
875 PyObject *traceback}
Guido van Rossumae110af1997-05-22 20:11:52 +0000876Set the error indicator from the three objects. If the error
877indicator is already set, it is cleared first. If the objects are
878\NULL{}, the error indicator is cleared. Do not pass a \NULL{} type
879and non-\NULL{} value or traceback. The exception type should be a
880string or class; if it is a class, the value should be an instance of
881that class. Do not pass an invalid exception type or value.
882(Violating these rules will cause subtle problems later.) This call
Fred Drakebab29652001-07-10 16:10:08 +0000883takes away a reference to each object: you must own a reference
Guido van Rossumae110af1997-05-22 20:11:52 +0000884to each object before the call and after the call you no longer own
885these references. (If you don't understand this, don't use this
Fred Drake659ebfa2000-04-03 15:42:13 +0000886function. I warned you.) \strong{Note:} This function is normally
Guido van Rossumae110af1997-05-22 20:11:52 +0000887only used by code that needs to save and restore the error indicator
888temporarily.
889\end{cfuncdesc}
890
891\begin{cfuncdesc}{void}{PyErr_SetString}{PyObject *type, char *message}
892This is the most common way to set the error indicator. The first
893argument specifies the exception type; it is normally one of the
Fred Drakef8830d11998-04-23 14:06:01 +0000894standard exceptions, e.g. \cdata{PyExc_RuntimeError}. You need not
Guido van Rossumae110af1997-05-22 20:11:52 +0000895increment its reference count. The second argument is an error
896message; it is converted to a string object.
897\end{cfuncdesc}
898
899\begin{cfuncdesc}{void}{PyErr_SetObject}{PyObject *type, PyObject *value}
Fred Drakee058b4f1998-02-16 06:15:35 +0000900This function is similar to \cfunction{PyErr_SetString()} but lets you
Guido van Rossumae110af1997-05-22 20:11:52 +0000901specify an arbitrary Python object for the ``value'' of the exception.
902You need not increment its reference count.
903\end{cfuncdesc}
904
Fred Drake73577702000-04-10 18:50:14 +0000905\begin{cfuncdesc}{PyObject*}{PyErr_Format}{PyObject *exception,
Moshe Zadka57a59322000-09-01 09:47:20 +0000906 const char *format, \moreargs}
Fred Drake89fb0352000-10-14 05:49:30 +0000907This function sets the error indicator. \var{exception} should be a
908Python exception (string or class, not an instance).
Fred Drake5566c1c2001-01-19 22:48:33 +0000909\var{format} should be a string, containing format codes, similar to
Moshe Zadka57a59322000-09-01 09:47:20 +0000910\cfunction{printf}. The \code{width.precision} before a format code
911is parsed, but the width part is ignored.
912
913\begin{tableii}{c|l}{character}{Character}{Meaning}
914 \lineii{c}{Character, as an \ctype{int} parameter}
915 \lineii{d}{Number in decimal, as an \ctype{int} parameter}
916 \lineii{x}{Number in hexadecimal, as an \ctype{int} parameter}
917 \lineii{x}{A string, as a \ctype{char *} parameter}
918\end{tableii}
919
920An unrecognized format character causes all the rest of
921the format string to be copied as-is to the result string,
922and any extra arguments discarded.
923
924A new reference is returned, which is owned by the caller.
Jeremy Hylton98605b52000-04-10 18:40:57 +0000925\end{cfuncdesc}
926
Guido van Rossumae110af1997-05-22 20:11:52 +0000927\begin{cfuncdesc}{void}{PyErr_SetNone}{PyObject *type}
Fred Drakee058b4f1998-02-16 06:15:35 +0000928This is a shorthand for \samp{PyErr_SetObject(\var{type}, Py_None)}.
Guido van Rossumae110af1997-05-22 20:11:52 +0000929\end{cfuncdesc}
930
931\begin{cfuncdesc}{int}{PyErr_BadArgument}{}
Fred Drakee058b4f1998-02-16 06:15:35 +0000932This is a shorthand for \samp{PyErr_SetString(PyExc_TypeError,
Guido van Rossumae110af1997-05-22 20:11:52 +0000933\var{message})}, where \var{message} indicates that a built-in operation
934was invoked with an illegal argument. It is mostly for internal use.
935\end{cfuncdesc}
936
Fred Drakec6fa34e1998-04-02 06:47:24 +0000937\begin{cfuncdesc}{PyObject*}{PyErr_NoMemory}{}
Fred Drakee058b4f1998-02-16 06:15:35 +0000938This is a shorthand for \samp{PyErr_SetNone(PyExc_MemoryError)}; it
Guido van Rossumae110af1997-05-22 20:11:52 +0000939returns \NULL{} so an object allocation function can write
Fred Drakee058b4f1998-02-16 06:15:35 +0000940\samp{return PyErr_NoMemory();} when it runs out of memory.
Guido van Rossumae110af1997-05-22 20:11:52 +0000941\end{cfuncdesc}
942
Fred Drakec6fa34e1998-04-02 06:47:24 +0000943\begin{cfuncdesc}{PyObject*}{PyErr_SetFromErrno}{PyObject *type}
Fred Drake659ebfa2000-04-03 15:42:13 +0000944This is a convenience function to raise an exception when a C library
945function has returned an error and set the C variable \cdata{errno}.
Guido van Rossumae110af1997-05-22 20:11:52 +0000946It constructs a tuple object whose first item is the integer
Fred Drakef8830d11998-04-23 14:06:01 +0000947\cdata{errno} value and whose second item is the corresponding error
Fred Drake659ebfa2000-04-03 15:42:13 +0000948message (gotten from \cfunction{strerror()}\ttindex{strerror()}), and
949then calls
Fred Drakee058b4f1998-02-16 06:15:35 +0000950\samp{PyErr_SetObject(\var{type}, \var{object})}. On \UNIX{}, when
Fred Drakef8830d11998-04-23 14:06:01 +0000951the \cdata{errno} value is \constant{EINTR}, indicating an interrupted
Fred Drakee058b4f1998-02-16 06:15:35 +0000952system call, this calls \cfunction{PyErr_CheckSignals()}, and if that set
Guido van Rossumae110af1997-05-22 20:11:52 +0000953the error indicator, leaves it set to that. The function always
954returns \NULL{}, so a wrapper function around a system call can write
Fred Drakee058b4f1998-02-16 06:15:35 +0000955\samp{return PyErr_SetFromErrno();} when the system call returns an
956error.
Guido van Rossumae110af1997-05-22 20:11:52 +0000957\end{cfuncdesc}
958
Fred Drake490d34d2001-06-20 21:39:12 +0000959\begin{cfuncdesc}{PyObject*}{PyErr_SetFromErrnoWithFilename}{PyObject *type,
960 char *filename}
961Similar to \cfunction{PyErr_SetFromErrno()}, with the additional
962behavior that if \var{filename} is not \NULL, it is passed to the
963constructor of \var{type} as a third parameter. In the case of
964exceptions such as \exception{IOError} and \exception{OSError}, this
965is used to define the \member{filename} attribute of the exception
966instance.
967\end{cfuncdesc}
968
Guido van Rossumae110af1997-05-22 20:11:52 +0000969\begin{cfuncdesc}{void}{PyErr_BadInternalCall}{}
Fred Drakee058b4f1998-02-16 06:15:35 +0000970This is a shorthand for \samp{PyErr_SetString(PyExc_TypeError,
Guido van Rossumae110af1997-05-22 20:11:52 +0000971\var{message})}, where \var{message} indicates that an internal
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000972operation (e.g. a Python/C API function) was invoked with an illegal
Guido van Rossumae110af1997-05-22 20:11:52 +0000973argument. It is mostly for internal use.
974\end{cfuncdesc}
975
Guido van Rossum3dbb4062000-12-19 03:53:01 +0000976\begin{cfuncdesc}{int}{PyErr_Warn}{PyObject *category, char *message}
977Issue a warning message. The \var{category} argument is a warning
Fred Drake5566c1c2001-01-19 22:48:33 +0000978category (see below) or \NULL; the \var{message} argument is a message
Guido van Rossum3dbb4062000-12-19 03:53:01 +0000979string.
980
981This function normally prints a warning message to \var{sys.stderr};
982however, it is also possible that the user has specified that warnings
983are to be turned into errors, and in that case this will raise an
984exception. It is also possible that the function raises an exception
985because of a problem with the warning machinery (the implementation
986imports the \module{warnings} module to do the heavy lifting). The
987return value is \code{0} if no exception is raised, or \code{-1} if
988an exception is raised. (It is not possible to determine whether a
989warning message is actually printed, nor what the reason is for the
990exception; this is intentional.) If an exception is raised, the
Fred Drake5566c1c2001-01-19 22:48:33 +0000991caller should do its normal exception handling
992(e.g. \cfunction{Py_DECREF()} owned references and return an error
993value).
Guido van Rossum3dbb4062000-12-19 03:53:01 +0000994
995Warning categories must be subclasses of \cdata{Warning}; the default
996warning category is \cdata{RuntimeWarning}. The standard Python
997warning categories are available as global variables whose names are
998\samp{PyExc_} followed by the Python exception name. These have the
999type \ctype{PyObject*}; they are all class objects. Their names are
1000\cdata{PyExc_Warning}, \cdata{PyExc_UserWarning},
1001\cdata{PyExc_DeprecationWarning}, \cdata{PyExc_SyntaxWarning}, and
1002\cdata{PyExc_RuntimeWarning}. \cdata{PyExc_Warning} is a subclass of
1003\cdata{PyExc_Exception}; the other warning categories are subclasses
1004of \cdata{PyExc_Warning}.
1005
1006For information about warning control, see the documentation for the
Fred Drake316ef7c2001-01-04 05:56:34 +00001007\module{warnings} module and the \programopt{-W} option in the command
1008line documentation. There is no C API for warning control.
Guido van Rossum3dbb4062000-12-19 03:53:01 +00001009\end{cfuncdesc}
1010
Guido van Rossum1874c8f2001-02-28 23:46:44 +00001011\begin{cfuncdesc}{int}{PyErr_WarnExplicit}{PyObject *category, char *message,
1012char *filename, int lineno, char *module, PyObject *registry}
1013Issue a warning message with explicit control over all warning
1014attributes. This is a straightforward wrapper around the Python
1015function \function{warnings.warn_explicit()}, see there for more
1016information. The \var{module} and \var{registry} arguments may be
1017set to \code{NULL} to get the default effect described there.
1018\end{cfuncdesc}
1019
Guido van Rossumae110af1997-05-22 20:11:52 +00001020\begin{cfuncdesc}{int}{PyErr_CheckSignals}{}
1021This function interacts with Python's signal handling. It checks
1022whether a signal has been sent to the processes and if so, invokes the
Fred Drake4de05a91998-02-16 14:25:26 +00001023corresponding signal handler. If the
1024\module{signal}\refbimodindex{signal} module is supported, this can
1025invoke a signal handler written in Python. In all cases, the default
Fred Drake659ebfa2000-04-03 15:42:13 +00001026effect for \constant{SIGINT}\ttindex{SIGINT} is to raise the
1027\withsubitem{(built-in exception)}{\ttindex{KeyboardInterrupt}}
1028\exception{KeyboardInterrupt} exception. If an exception is raised the
Fred Drakee058b4f1998-02-16 06:15:35 +00001029error indicator is set and the function returns \code{1}; otherwise
1030the function returns \code{0}. The error indicator may or may not be
1031cleared if it was previously set.
Guido van Rossumae110af1997-05-22 20:11:52 +00001032\end{cfuncdesc}
1033
1034\begin{cfuncdesc}{void}{PyErr_SetInterrupt}{}
Fred Drake659ebfa2000-04-03 15:42:13 +00001035This function is obsolete. It simulates the effect of a
1036\constant{SIGINT}\ttindex{SIGINT} signal arriving --- the next time
Fred Drakee058b4f1998-02-16 06:15:35 +00001037\cfunction{PyErr_CheckSignals()} is called,
Fred Drake659ebfa2000-04-03 15:42:13 +00001038\withsubitem{(built-in exception)}{\ttindex{KeyboardInterrupt}}
1039\exception{KeyboardInterrupt} will be raised.
1040It may be called without holding the interpreter lock.
Guido van Rossumae110af1997-05-22 20:11:52 +00001041\end{cfuncdesc}
1042
Fred Drakec6fa34e1998-04-02 06:47:24 +00001043\begin{cfuncdesc}{PyObject*}{PyErr_NewException}{char *name,
1044 PyObject *base,
1045 PyObject *dict}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001046This utility function creates and returns a new exception object. The
Fred Drake659ebfa2000-04-03 15:42:13 +00001047\var{name} argument must be the name of the new exception, a C string
1048of the form \code{module.class}. The \var{base} and
Fred Draked04038d2000-06-29 20:15:14 +00001049\var{dict} arguments are normally \NULL{}. This creates a
Fred Drake659ebfa2000-04-03 15:42:13 +00001050class object derived from the root for all exceptions, the built-in
1051name \exception{Exception} (accessible in C as
Fred Draked04038d2000-06-29 20:15:14 +00001052\cdata{PyExc_Exception}). The \member{__module__} attribute of the
1053new class is set to the first part (up to the last dot) of the
1054\var{name} argument, and the class name is set to the last part (after
1055the last dot). The \var{base} argument can be used to specify an
1056alternate base class. The \var{dict} argument can be used to specify
1057a dictionary of class variables and methods.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001058\end{cfuncdesc}
1059
Jeremy Hyltonb709df32000-09-01 02:47:25 +00001060\begin{cfuncdesc}{void}{PyErr_WriteUnraisable}{PyObject *obj}
1061This utility function prints a warning message to \var{sys.stderr}
1062when an exception has been set but it is impossible for the
1063interpreter to actually raise the exception. It is used, for example,
1064when an exception occurs in an \member{__del__} method.
1065
1066The function is called with a single argument \var{obj} that
1067identifies where the context in which the unraisable exception
1068occurred. The repr of \var{obj} will be printed in the warning
1069message.
1070\end{cfuncdesc}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001071
Fred Drakeefd146c1999-02-15 15:30:45 +00001072\section{Standard Exceptions \label{standardExceptions}}
Guido van Rossumae110af1997-05-22 20:11:52 +00001073
1074All standard Python exceptions are available as global variables whose
Fred Drake659ebfa2000-04-03 15:42:13 +00001075names are \samp{PyExc_} followed by the Python exception name. These
1076have the type \ctype{PyObject*}; they are all class objects. For
1077completeness, here are all the variables:
1078
1079\begin{tableiii}{l|l|c}{cdata}{C Name}{Python Name}{Notes}
1080 \lineiii{PyExc_Exception}{\exception{Exception}}{(1)}
1081 \lineiii{PyExc_StandardError}{\exception{StandardError}}{(1)}
1082 \lineiii{PyExc_ArithmeticError}{\exception{ArithmeticError}}{(1)}
1083 \lineiii{PyExc_LookupError}{\exception{LookupError}}{(1)}
1084 \lineiii{PyExc_AssertionError}{\exception{AssertionError}}{}
1085 \lineiii{PyExc_AttributeError}{\exception{AttributeError}}{}
1086 \lineiii{PyExc_EOFError}{\exception{EOFError}}{}
1087 \lineiii{PyExc_EnvironmentError}{\exception{EnvironmentError}}{(1)}
1088 \lineiii{PyExc_FloatingPointError}{\exception{FloatingPointError}}{}
1089 \lineiii{PyExc_IOError}{\exception{IOError}}{}
1090 \lineiii{PyExc_ImportError}{\exception{ImportError}}{}
1091 \lineiii{PyExc_IndexError}{\exception{IndexError}}{}
1092 \lineiii{PyExc_KeyError}{\exception{KeyError}}{}
1093 \lineiii{PyExc_KeyboardInterrupt}{\exception{KeyboardInterrupt}}{}
1094 \lineiii{PyExc_MemoryError}{\exception{MemoryError}}{}
1095 \lineiii{PyExc_NameError}{\exception{NameError}}{}
1096 \lineiii{PyExc_NotImplementedError}{\exception{NotImplementedError}}{}
1097 \lineiii{PyExc_OSError}{\exception{OSError}}{}
1098 \lineiii{PyExc_OverflowError}{\exception{OverflowError}}{}
1099 \lineiii{PyExc_RuntimeError}{\exception{RuntimeError}}{}
1100 \lineiii{PyExc_SyntaxError}{\exception{SyntaxError}}{}
1101 \lineiii{PyExc_SystemError}{\exception{SystemError}}{}
1102 \lineiii{PyExc_SystemExit}{\exception{SystemExit}}{}
1103 \lineiii{PyExc_TypeError}{\exception{TypeError}}{}
1104 \lineiii{PyExc_ValueError}{\exception{ValueError}}{}
Fred Drakea8d73412000-08-11 20:39:29 +00001105 \lineiii{PyExc_WindowsError}{\exception{WindowsError}}{(2)}
Fred Drake659ebfa2000-04-03 15:42:13 +00001106 \lineiii{PyExc_ZeroDivisionError}{\exception{ZeroDivisionError}}{}
1107\end{tableiii}
1108
1109\noindent
Fred Drakea8d73412000-08-11 20:39:29 +00001110Notes:
Fred Drake659ebfa2000-04-03 15:42:13 +00001111\begin{description}
1112\item[(1)]
Fred Draked04038d2000-06-29 20:15:14 +00001113 This is a base class for other standard exceptions.
Fred Drakea8d73412000-08-11 20:39:29 +00001114
1115\item[(2)]
1116 Only defined on Windows; protect code that uses this by testing that
1117 the preprocessor macro \code{MS_WINDOWS} is defined.
Fred Drake659ebfa2000-04-03 15:42:13 +00001118\end{description}
1119
1120
1121\section{Deprecation of String Exceptions}
1122
Fred Draked04038d2000-06-29 20:15:14 +00001123All exceptions built into Python or provided in the standard library
1124are derived from \exception{Exception}.
Fred Drake659ebfa2000-04-03 15:42:13 +00001125\withsubitem{(built-in exception)}{\ttindex{Exception}}
Fred Drake659ebfa2000-04-03 15:42:13 +00001126
Fred Draked04038d2000-06-29 20:15:14 +00001127String exceptions are still supported in the interpreter to allow
Fred Drake659ebfa2000-04-03 15:42:13 +00001128existing code to run unmodified, but this will also change in a future
1129release.
Guido van Rossumae110af1997-05-22 20:11:52 +00001130
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001131
Fred Drakeefd146c1999-02-15 15:30:45 +00001132\chapter{Utilities \label{utilities}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001133
Fred Drake88fdaa72001-07-20 20:56:11 +00001134The functions in this chapter perform various utility tasks, ranging
1135from helping C code be more portable across platforms, using Python
1136modules from C, and parsing function arguments and constructing Python
1137values from C values.
1138
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001139
Fred Drake377fb1e2001-07-14 03:01:48 +00001140\section{Operating System Utilities \label{os}}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001141
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001142\begin{cfuncdesc}{int}{Py_FdIsInteractive}{FILE *fp, char *filename}
Fred Drakee058b4f1998-02-16 06:15:35 +00001143Return true (nonzero) if the standard I/O file \var{fp} with name
1144\var{filename} is deemed interactive. This is the case for files for
1145which \samp{isatty(fileno(\var{fp}))} is true. If the global flag
Fred Drakef8830d11998-04-23 14:06:01 +00001146\cdata{Py_InteractiveFlag} is true, this function also returns true if
Fred Drake5566c1c2001-01-19 22:48:33 +00001147the \var{filename} pointer is \NULL{} or if the name is equal to one of
Fred Drakea8455ab2000-06-16 19:58:42 +00001148the strings \code{'<stdin>'} or \code{'???'}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001149\end{cfuncdesc}
1150
1151\begin{cfuncdesc}{long}{PyOS_GetLastModificationTime}{char *filename}
Fred Drakee058b4f1998-02-16 06:15:35 +00001152Return the time of last modification of the file \var{filename}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001153The result is encoded in the same way as the timestamp returned by
Fred Drake659ebfa2000-04-03 15:42:13 +00001154the standard C library function \cfunction{time()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001155\end{cfuncdesc}
1156
Fred Drakecabbc3b2000-06-28 15:53:13 +00001157\begin{cfuncdesc}{void}{PyOS_AfterFork}{}
1158Function to update some internal state after a process fork; this
1159should be called in the new process if the Python interpreter will
1160continue to be used. If a new executable is loaded into the new
1161process, this function does not need to be called.
1162\end{cfuncdesc}
1163
Fred Drake17e63432000-08-31 05:50:40 +00001164\begin{cfuncdesc}{int}{PyOS_CheckStack}{}
1165Return true when the interpreter runs out of stack space. This is a
1166reliable check, but is only available when \code{USE_STACKCHECK} is
1167defined (currently on Windows using the Microsoft Visual C++ compiler
1168and on the Macintosh). \code{USE_CHECKSTACK} will be defined
1169automatically; you should never change the definition in your own
1170code.
1171\end{cfuncdesc}
1172
Guido van Rossumc96ec6e2000-09-16 16:30:48 +00001173\begin{cfuncdesc}{PyOS_sighandler_t}{PyOS_getsig}{int i}
1174Return the current signal handler for signal \var{i}.
1175This is a thin wrapper around either \cfunction{sigaction} or
1176\cfunction{signal}. Do not call those functions directly!
1177\ctype{PyOS_sighandler_t} is a typedef alias for \ctype{void (*)(int)}.
1178\end{cfuncdesc}
1179
1180\begin{cfuncdesc}{PyOS_sighandler_t}{PyOS_setsig}{int i, PyOS_sighandler_t h}
1181Set the signal handler for signal \var{i} to be \var{h};
1182return the old signal handler.
1183This is a thin wrapper around either \cfunction{sigaction} or
1184\cfunction{signal}. Do not call those functions directly!
1185\ctype{PyOS_sighandler_t} is a typedef alias for \ctype{void (*)(int)}.
1186\end{cfuncdesc}
1187
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001188
Fred Drakeefd146c1999-02-15 15:30:45 +00001189\section{Process Control \label{processControl}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00001190
1191\begin{cfuncdesc}{void}{Py_FatalError}{char *message}
1192Print a fatal error message and kill the process. No cleanup is
1193performed. This function should only be invoked when a condition is
1194detected that would make it dangerous to continue using the Python
1195interpreter; e.g., when the object administration appears to be
Fred Drake659ebfa2000-04-03 15:42:13 +00001196corrupted. On \UNIX{}, the standard C library function
1197\cfunction{abort()}\ttindex{abort()} is called which will attempt to
1198produce a \file{core} file.
Fred Drakee5bf8b21998-02-12 21:22:28 +00001199\end{cfuncdesc}
1200
1201\begin{cfuncdesc}{void}{Py_Exit}{int status}
Fred Drake659ebfa2000-04-03 15:42:13 +00001202Exit the current process. This calls
1203\cfunction{Py_Finalize()}\ttindex{Py_Finalize()} and
1204then calls the standard C library function
1205\code{exit(\var{status})}\ttindex{exit()}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00001206\end{cfuncdesc}
1207
1208\begin{cfuncdesc}{int}{Py_AtExit}{void (*func) ()}
Fred Drake659ebfa2000-04-03 15:42:13 +00001209Register a cleanup function to be called by
1210\cfunction{Py_Finalize()}\ttindex{Py_Finalize()}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00001211The cleanup function will be called with no arguments and should
Fred Drake659ebfa2000-04-03 15:42:13 +00001212return no value. At most 32 \index{cleanup functions}cleanup
1213functions can be registered.
Fred Drakee5bf8b21998-02-12 21:22:28 +00001214When the registration is successful, \cfunction{Py_AtExit()} returns
1215\code{0}; on failure, it returns \code{-1}. The cleanup function
1216registered last is called first. Each cleanup function will be called
1217at most once. Since Python's internal finallization will have
1218completed before the cleanup function, no Python APIs should be called
1219by \var{func}.
1220\end{cfuncdesc}
1221
1222
Fred Drakeefd146c1999-02-15 15:30:45 +00001223\section{Importing Modules \label{importing}}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001224
Fred Drakec6fa34e1998-04-02 06:47:24 +00001225\begin{cfuncdesc}{PyObject*}{PyImport_ImportModule}{char *name}
Fred Drake659ebfa2000-04-03 15:42:13 +00001226This is a simplified interface to
1227\cfunction{PyImport_ImportModuleEx()} below, leaving the
1228\var{globals} and \var{locals} arguments set to \NULL{}. When the
Fred Drakebab29652001-07-10 16:10:08 +00001229\var{name} argument contains a dot (when it specifies a
Fred Drake659ebfa2000-04-03 15:42:13 +00001230submodule of a package), the \var{fromlist} argument is set to the
1231list \code{['*']} so that the return value is the named module rather
1232than the top-level package containing it as would otherwise be the
1233case. (Unfortunately, this has an additional side effect when
1234\var{name} in fact specifies a subpackage instead of a submodule: the
1235submodules specified in the package's \code{__all__} variable are
1236\index{package variable!\code{__all__}}
1237\withsubitem{(package variable)}{\ttindex{__all__}}loaded.) Return a
1238new reference to the imported module, or
1239\NULL{} with an exception set on failure (the module may still be
1240created in this case --- examine \code{sys.modules} to find out).
1241\withsubitem{(in module sys)}{\ttindex{modules}}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001242\end{cfuncdesc}
1243
Fred Drake01978582001-08-08 19:14:53 +00001244\begin{cfuncdesc}{PyObject*}{PyImport_ImportModuleEx}{char *name,
1245 PyObject *globals, PyObject *locals, PyObject *fromlist}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001246Import a module. This is best described by referring to the built-in
Fred Drake53fb7721998-02-16 06:23:20 +00001247Python function \function{__import__()}\bifuncindex{__import__}, as
1248the standard \function{__import__()} function calls this function
1249directly.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001250
Guido van Rossum42cefd01997-10-05 15:27:29 +00001251The return value is a new reference to the imported module or
Guido van Rossum580aa8d1997-11-25 15:34:51 +00001252top-level package, or \NULL{} with an exception set on failure
Guido van Rossumc44d3d61997-10-06 05:10:47 +00001253(the module may still be created in this case). Like for
Fred Drakee058b4f1998-02-16 06:15:35 +00001254\function{__import__()}, the return value when a submodule of a
1255package was requested is normally the top-level package, unless a
1256non-empty \var{fromlist} was given.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001257\end{cfuncdesc}
1258
Fred Drakec6fa34e1998-04-02 06:47:24 +00001259\begin{cfuncdesc}{PyObject*}{PyImport_Import}{PyObject *name}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001260This is a higher-level interface that calls the current ``import hook
Fred Drakee058b4f1998-02-16 06:15:35 +00001261function''. It invokes the \function{__import__()} function from the
Guido van Rossum42cefd01997-10-05 15:27:29 +00001262\code{__builtins__} of the current globals. This means that the
1263import is done using whatever import hooks are installed in the
Fred Drake4de05a91998-02-16 14:25:26 +00001264current environment, e.g. by \module{rexec}\refstmodindex{rexec} or
1265\module{ihooks}\refstmodindex{ihooks}.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001266\end{cfuncdesc}
1267
Fred Drakec6fa34e1998-04-02 06:47:24 +00001268\begin{cfuncdesc}{PyObject*}{PyImport_ReloadModule}{PyObject *m}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001269Reload a module. This is best described by referring to the built-in
Fred Drake53fb7721998-02-16 06:23:20 +00001270Python function \function{reload()}\bifuncindex{reload}, as the standard
Fred Drakee058b4f1998-02-16 06:15:35 +00001271\function{reload()} function calls this function directly. Return a
1272new reference to the reloaded module, or \NULL{} with an exception set
1273on failure (the module still exists in this case).
Guido van Rossum42cefd01997-10-05 15:27:29 +00001274\end{cfuncdesc}
1275
Fred Drakec6fa34e1998-04-02 06:47:24 +00001276\begin{cfuncdesc}{PyObject*}{PyImport_AddModule}{char *name}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001277Return the module object corresponding to a module name. The
1278\var{name} argument may be of the form \code{package.module}). First
1279check the modules dictionary if there's one there, and if not, create
Fred Drake659ebfa2000-04-03 15:42:13 +00001280a new one and insert in in the modules dictionary.
Guido van Rossuma096a2e1998-11-02 17:02:42 +00001281Warning: this function does not load or import the module; if the
1282module wasn't already loaded, you will get an empty module object.
1283Use \cfunction{PyImport_ImportModule()} or one of its variants to
1284import a module.
Fred Drake659ebfa2000-04-03 15:42:13 +00001285Return \NULL{} with an exception set on failure.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001286\end{cfuncdesc}
1287
Fred Drakec6fa34e1998-04-02 06:47:24 +00001288\begin{cfuncdesc}{PyObject*}{PyImport_ExecCodeModule}{char *name, PyObject *co}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001289Given a module name (possibly of the form \code{package.module}) and a
1290code object read from a Python bytecode file or obtained from the
Fred Drake53fb7721998-02-16 06:23:20 +00001291built-in function \function{compile()}\bifuncindex{compile}, load the
1292module. Return a new reference to the module object, or \NULL{} with
1293an exception set if an error occurred (the module may still be created
1294in this case). (This function would reload the module if it was
1295already imported.)
Guido van Rossum42cefd01997-10-05 15:27:29 +00001296\end{cfuncdesc}
1297
1298\begin{cfuncdesc}{long}{PyImport_GetMagicNumber}{}
Fred Drake659ebfa2000-04-03 15:42:13 +00001299Return the magic number for Python bytecode files (a.k.a.
1300\file{.pyc} and \file{.pyo} files). The magic number should be
1301present in the first four bytes of the bytecode file, in little-endian
1302byte order.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001303\end{cfuncdesc}
1304
Fred Drakec6fa34e1998-04-02 06:47:24 +00001305\begin{cfuncdesc}{PyObject*}{PyImport_GetModuleDict}{}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001306Return the dictionary used for the module administration
1307(a.k.a. \code{sys.modules}). Note that this is a per-interpreter
1308variable.
1309\end{cfuncdesc}
1310
1311\begin{cfuncdesc}{void}{_PyImport_Init}{}
1312Initialize the import mechanism. For internal use only.
1313\end{cfuncdesc}
1314
1315\begin{cfuncdesc}{void}{PyImport_Cleanup}{}
1316Empty the module table. For internal use only.
1317\end{cfuncdesc}
1318
1319\begin{cfuncdesc}{void}{_PyImport_Fini}{}
1320Finalize the import mechanism. For internal use only.
1321\end{cfuncdesc}
1322
Fred Drakec6fa34e1998-04-02 06:47:24 +00001323\begin{cfuncdesc}{PyObject*}{_PyImport_FindExtension}{char *, char *}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001324For internal use only.
Guido van Rossum5b8a5231997-12-30 04:38:44 +00001325\end{cfuncdesc}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001326
Fred Drakec6fa34e1998-04-02 06:47:24 +00001327\begin{cfuncdesc}{PyObject*}{_PyImport_FixupExtension}{char *, char *}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001328For internal use only.
Guido van Rossum5b8a5231997-12-30 04:38:44 +00001329\end{cfuncdesc}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001330
Fred Drake1d158692000-06-18 05:21:21 +00001331\begin{cfuncdesc}{int}{PyImport_ImportFrozenModule}{char *name}
1332Load a frozen module named \var{name}. Return \code{1} for success,
1333\code{0} if the module is not found, and \code{-1} with an exception
1334set if the initialization failed. To access the imported module on a
1335successful load, use \cfunction{PyImport_ImportModule()}.
Fred Drakee058b4f1998-02-16 06:15:35 +00001336(Note the misnomer --- this function would reload the module if it was
Guido van Rossum42cefd01997-10-05 15:27:29 +00001337already imported.)
1338\end{cfuncdesc}
1339
Fred Drake659ebfa2000-04-03 15:42:13 +00001340\begin{ctypedesc}[_frozen]{struct _frozen}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001341This is the structure type definition for frozen module descriptors,
Fred Drakec6fa34e1998-04-02 06:47:24 +00001342as generated by the \program{freeze}\index{freeze utility} utility
1343(see \file{Tools/freeze/} in the Python source distribution). Its
Fred Drakee0d9a832000-09-01 05:30:00 +00001344definition, found in \file{Include/import.h}, is:
Fred Drakec6fa34e1998-04-02 06:47:24 +00001345
Guido van Rossum9faf4c51997-10-07 14:38:54 +00001346\begin{verbatim}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001347struct _frozen {
Fred Drake36fbe761997-10-13 18:18:33 +00001348 char *name;
1349 unsigned char *code;
1350 int size;
Guido van Rossum42cefd01997-10-05 15:27:29 +00001351};
Guido van Rossum9faf4c51997-10-07 14:38:54 +00001352\end{verbatim}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001353\end{ctypedesc}
1354
Fred Drakec6fa34e1998-04-02 06:47:24 +00001355\begin{cvardesc}{struct _frozen*}{PyImport_FrozenModules}
Fred Drakef8830d11998-04-23 14:06:01 +00001356This pointer is initialized to point to an array of \ctype{struct
Fred Drake659ebfa2000-04-03 15:42:13 +00001357_frozen} records, terminated by one whose members are all
1358\NULL{} or zero. When a frozen module is imported, it is searched in
1359this table. Third-party code could play tricks with this to provide a
Guido van Rossum42cefd01997-10-05 15:27:29 +00001360dynamically created collection of frozen modules.
1361\end{cvardesc}
1362
Fred Drakee0d9a832000-09-01 05:30:00 +00001363\begin{cfuncdesc}{int}{PyImport_AppendInittab}{char *name,
1364 void (*initfunc)(void)}
1365Add a single module to the existing table of built-in modules. This
1366is a convenience wrapper around \cfunction{PyImport_ExtendInittab()},
1367returning \code{-1} if the table could not be extended. The new
1368module can be imported by the name \var{name}, and uses the function
1369\var{initfunc} as the initialization function called on the first
1370attempted import. This should be called before
1371\cfunction{Py_Initialize()}.
1372\end{cfuncdesc}
1373
1374\begin{ctypedesc}[_inittab]{struct _inittab}
1375Structure describing a single entry in the list of built-in modules.
1376Each of these structures gives the name and initialization function
1377for a module built into the interpreter. Programs which embed Python
1378may use an array of these structures in conjunction with
1379\cfunction{PyImport_ExtendInittab()} to provide additional built-in
1380modules. The structure is defined in \file{Include/import.h} as:
1381
1382\begin{verbatim}
1383struct _inittab {
1384 char *name;
1385 void (*initfunc)(void);
1386};
1387\end{verbatim}
1388\end{ctypedesc}
1389
1390\begin{cfuncdesc}{int}{PyImport_ExtendInittab}{struct _inittab *newtab}
1391Add a collection of modules to the table of built-in modules. The
1392\var{newtab} array must end with a sentinel entry which contains
1393\NULL{} for the \member{name} field; failure to provide the sentinel
1394value can result in a memory fault. Returns \code{0} on success or
1395\code{-1} if insufficient memory could be allocated to extend the
1396internal table. In the event of failure, no modules are added to the
1397internal table. This should be called before
1398\cfunction{Py_Initialize()}.
1399\end{cfuncdesc}
1400
Guido van Rossum42cefd01997-10-05 15:27:29 +00001401
Fred Drake88fdaa72001-07-20 20:56:11 +00001402\section{Parsing arguements and building values
1403 \label{arg-parsing}}
1404
1405These functions are useful when creating your own extensions functions
1406and methods. Additional information and examples are available in
1407\citetitle[../ext/ext.html]{Extending and Embedding the Python
1408Interpreter}.
1409
1410\begin{cfuncdesc}{int}{PyArg_ParseTuple}{PyObject *args, char *format,
1411 \moreargs}
1412 Parse the parameters of a function that takes only positional
1413 parameters into local variables. Returns true on success; on
1414 failure, it returns false and raises the appropriate exception. See
1415 \citetitle[../ext/parseTuple.html]{Extending and Embedding the
1416 Python Interpreter} for more information.
1417\end{cfuncdesc}
1418
1419\begin{cfuncdesc}{int}{PyArg_ParseTupleAndKeywords}{PyObject *args,
1420 PyObject *kw, char *format, char *keywords[],
1421 \moreargs}
1422 Parse the parameters of a function that takes both positional and
1423 keyword parameters into local variables. Returns true on success;
1424 on failure, it returns false and raises the appropriate exception.
1425 See \citetitle[../ext/parseTupleAndKeywords.html]{Extending and
1426 Embedding the Python Interpreter} for more information.
1427\end{cfuncdesc}
1428
1429\begin{cfuncdesc}{int}{PyArg_Parse}{PyObject *args, char *format,
1430 \moreargs}
1431 Function used to deconstruct the argument lists of ``old-style''
1432 functions --- these are functions which use the
1433 \constant{METH_OLDARGS} parameter parsing method. This is not
1434 recommended for use in parameter parsing in new code, and most code
1435 in the standard interpreter has been modified to no longer use this
1436 for that purpose. It does remain a convenient way to decompose
1437 other tuples, however, and may continue to be used for that
1438 purpose.
1439\end{cfuncdesc}
1440
1441\begin{cfuncdesc}{PyObject*}{Py_BuildValue}{char *format,
1442 \moreargs}
1443 Create a new value based on a format string similar to those
1444 accepted by the \cfunction{PyArg_Parse*()} family of functions and a
1445 sequence of values. Returns the value or \NULL{} in the case of an
1446 error; an exception will be raised if \NULL{} is returned. For more
1447 information on the format string and additional parameters, see
1448 \citetitle[../ext/buildValue.html]{Extending and Embedding the
1449 Python Interpreter}.
1450\end{cfuncdesc}
1451
1452
1453
Fred Drakeefd146c1999-02-15 15:30:45 +00001454\chapter{Abstract Objects Layer \label{abstract}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001455
1456The functions in this chapter interact with Python objects regardless
1457of their type, or with wide classes of object types (e.g. all
1458numerical types, or all sequence types). When used on object types
Fred Drake659ebfa2000-04-03 15:42:13 +00001459for which they do not apply, they will raise a Python exception.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001460
Fred Drakeefd146c1999-02-15 15:30:45 +00001461\section{Object Protocol \label{object}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001462
1463\begin{cfuncdesc}{int}{PyObject_Print}{PyObject *o, FILE *fp, int flags}
Fred Drake659ebfa2000-04-03 15:42:13 +00001464Print an object \var{o}, on file \var{fp}. Returns \code{-1} on error.
1465The flags argument is used to enable certain printing options. The
1466only option currently supported is \constant{Py_PRINT_RAW}; if given,
1467the \function{str()} of the object is written instead of the
1468\function{repr()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001469\end{cfuncdesc}
1470
1471\begin{cfuncdesc}{int}{PyObject_HasAttrString}{PyObject *o, char *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001472Returns \code{1} if \var{o} has the attribute \var{attr_name}, and
1473\code{0} otherwise. This is equivalent to the Python expression
1474\samp{hasattr(\var{o}, \var{attr_name})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001475This function always succeeds.
1476\end{cfuncdesc}
1477
Fred Drake659ebfa2000-04-03 15:42:13 +00001478\begin{cfuncdesc}{PyObject*}{PyObject_GetAttrString}{PyObject *o,
1479 char *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001480Retrieve an attribute named \var{attr_name} from object \var{o}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001481Returns the attribute value on success, or \NULL{} on failure.
Fred Drakee058b4f1998-02-16 06:15:35 +00001482This is the equivalent of the Python expression
1483\samp{\var{o}.\var{attr_name}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001484\end{cfuncdesc}
1485
1486
1487\begin{cfuncdesc}{int}{PyObject_HasAttr}{PyObject *o, PyObject *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001488Returns \code{1} if \var{o} has the attribute \var{attr_name}, and
1489\code{0} otherwise. This is equivalent to the Python expression
1490\samp{hasattr(\var{o}, \var{attr_name})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001491This function always succeeds.
1492\end{cfuncdesc}
1493
1494
Fred Drake659ebfa2000-04-03 15:42:13 +00001495\begin{cfuncdesc}{PyObject*}{PyObject_GetAttr}{PyObject *o,
1496 PyObject *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001497Retrieve an attribute named \var{attr_name} from object \var{o}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001498Returns the attribute value on success, or \NULL{} on failure.
Fred Drakee058b4f1998-02-16 06:15:35 +00001499This is the equivalent of the Python expression
1500\samp{\var{o}.\var{attr_name}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001501\end{cfuncdesc}
1502
1503
Fred Drake01978582001-08-08 19:14:53 +00001504\begin{cfuncdesc}{int}{PyObject_SetAttrString}{PyObject *o,
1505 char *attr_name, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00001506Set the value of the attribute named \var{attr_name}, for object
1507\var{o}, to the value \var{v}. Returns \code{-1} on failure. This is
1508the equivalent of the Python statement \samp{\var{o}.\var{attr_name} =
1509\var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001510\end{cfuncdesc}
1511
1512
Fred Drake01978582001-08-08 19:14:53 +00001513\begin{cfuncdesc}{int}{PyObject_SetAttr}{PyObject *o,
1514 PyObject *attr_name, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00001515Set the value of the attribute named \var{attr_name}, for
1516object \var{o},
1517to the value \var{v}. Returns \code{-1} on failure. This is
1518the equivalent of the Python statement \samp{\var{o}.\var{attr_name} =
1519\var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001520\end{cfuncdesc}
1521
1522
1523\begin{cfuncdesc}{int}{PyObject_DelAttrString}{PyObject *o, char *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001524Delete attribute named \var{attr_name}, for object \var{o}. Returns
1525\code{-1} on failure. This is the equivalent of the Python
1526statement: \samp{del \var{o}.\var{attr_name}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001527\end{cfuncdesc}
1528
1529
1530\begin{cfuncdesc}{int}{PyObject_DelAttr}{PyObject *o, PyObject *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001531Delete attribute named \var{attr_name}, for object \var{o}. Returns
1532\code{-1} on failure. This is the equivalent of the Python
1533statement \samp{del \var{o}.\var{attr_name}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001534\end{cfuncdesc}
1535
1536
1537\begin{cfuncdesc}{int}{PyObject_Cmp}{PyObject *o1, PyObject *o2, int *result}
Fred Drakee058b4f1998-02-16 06:15:35 +00001538Compare the values of \var{o1} and \var{o2} using a routine provided
1539by \var{o1}, if one exists, otherwise with a routine provided by
1540\var{o2}. The result of the comparison is returned in \var{result}.
1541Returns \code{-1} on failure. This is the equivalent of the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00001542statement\bifuncindex{cmp} \samp{\var{result} = cmp(\var{o1}, \var{o2})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001543\end{cfuncdesc}
1544
1545
1546\begin{cfuncdesc}{int}{PyObject_Compare}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001547Compare the values of \var{o1} and \var{o2} using a routine provided
1548by \var{o1}, if one exists, otherwise with a routine provided by
1549\var{o2}. Returns the result of the comparison on success. On error,
1550the value returned is undefined; use \cfunction{PyErr_Occurred()} to
Fred Drake659ebfa2000-04-03 15:42:13 +00001551detect an error. This is equivalent to the Python
1552expression\bifuncindex{cmp} \samp{cmp(\var{o1}, \var{o2})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001553\end{cfuncdesc}
1554
1555
1556\begin{cfuncdesc}{PyObject*}{PyObject_Repr}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00001557Compute a string representation of object \var{o}. Returns the
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001558string representation on success, \NULL{} on failure. This is
Fred Drakee058b4f1998-02-16 06:15:35 +00001559the equivalent of the Python expression \samp{repr(\var{o})}.
1560Called by the \function{repr()}\bifuncindex{repr} built-in function
1561and by reverse quotes.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001562\end{cfuncdesc}
1563
1564
1565\begin{cfuncdesc}{PyObject*}{PyObject_Str}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00001566Compute a string representation of object \var{o}. Returns the
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001567string representation on success, \NULL{} on failure. This is
Fred Drakee058b4f1998-02-16 06:15:35 +00001568the equivalent of the Python expression \samp{str(\var{o})}.
1569Called by the \function{str()}\bifuncindex{str} built-in function and
1570by the \keyword{print} statement.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001571\end{cfuncdesc}
1572
1573
Marc-André Lemburgad7c98e2001-01-17 17:09:53 +00001574\begin{cfuncdesc}{PyObject*}{PyObject_Unicode}{PyObject *o}
1575Compute a Unicode string representation of object \var{o}. Returns the
1576Unicode string representation on success, \NULL{} on failure. This is
1577the equivalent of the Python expression \samp{unistr(\var{o})}.
1578Called by the \function{unistr()}\bifuncindex{unistr} built-in function.
1579\end{cfuncdesc}
1580
Fred Drake58c8f9f2001-03-28 21:14:32 +00001581\begin{cfuncdesc}{int}{PyObject_IsInstance}{PyObject *inst, PyObject *cls}
1582Return \code{1} if \var{inst} is an instance of the class \var{cls} or
1583a subclass of \var{cls}. If \var{cls} is a type object rather than a
1584class object, \cfunction{PyObject_IsInstance()} returns \code{1} if
1585\var{inst} is of type \var{cls}. If \var{inst} is not a class
1586instance and \var{cls} is neither a type object or class object,
1587\var{inst} must have a \member{__class__} attribute --- the class
1588relationship of the value of that attribute with \var{cls} will be
1589used to determine the result of this function.
1590\versionadded{2.1}
1591\end{cfuncdesc}
1592
1593Subclass determination is done in a fairly straightforward way, but
1594includes a wrinkle that implementors of extensions to the class system
1595may want to be aware of. If \class{A} and \class{B} are class
1596objects, \class{B} is a subclass of \class{A} if it inherits from
1597\class{A} either directly or indirectly. If either is not a class
1598object, a more general mechanism is used to determine the class
1599relationship of the two objects. When testing if \var{B} is a
1600subclass of \var{A}, if \var{A} is \var{B},
1601\cfunction{PyObject_IsSubclass()} returns true. If \var{A} and
1602\var{B} are different objects, \var{B}'s \member{__bases__} attribute
1603is searched in a depth-first fashion for \var{A} --- the presence of
1604the \member{__bases__} attribute is considered sufficient for this
1605determination.
1606
1607\begin{cfuncdesc}{int}{PyObject_IsSubclass}{PyObject *derived,
1608 PyObject *cls}
1609Returns \code{1} if the class \var{derived} is identical to or derived
1610from the class \var{cls}, otherwise returns \code{0}. In case of an
1611error, returns \code{-1}. If either \var{derived} or \var{cls} is not
1612an actual class object, this function uses the generic algorithm
1613described above.
1614\versionadded{2.1}
1615\end{cfuncdesc}
1616
Marc-André Lemburgad7c98e2001-01-17 17:09:53 +00001617
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001618\begin{cfuncdesc}{int}{PyCallable_Check}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00001619Determine if the object \var{o} is callable. Return \code{1} if the
Fred Drakee058b4f1998-02-16 06:15:35 +00001620object is callable and \code{0} otherwise.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001621This function always succeeds.
1622\end{cfuncdesc}
1623
1624
Fred Drake659ebfa2000-04-03 15:42:13 +00001625\begin{cfuncdesc}{PyObject*}{PyObject_CallObject}{PyObject *callable_object,
1626 PyObject *args}
Fred Drakee058b4f1998-02-16 06:15:35 +00001627Call a callable Python object \var{callable_object}, with
1628arguments given by the tuple \var{args}. If no arguments are
Fred Drake659ebfa2000-04-03 15:42:13 +00001629needed, then \var{args} may be \NULL{}. Returns the result of the
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001630call on success, or \NULL{} on failure. This is the equivalent
Fred Drakef90490e2001-08-02 18:00:28 +00001631of the Python expression \samp{apply(\var{callable_object},
1632\var{args})} or \samp{\var{callable_object}(*\var{args})}.
Fred Drake659ebfa2000-04-03 15:42:13 +00001633\bifuncindex{apply}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001634\end{cfuncdesc}
1635
Fred Drake5566c1c2001-01-19 22:48:33 +00001636\begin{cfuncdesc}{PyObject*}{PyObject_CallFunction}{PyObject *callable_object,
1637 char *format, ...}
Fred Drakee058b4f1998-02-16 06:15:35 +00001638Call a callable Python object \var{callable_object}, with a
Fred Drake659ebfa2000-04-03 15:42:13 +00001639variable number of C arguments. The C arguments are described
Fred Drakee058b4f1998-02-16 06:15:35 +00001640using a \cfunction{Py_BuildValue()} style format string. The format may
1641be \NULL{}, indicating that no arguments are provided. Returns the
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001642result of the call on success, or \NULL{} on failure. This is
Fred Drakef90490e2001-08-02 18:00:28 +00001643the equivalent of the Python expression
1644\samp{apply(\var{callable_object}\var{args})} or
1645\samp{\var{callable_object}(*\var{args})}.
1646\bifuncindex{apply}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001647\end{cfuncdesc}
1648
1649
Fred Drake5566c1c2001-01-19 22:48:33 +00001650\begin{cfuncdesc}{PyObject*}{PyObject_CallMethod}{PyObject *o,
1651 char *method, char *format, ...}
Fred Drakee058b4f1998-02-16 06:15:35 +00001652Call the method named \var{m} of object \var{o} with a variable number
Fred Drake659ebfa2000-04-03 15:42:13 +00001653of C arguments. The C arguments are described by a
Fred Drakee058b4f1998-02-16 06:15:35 +00001654\cfunction{Py_BuildValue()} format string. The format may be \NULL{},
1655indicating that no arguments are provided. Returns the result of the
1656call on success, or \NULL{} on failure. This is the equivalent of the
1657Python expression \samp{\var{o}.\var{method}(\var{args})}.
Fred Drake659ebfa2000-04-03 15:42:13 +00001658Note that special method names, such as \method{__add__()},
1659\method{__getitem__()}, and so on are not supported. The specific
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001660abstract-object routines for these must be used.
1661\end{cfuncdesc}
1662
1663
1664\begin{cfuncdesc}{int}{PyObject_Hash}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001665Compute and return the hash value of an object \var{o}. On
1666failure, return \code{-1}. This is the equivalent of the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00001667expression \samp{hash(\var{o})}.\bifuncindex{hash}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001668\end{cfuncdesc}
1669
1670
1671\begin{cfuncdesc}{int}{PyObject_IsTrue}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001672Returns \code{1} if the object \var{o} is considered to be true, and
1673\code{0} otherwise. This is equivalent to the Python expression
1674\samp{not not \var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001675This function always succeeds.
1676\end{cfuncdesc}
1677
1678
1679\begin{cfuncdesc}{PyObject*}{PyObject_Type}{PyObject *o}
1680On success, returns a type object corresponding to the object
Fred Drakee058b4f1998-02-16 06:15:35 +00001681type of object \var{o}. On failure, returns \NULL{}. This is
1682equivalent to the Python expression \samp{type(\var{o})}.
Fred Drake53fb7721998-02-16 06:23:20 +00001683\bifuncindex{type}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001684\end{cfuncdesc}
1685
1686\begin{cfuncdesc}{int}{PyObject_Length}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001687Return the length of object \var{o}. If the object \var{o} provides
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001688both sequence and mapping protocols, the sequence length is
Fred Drake659ebfa2000-04-03 15:42:13 +00001689returned. On error, \code{-1} is returned. This is the equivalent
1690to the Python expression \samp{len(\var{o})}.\bifuncindex{len}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001691\end{cfuncdesc}
1692
1693
1694\begin{cfuncdesc}{PyObject*}{PyObject_GetItem}{PyObject *o, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00001695Return element of \var{o} corresponding to the object \var{key} or
1696\NULL{} on failure. This is the equivalent of the Python expression
1697\samp{\var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001698\end{cfuncdesc}
1699
1700
Fred Drake01978582001-08-08 19:14:53 +00001701\begin{cfuncdesc}{int}{PyObject_SetItem}{PyObject *o,
1702 PyObject *key, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00001703Map the object \var{key} to the value \var{v}.
1704Returns \code{-1} on failure. This is the equivalent
1705of the Python statement \samp{\var{o}[\var{key}] = \var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001706\end{cfuncdesc}
1707
1708
Guido van Rossumd1dbf631999-01-22 20:10:49 +00001709\begin{cfuncdesc}{int}{PyObject_DelItem}{PyObject *o, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00001710Delete the mapping for \var{key} from \var{o}. Returns \code{-1} on
1711failure. This is the equivalent of the Python statement \samp{del
1712\var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001713\end{cfuncdesc}
1714
Andrew M. Kuchling8c46b302000-07-13 23:58:16 +00001715\begin{cfuncdesc}{int}{PyObject_AsFileDescriptor}{PyObject *o}
1716Derives a file-descriptor from a Python object. If the object
1717is an integer or long integer, its value is returned. If not, the
1718object's \method{fileno()} method is called if it exists; the method
1719must return an integer or long integer, which is returned as the file
1720descriptor value. Returns \code{-1} on failure.
1721\end{cfuncdesc}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001722
Fred Drake01978582001-08-08 19:14:53 +00001723
Fred Drakeefd146c1999-02-15 15:30:45 +00001724\section{Number Protocol \label{number}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001725
1726\begin{cfuncdesc}{int}{PyNumber_Check}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001727Returns \code{1} if the object \var{o} provides numeric protocols, and
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001728false otherwise.
1729This function always succeeds.
1730\end{cfuncdesc}
1731
1732
1733\begin{cfuncdesc}{PyObject*}{PyNumber_Add}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001734Returns the result of adding \var{o1} and \var{o2}, or \NULL{} on
1735failure. This is the equivalent of the Python expression
1736\samp{\var{o1} + \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001737\end{cfuncdesc}
1738
1739
1740\begin{cfuncdesc}{PyObject*}{PyNumber_Subtract}{PyObject *o1, PyObject *o2}
Fred Drake659ebfa2000-04-03 15:42:13 +00001741Returns the result of subtracting \var{o2} from \var{o1}, or
1742\NULL{} on failure. This is the equivalent of the Python expression
Fred Drakee058b4f1998-02-16 06:15:35 +00001743\samp{\var{o1} - \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001744\end{cfuncdesc}
1745
1746
1747\begin{cfuncdesc}{PyObject*}{PyNumber_Multiply}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001748Returns the result of multiplying \var{o1} and \var{o2}, or \NULL{} on
1749failure. This is the equivalent of the Python expression
1750\samp{\var{o1} * \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001751\end{cfuncdesc}
1752
1753
1754\begin{cfuncdesc}{PyObject*}{PyNumber_Divide}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001755Returns the result of dividing \var{o1} by \var{o2}, or \NULL{} on
1756failure.
1757This is the equivalent of the Python expression \samp{\var{o1} /
1758\var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001759\end{cfuncdesc}
1760
1761
Fred Drake01978582001-08-08 19:14:53 +00001762\begin{cfuncdesc}{PyObject*}{PyNumber_FloorDivide}{PyObject *o1, PyObject *o2}
1763Return the floor of \var{o1} divided by \var{o2}, or \NULL{} on
1764failure. This is equivalent to the ``classic'' division of integers.
1765\versionadded{2.2}
1766\end{cfuncdesc}
1767
1768
1769\begin{cfuncdesc}{PyObject*}{PyNumber_TrueDivide}{PyObject *o1, PyObject *o2}
1770Return a reasonable approximation for the mathematical value of
1771\var{o1} divided by \var{o2}, or \NULL{} on failure. The return value
1772is ``approximate'' because binary floating point numbers are
1773approximate; it is not possible to represent all real numbers in base
1774two. This function can return a floating point value when passed two
1775integers.
1776\versionadded{2.2}
1777\end{cfuncdesc}
1778
1779
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001780\begin{cfuncdesc}{PyObject*}{PyNumber_Remainder}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001781Returns the remainder of dividing \var{o1} by \var{o2}, or \NULL{} on
1782failure. This is the equivalent of the Python expression
Fred Drake659ebfa2000-04-03 15:42:13 +00001783\samp{\var{o1} \%\ \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001784\end{cfuncdesc}
1785
1786
1787\begin{cfuncdesc}{PyObject*}{PyNumber_Divmod}{PyObject *o1, PyObject *o2}
Fred Drake53fb7721998-02-16 06:23:20 +00001788See the built-in function \function{divmod()}\bifuncindex{divmod}.
1789Returns \NULL{} on failure. This is the equivalent of the Python
1790expression \samp{divmod(\var{o1}, \var{o2})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001791\end{cfuncdesc}
1792
1793
Fred Drake01978582001-08-08 19:14:53 +00001794\begin{cfuncdesc}{PyObject*}{PyNumber_Power}{PyObject *o1,
1795 PyObject *o2, PyObject *o3}
Fred Drake53fb7721998-02-16 06:23:20 +00001796See the built-in function \function{pow()}\bifuncindex{pow}. Returns
1797\NULL{} on failure. This is the equivalent of the Python expression
Fred Drakee058b4f1998-02-16 06:15:35 +00001798\samp{pow(\var{o1}, \var{o2}, \var{o3})}, where \var{o3} is optional.
Fred Drake659ebfa2000-04-03 15:42:13 +00001799If \var{o3} is to be ignored, pass \cdata{Py_None} in its place
1800(passing \NULL{} for \var{o3} would cause an illegal memory access).
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001801\end{cfuncdesc}
1802
1803
1804\begin{cfuncdesc}{PyObject*}{PyNumber_Negative}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001805Returns the negation of \var{o} on success, or \NULL{} on failure.
1806This is the equivalent of the Python expression \samp{-\var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001807\end{cfuncdesc}
1808
1809
1810\begin{cfuncdesc}{PyObject*}{PyNumber_Positive}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001811Returns \var{o} on success, or \NULL{} on failure.
1812This is the equivalent of the Python expression \samp{+\var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001813\end{cfuncdesc}
1814
1815
1816\begin{cfuncdesc}{PyObject*}{PyNumber_Absolute}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001817Returns the absolute value of \var{o}, or \NULL{} on failure. This is
1818the equivalent of the Python expression \samp{abs(\var{o})}.
Fred Drake659ebfa2000-04-03 15:42:13 +00001819\bifuncindex{abs}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001820\end{cfuncdesc}
1821
1822
1823\begin{cfuncdesc}{PyObject*}{PyNumber_Invert}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001824Returns the bitwise negation of \var{o} on success, or \NULL{} on
1825failure. This is the equivalent of the Python expression
1826\samp{\~\var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001827\end{cfuncdesc}
1828
1829
1830\begin{cfuncdesc}{PyObject*}{PyNumber_Lshift}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001831Returns the result of left shifting \var{o1} by \var{o2} on success,
1832or \NULL{} on failure. This is the equivalent of the Python
Fred Draked20d8b32001-04-13 14:52:39 +00001833expression \samp{\var{o1} <\code{<} \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001834\end{cfuncdesc}
1835
1836
1837\begin{cfuncdesc}{PyObject*}{PyNumber_Rshift}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001838Returns the result of right shifting \var{o1} by \var{o2} on success,
1839or \NULL{} on failure. This is the equivalent of the Python
Fred Draked20d8b32001-04-13 14:52:39 +00001840expression \samp{\var{o1} >\code{>} \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001841\end{cfuncdesc}
1842
1843
1844\begin{cfuncdesc}{PyObject*}{PyNumber_And}{PyObject *o1, PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00001845Returns the ``bitwise and'' of \var{o2} and \var{o2} on success and
1846\NULL{} on failure. This is the equivalent of the Python expression
Fred Drake5566c1c2001-01-19 22:48:33 +00001847\samp{\var{o1} \&\ \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001848\end{cfuncdesc}
1849
1850
1851\begin{cfuncdesc}{PyObject*}{PyNumber_Xor}{PyObject *o1, PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00001852Returns the ``bitwise exclusive or'' of \var{o1} by \var{o2} on success,
Fred Drakee058b4f1998-02-16 06:15:35 +00001853or \NULL{} on failure. This is the equivalent of the Python
Fred Drake755c23d2001-07-14 03:05:53 +00001854expression \samp{\var{o1} \textasciicircum{} \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001855\end{cfuncdesc}
1856
1857\begin{cfuncdesc}{PyObject*}{PyNumber_Or}{PyObject *o1, PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00001858Returns the ``bitwise or'' of \var{o1} and \var{o2} on success, or
1859\NULL{} on failure. This is the equivalent of the Python expression
1860\samp{\var{o1} | \var{o2}}.
1861\end{cfuncdesc}
1862
1863
1864\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceAdd}{PyObject *o1, PyObject *o2}
Fred Drake01978582001-08-08 19:14:53 +00001865Returns the result of adding \var{o1} and \var{o2}, or \NULL{} on
1866failure. The operation is done \emph{in-place} when \var{o1} supports
1867it. This is the equivalent of the Python statement \samp{\var{o1} +=
1868\var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001869\end{cfuncdesc}
1870
1871
Fred Drake01978582001-08-08 19:14:53 +00001872\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceSubtract}{PyObject *o1,
1873 PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00001874Returns the result of subtracting \var{o2} from \var{o1}, or
Fred Drake01978582001-08-08 19:14:53 +00001875\NULL{} on failure. The operation is done \emph{in-place} when
1876\var{o1} supports it. This is the equivalent of the Python statement
1877\samp{\var{o1} -= \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001878\end{cfuncdesc}
1879
1880
Fred Drake01978582001-08-08 19:14:53 +00001881\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceMultiply}{PyObject *o1,
1882 PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00001883Returns the result of multiplying \var{o1} and \var{o2}, or \NULL{} on
1884failure. The operation is done \emph{in-place} when \var{o1} supports it.
Fred Drake01978582001-08-08 19:14:53 +00001885This is the equivalent of the Python statement \samp{\var{o1} *= \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001886\end{cfuncdesc}
1887
1888
Fred Drake01978582001-08-08 19:14:53 +00001889\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceDivide}{PyObject *o1,
1890 PyObject *o2}
1891Returns the result of dividing \var{o1} by \var{o2}, or \NULL{} on
1892failure. The operation is done \emph{in-place} when \var{o1} supports
1893it. This is the equivalent of the Python statement \samp{\var{o1} /=
1894\var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001895\end{cfuncdesc}
1896
1897
Fred Drake01978582001-08-08 19:14:53 +00001898\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceFloorDivide}{PyObject *o1,
1899 PyObject *o2}
1900Returns the mathematical of dividing \var{o1} by \var{o2}, or \NULL{}
1901on failure. The operation is done \emph{in-place} when \var{o1}
1902supports it. This is the equivalent of the Python statement
1903\samp{\var{o1} //= \var{o2}}.
1904\versionadded{2.2}
1905\end{cfuncdesc}
1906
1907
1908\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceTrueDivide}{PyObject *o1,
1909 PyObject *o2}
1910Return a reasonable approximation for the mathematical value of
1911\var{o1} divided by \var{o2}, or \NULL{} on failure. The return value
1912is ``approximate'' because binary floating point numbers are
1913approximate; it is not possible to represent all real numbers in base
1914two. This function can return a floating point value when passed two
1915integers. The operation is done \emph{in-place} when \var{o1}
1916supports it.
1917\versionadded{2.2}
1918\end{cfuncdesc}
1919
1920
1921\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceRemainder}{PyObject *o1,
1922 PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00001923Returns the remainder of dividing \var{o1} by \var{o2}, or \NULL{} on
1924failure. The operation is done \emph{in-place} when \var{o1} supports it.
Fred Drake01978582001-08-08 19:14:53 +00001925This is the equivalent of the Python statement \samp{\var{o1} \%= \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001926\end{cfuncdesc}
1927
1928
Fred Drake01978582001-08-08 19:14:53 +00001929\begin{cfuncdesc}{PyObject*}{PyNumber_InPlacePower}{PyObject *o1,
1930 PyObject *o2, PyObject *o3}
1931See the built-in function \function{pow()}.\bifuncindex{pow} Returns
1932\NULL{} on failure. The operation is done \emph{in-place} when
1933\var{o1} supports it. This is the equivalent of the Python statement
1934\samp{\var{o1} **= \var{o2}} when o3 is \cdata{Py_None}, or an
1935in-place variant of \samp{pow(\var{o1}, \var{o2}, \var{o3})}
1936otherwise. If \var{o3} is to be ignored, pass \cdata{Py_None} in its
1937place (passing \NULL{} for \var{o3} would cause an illegal memory
1938access).
Fred Drake7740a012000-09-12 20:27:05 +00001939\end{cfuncdesc}
1940
Fred Drake01978582001-08-08 19:14:53 +00001941\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceLshift}{PyObject *o1,
1942 PyObject *o2}
1943Returns the result of left shifting \var{o1} by \var{o2} on success,
1944or \NULL{} on failure. The operation is done \emph{in-place} when
1945\var{o1} supports it. This is the equivalent of the Python statement
1946\samp{\var{o1} <\code{<=} \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001947\end{cfuncdesc}
1948
1949
Fred Drake01978582001-08-08 19:14:53 +00001950\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceRshift}{PyObject *o1,
1951 PyObject *o2}
1952Returns the result of right shifting \var{o1} by \var{o2} on success,
1953or \NULL{} on failure. The operation is done \emph{in-place} when
1954\var{o1} supports it. This is the equivalent of the Python statement
1955\samp{\var{o1} >\code{>=} \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001956\end{cfuncdesc}
1957
1958
1959\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceAnd}{PyObject *o1, PyObject *o2}
Fred Drake5566c1c2001-01-19 22:48:33 +00001960Returns the ``bitwise and'' of \var{o1} and \var{o2} on success
1961and \NULL{} on failure. The operation is done \emph{in-place} when
Fred Drake01978582001-08-08 19:14:53 +00001962\var{o1} supports it. This is the equivalent of the Python statement
Fred Drake5566c1c2001-01-19 22:48:33 +00001963\samp{\var{o1} \&= \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001964\end{cfuncdesc}
1965
1966
1967\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceXor}{PyObject *o1, PyObject *o2}
Fred Drake01978582001-08-08 19:14:53 +00001968Returns the ``bitwise exclusive or'' of \var{o1} by \var{o2} on
1969success, or \NULL{} on failure. The operation is done \emph{in-place}
1970when \var{o1} supports it. This is the equivalent of the Python
1971statement \samp{\var{o1} \textasciicircum= \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001972\end{cfuncdesc}
1973
1974\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceOr}{PyObject *o1, PyObject *o2}
Fred Drake01978582001-08-08 19:14:53 +00001975Returns the ``bitwise or'' of \var{o1} and \var{o2} on success, or
1976\NULL{} on failure. The operation is done \emph{in-place} when
1977\var{o1} supports it. This is the equivalent of the Python statement
1978\samp{\var{o1} |= \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001979\end{cfuncdesc}
1980
Fred Drakec0e6c5b2000-09-22 18:17:49 +00001981\begin{cfuncdesc}{int}{PyNumber_Coerce}{PyObject **p1, PyObject **p2}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001982This function takes the addresses of two variables of type
Fred Drake659ebfa2000-04-03 15:42:13 +00001983\ctype{PyObject*}. If the objects pointed to by \code{*\var{p1}} and
1984\code{*\var{p2}} have the same type, increment their reference count
1985and return \code{0} (success). If the objects can be converted to a
1986common numeric type, replace \code{*p1} and \code{*p2} by their
1987converted value (with 'new' reference counts), and return \code{0}.
1988If no conversion is possible, or if some other error occurs, return
1989\code{-1} (failure) and don't increment the reference counts. The
1990call \code{PyNumber_Coerce(\&o1, \&o2)} is equivalent to the Python
1991statement \samp{\var{o1}, \var{o2} = coerce(\var{o1}, \var{o2})}.
1992\bifuncindex{coerce}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001993\end{cfuncdesc}
1994
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001995\begin{cfuncdesc}{PyObject*}{PyNumber_Int}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001996Returns the \var{o} converted to an integer object on success, or
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001997\NULL{} on failure. This is the equivalent of the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00001998expression \samp{int(\var{o})}.\bifuncindex{int}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001999\end{cfuncdesc}
2000
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002001\begin{cfuncdesc}{PyObject*}{PyNumber_Long}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00002002Returns the \var{o} converted to a long integer object on success,
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002003or \NULL{} on failure. This is the equivalent of the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00002004expression \samp{long(\var{o})}.\bifuncindex{long}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002005\end{cfuncdesc}
2006
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002007\begin{cfuncdesc}{PyObject*}{PyNumber_Float}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00002008Returns the \var{o} converted to a float object on success, or
2009\NULL{} on failure. This is the equivalent of the Python expression
2010\samp{float(\var{o})}.\bifuncindex{float}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002011\end{cfuncdesc}
2012
2013
Fred Drakeefd146c1999-02-15 15:30:45 +00002014\section{Sequence Protocol \label{sequence}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002015
2016\begin{cfuncdesc}{int}{PySequence_Check}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00002017Return \code{1} if the object provides sequence protocol, and
2018\code{0} otherwise. This function always succeeds.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002019\end{cfuncdesc}
2020
Fred Drakec6a3cb42001-04-04 01:25:17 +00002021\begin{cfuncdesc}{int}{PySequence_Size}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00002022Returns the number of objects in sequence \var{o} on success, and
2023\code{-1} on failure. For objects that do not provide sequence
2024protocol, this is equivalent to the Python expression
2025\samp{len(\var{o})}.\bifuncindex{len}
2026\end{cfuncdesc}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002027
Fred Drakec6a3cb42001-04-04 01:25:17 +00002028\begin{cfuncdesc}{int}{PySequence_Length}{PyObject *o}
2029Alternate name for \cfunction{PySequence_Size()}.
2030\end{cfuncdesc}
2031
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002032\begin{cfuncdesc}{PyObject*}{PySequence_Concat}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00002033Return the concatenation of \var{o1} and \var{o2} on success, and \NULL{} on
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002034failure. This is the equivalent of the Python
Fred Drakee058b4f1998-02-16 06:15:35 +00002035expression \samp{\var{o1} + \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002036\end{cfuncdesc}
2037
2038
2039\begin{cfuncdesc}{PyObject*}{PySequence_Repeat}{PyObject *o, int count}
Fred Drake659ebfa2000-04-03 15:42:13 +00002040Return the result of repeating sequence object
2041\var{o} \var{count} times, or \NULL{} on failure. This is the
2042equivalent of the Python expression \samp{\var{o} * \var{count}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002043\end{cfuncdesc}
2044
Fred Drake01978582001-08-08 19:14:53 +00002045\begin{cfuncdesc}{PyObject*}{PySequence_InPlaceConcat}{PyObject *o1,
2046 PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00002047Return the concatenation of \var{o1} and \var{o2} on success, and \NULL{} on
2048failure. The operation is done \emph{in-place} when \var{o1} supports it.
2049This is the equivalent of the Python expression \samp{\var{o1} += \var{o2}}.
2050\end{cfuncdesc}
2051
2052
2053\begin{cfuncdesc}{PyObject*}{PySequence_InPlaceRepeat}{PyObject *o, int count}
2054Return the result of repeating sequence object \var{o} \var{count} times, or
2055\NULL{} on failure. The operation is done \emph{in-place} when \var{o}
2056supports it. This is the equivalent of the Python expression \samp{\var{o}
2057*= \var{count}}.
2058\end{cfuncdesc}
2059
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002060
2061\begin{cfuncdesc}{PyObject*}{PySequence_GetItem}{PyObject *o, int i}
Fred Drakee058b4f1998-02-16 06:15:35 +00002062Return the \var{i}th element of \var{o}, or \NULL{} on failure. This
2063is the equivalent of the Python expression \samp{\var{o}[\var{i}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002064\end{cfuncdesc}
2065
2066
2067\begin{cfuncdesc}{PyObject*}{PySequence_GetSlice}{PyObject *o, int i1, int i2}
Fred Drakee058b4f1998-02-16 06:15:35 +00002068Return the slice of sequence object \var{o} between \var{i1} and
2069\var{i2}, or \NULL{} on failure. This is the equivalent of the Python
2070expression \samp{\var{o}[\var{i1}:\var{i2}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002071\end{cfuncdesc}
2072
2073
2074\begin{cfuncdesc}{int}{PySequence_SetItem}{PyObject *o, int i, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00002075Assign object \var{v} to the \var{i}th element of \var{o}.
2076Returns \code{-1} on failure. This is the equivalent of the Python
2077statement \samp{\var{o}[\var{i}] = \var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002078\end{cfuncdesc}
2079
2080\begin{cfuncdesc}{int}{PySequence_DelItem}{PyObject *o, int i}
Fred Drake5566c1c2001-01-19 22:48:33 +00002081Delete the \var{i}th element of object \var{o}. Returns
Fred Drakee058b4f1998-02-16 06:15:35 +00002082\code{-1} on failure. This is the equivalent of the Python
2083statement \samp{del \var{o}[\var{i}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002084\end{cfuncdesc}
2085
Fred Drake659ebfa2000-04-03 15:42:13 +00002086\begin{cfuncdesc}{int}{PySequence_SetSlice}{PyObject *o, int i1,
2087 int i2, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00002088Assign the sequence object \var{v} to the slice in sequence
2089object \var{o} from \var{i1} to \var{i2}. This is the equivalent of
2090the Python statement \samp{\var{o}[\var{i1}:\var{i2}] = \var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002091\end{cfuncdesc}
2092
2093\begin{cfuncdesc}{int}{PySequence_DelSlice}{PyObject *o, int i1, int i2}
Fred Drakee058b4f1998-02-16 06:15:35 +00002094Delete the slice in sequence object \var{o} from \var{i1} to \var{i2}.
2095Returns \code{-1} on failure. This is the equivalent of the Python
2096statement \samp{del \var{o}[\var{i1}:\var{i2}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002097\end{cfuncdesc}
2098
2099\begin{cfuncdesc}{PyObject*}{PySequence_Tuple}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00002100Returns the \var{o} as a tuple on success, and \NULL{} on failure.
Fred Drake659ebfa2000-04-03 15:42:13 +00002101This is equivalent to the Python expression \samp{tuple(\var{o})}.
2102\bifuncindex{tuple}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002103\end{cfuncdesc}
2104
2105\begin{cfuncdesc}{int}{PySequence_Count}{PyObject *o, PyObject *value}
Fred Drakee058b4f1998-02-16 06:15:35 +00002106Return the number of occurrences of \var{value} in \var{o}, that is,
2107return the number of keys for which \code{\var{o}[\var{key}] ==
2108\var{value}}. On failure, return \code{-1}. This is equivalent to
2109the Python expression \samp{\var{o}.count(\var{value})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002110\end{cfuncdesc}
2111
Fred Drake659ebfa2000-04-03 15:42:13 +00002112\begin{cfuncdesc}{int}{PySequence_Contains}{PyObject *o, PyObject *value}
Fred Drakee058b4f1998-02-16 06:15:35 +00002113Determine if \var{o} contains \var{value}. If an item in \var{o} is
2114equal to \var{value}, return \code{1}, otherwise return \code{0}. On
2115error, return \code{-1}. This is equivalent to the Python expression
2116\samp{\var{value} in \var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002117\end{cfuncdesc}
2118
2119\begin{cfuncdesc}{int}{PySequence_Index}{PyObject *o, PyObject *value}
Fred Drakee058b4f1998-02-16 06:15:35 +00002120Return the first index \var{i} for which \code{\var{o}[\var{i}] ==
2121\var{value}}. On error, return \code{-1}. This is equivalent to
2122the Python expression \samp{\var{o}.index(\var{value})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002123\end{cfuncdesc}
2124
Fred Drakea8455ab2000-06-16 19:58:42 +00002125\begin{cfuncdesc}{PyObject*}{PySequence_List}{PyObject *o}
2126Return a list object with the same contents as the arbitrary sequence
2127\var{o}. The returned list is guaranteed to be new.
2128\end{cfuncdesc}
2129
2130\begin{cfuncdesc}{PyObject*}{PySequence_Tuple}{PyObject *o}
2131Return a tuple object with the same contents as the arbitrary sequence
2132\var{o}. If \var{o} is a tuple, a new reference will be returned,
2133otherwise a tuple will be constructed with the appropriate contents.
2134\end{cfuncdesc}
2135
Fred Drakef39ed671998-02-26 22:01:23 +00002136
Fred Drake81cccb72000-09-12 15:22:05 +00002137\begin{cfuncdesc}{PyObject*}{PySequence_Fast}{PyObject *o, const char *m}
2138Returns the sequence \var{o} as a tuple, unless it is already a
2139tuple or list, in which case \var{o} is returned. Use
2140\cfunction{PySequence_Fast_GET_ITEM()} to access the members of the
2141result. Returns \NULL{} on failure. If the object is not a sequence,
2142raises \exception{TypeError} with \var{m} as the message text.
2143\end{cfuncdesc}
2144
2145\begin{cfuncdesc}{PyObject*}{PySequence_Fast_GET_ITEM}{PyObject *o, int i}
2146Return the \var{i}th element of \var{o}, assuming that \var{o} was
2147returned by \cfunction{PySequence_Fast()}, and that \var{i} is within
2148bounds. The caller is expected to get the length of the sequence by
Fred Drake96a2a802001-05-29 18:51:41 +00002149calling \cfunction{PySequence_Size()} on \var{o}, since lists and tuples
Fred Drake81cccb72000-09-12 15:22:05 +00002150are guaranteed to always return their true length.
2151\end{cfuncdesc}
2152
2153
Fred Drakeefd146c1999-02-15 15:30:45 +00002154\section{Mapping Protocol \label{mapping}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002155
2156\begin{cfuncdesc}{int}{PyMapping_Check}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00002157Return \code{1} if the object provides mapping protocol, and
2158\code{0} otherwise. This function always succeeds.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002159\end{cfuncdesc}
2160
2161
2162\begin{cfuncdesc}{int}{PyMapping_Length}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00002163Returns the number of keys in object \var{o} on success, and
2164\code{-1} on failure. For objects that do not provide mapping
2165protocol, this is equivalent to the Python expression
2166\samp{len(\var{o})}.\bifuncindex{len}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002167\end{cfuncdesc}
2168
2169
2170\begin{cfuncdesc}{int}{PyMapping_DelItemString}{PyObject *o, char *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00002171Remove the mapping for object \var{key} from the object \var{o}.
2172Return \code{-1} on failure. This is equivalent to
2173the Python statement \samp{del \var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002174\end{cfuncdesc}
2175
2176
2177\begin{cfuncdesc}{int}{PyMapping_DelItem}{PyObject *o, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00002178Remove the mapping for object \var{key} from the object \var{o}.
2179Return \code{-1} on failure. This is equivalent to
2180the Python statement \samp{del \var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002181\end{cfuncdesc}
2182
2183
2184\begin{cfuncdesc}{int}{PyMapping_HasKeyString}{PyObject *o, char *key}
Fred Drake659ebfa2000-04-03 15:42:13 +00002185On success, return \code{1} if the mapping object has the key
2186\var{key} and \code{0} otherwise. This is equivalent to the Python
2187expression \samp{\var{o}.has_key(\var{key})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002188This function always succeeds.
2189\end{cfuncdesc}
2190
2191
2192\begin{cfuncdesc}{int}{PyMapping_HasKey}{PyObject *o, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00002193Return \code{1} if the mapping object has the key \var{key} and
2194\code{0} otherwise. This is equivalent to the Python expression
2195\samp{\var{o}.has_key(\var{key})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002196This function always succeeds.
2197\end{cfuncdesc}
2198
2199
2200\begin{cfuncdesc}{PyObject*}{PyMapping_Keys}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00002201On success, return a list of the keys in object \var{o}. On
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002202failure, return \NULL{}. This is equivalent to the Python
Fred Drakee058b4f1998-02-16 06:15:35 +00002203expression \samp{\var{o}.keys()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002204\end{cfuncdesc}
2205
2206
2207\begin{cfuncdesc}{PyObject*}{PyMapping_Values}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00002208On success, return a list of the values in object \var{o}. On
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002209failure, return \NULL{}. This is equivalent to the Python
Fred Drakee058b4f1998-02-16 06:15:35 +00002210expression \samp{\var{o}.values()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002211\end{cfuncdesc}
2212
2213
2214\begin{cfuncdesc}{PyObject*}{PyMapping_Items}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00002215On success, return a list of the items in object \var{o}, where
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002216each item is a tuple containing a key-value pair. On
2217failure, return \NULL{}. This is equivalent to the Python
Fred Drakee058b4f1998-02-16 06:15:35 +00002218expression \samp{\var{o}.items()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002219\end{cfuncdesc}
2220
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002221
2222\begin{cfuncdesc}{PyObject*}{PyMapping_GetItemString}{PyObject *o, char *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00002223Return element of \var{o} corresponding to the object \var{key} or
2224\NULL{} on failure. This is the equivalent of the Python expression
2225\samp{\var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002226\end{cfuncdesc}
2227
Fred Drakedbcaeda2001-05-07 17:42:18 +00002228\begin{cfuncdesc}{int}{PyMapping_SetItemString}{PyObject *o, char *key,
2229 PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00002230Map the object \var{key} to the value \var{v} in object \var{o}.
2231Returns \code{-1} on failure. This is the equivalent of the Python
2232statement \samp{\var{o}[\var{key}] = \var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002233\end{cfuncdesc}
2234
2235
Fred Drakedbcaeda2001-05-07 17:42:18 +00002236\section{Iterator Protocol \label{iterator}}
2237
Fred Drakea8e08272001-05-07 17:47:07 +00002238\versionadded{2.2}
2239
Fred Drakedbcaeda2001-05-07 17:42:18 +00002240There are only a couple of functions specifically for working with
2241iterators.
2242
2243\begin{cfuncdesc}{int}{PyIter_Check}{PyObject *o}
2244 Return true if the object \var{o} supports the iterator protocol.
2245\end{cfuncdesc}
2246
2247\begin{cfuncdesc}{PyObject*}{PyIter_Next}{PyObject *o}
2248 Return the next value from the iteration \var{o}. If the object is
2249 an iterator, this retrieves the next value from the iteration, and
2250 returns \NULL{} with no exception set if there are no remaining
2251 items. If the object is not an iterator, \exception{TypeError} is
2252 raised, or if there is an error in retrieving the item, returns
2253 \NULL{} and passes along the exception.
2254\end{cfuncdesc}
2255
2256To write a loop which iterates over an iterator, the C code should
2257look something like this:
2258
2259\begin{verbatim}
2260PyObject *iterator = ...;
2261PyObject *item;
2262
2263while (item = PyIter_Next(iter)) {
2264 /* do something with item */
2265}
2266if (PyErr_Occurred()) {
2267 /* propogate error */
2268}
2269else {
2270 /* continue doing useful work */
2271}
2272\end{verbatim}
2273
2274
Fred Drakeefd146c1999-02-15 15:30:45 +00002275\chapter{Concrete Objects Layer \label{concrete}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002276
2277The functions in this chapter are specific to certain Python object
2278types. Passing them an object of the wrong type is not a good idea;
2279if you receive an object from a Python program and you are not sure
2280that it has the right type, you must perform a type check first;
Fred Drake5566c1c2001-01-19 22:48:33 +00002281for example, to check that an object is a dictionary, use
Fred Drakee5bf8b21998-02-12 21:22:28 +00002282\cfunction{PyDict_Check()}. The chapter is structured like the
2283``family tree'' of Python object types.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002284
Fred Drake89024422000-10-23 16:00:54 +00002285\strong{Warning:}
2286While the functions described in this chapter carefully check the type
2287of the objects which are passed in, many of them do not check for
2288\NULL{} being passed instead of a valid object. Allowing \NULL{} to
2289be passed in can cause memory access violations and immediate
2290termination of the interpreter.
2291
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002292
Fred Drakeefd146c1999-02-15 15:30:45 +00002293\section{Fundamental Objects \label{fundamental}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002294
Fred Drakee5bf8b21998-02-12 21:22:28 +00002295This section describes Python type objects and the singleton object
2296\code{None}.
2297
2298
Fred Drakeefd146c1999-02-15 15:30:45 +00002299\subsection{Type Objects \label{typeObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002300
Fred Drake659ebfa2000-04-03 15:42:13 +00002301\obindex{type}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002302\begin{ctypedesc}{PyTypeObject}
Fred Drake659ebfa2000-04-03 15:42:13 +00002303The C structure of the objects used to describe built-in types.
Fred Drakee5bf8b21998-02-12 21:22:28 +00002304\end{ctypedesc}
2305
Fred Drake659ebfa2000-04-03 15:42:13 +00002306\begin{cvardesc}{PyObject*}{PyType_Type}
Fred Drakeefd146c1999-02-15 15:30:45 +00002307This is the type object for type objects; it is the same object as
2308\code{types.TypeType} in the Python layer.
Fred Drake659ebfa2000-04-03 15:42:13 +00002309\withsubitem{(in module types)}{\ttindex{TypeType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002310\end{cvardesc}
2311
Fred Drake659ebfa2000-04-03 15:42:13 +00002312\begin{cfuncdesc}{int}{PyType_Check}{PyObject *o}
2313Returns true is the object \var{o} is a type object.
2314\end{cfuncdesc}
2315
2316\begin{cfuncdesc}{int}{PyType_HasFeature}{PyObject *o, int feature}
2317Returns true if the type object \var{o} sets the feature
Fred Drakef0e08ef2001-02-03 01:11:26 +00002318\var{feature}. Type features are denoted by single bit flags.
Fred Drake659ebfa2000-04-03 15:42:13 +00002319\end{cfuncdesc}
2320
Fred Drakee5bf8b21998-02-12 21:22:28 +00002321
Fred Drakeefd146c1999-02-15 15:30:45 +00002322\subsection{The None Object \label{noneObject}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002323
Fred Drake659ebfa2000-04-03 15:42:13 +00002324\obindex{None@\texttt{None}}
2325Note that the \ctype{PyTypeObject} for \code{None} is not directly
2326exposed in the Python/C API. Since \code{None} is a singleton,
2327testing for object identity (using \samp{==} in C) is sufficient.
2328There is no \cfunction{PyNone_Check()} function for the same reason.
2329
2330\begin{cvardesc}{PyObject*}{Py_None}
Guido van Rossum44475131998-04-21 15:30:01 +00002331The Python \code{None} object, denoting lack of value. This object has
2332no methods.
Fred Drakee5bf8b21998-02-12 21:22:28 +00002333\end{cvardesc}
2334
2335
Fred Drakefa774872001-07-11 20:35:37 +00002336\section{Numeric Objects \label{numericObjects}}
2337
2338\obindex{numeric}
2339
2340
2341\subsection{Plain Integer Objects \label{intObjects}}
2342
2343\obindex{integer}
2344\begin{ctypedesc}{PyIntObject}
2345This subtype of \ctype{PyObject} represents a Python integer object.
2346\end{ctypedesc}
2347
2348\begin{cvardesc}{PyTypeObject}{PyInt_Type}
2349This instance of \ctype{PyTypeObject} represents the Python plain
2350integer type. This is the same object as \code{types.IntType}.
2351\withsubitem{(in modules types)}{\ttindex{IntType}}
2352\end{cvardesc}
2353
2354\begin{cfuncdesc}{int}{PyInt_Check}{PyObject* o}
2355Returns true if \var{o} is of type \cdata{PyInt_Type}.
2356\end{cfuncdesc}
2357
2358\begin{cfuncdesc}{PyObject*}{PyInt_FromLong}{long ival}
2359Creates a new integer object with a value of \var{ival}.
2360
2361The current implementation keeps an array of integer objects for all
2362integers between \code{-1} and \code{100}, when you create an int in
2363that range you actually just get back a reference to the existing
2364object. So it should be possible to change the value of \code{1}. I
2365suspect the behaviour of Python in this case is undefined. :-)
2366\end{cfuncdesc}
2367
2368\begin{cfuncdesc}{long}{PyInt_AsLong}{PyObject *io}
2369Will first attempt to cast the object to a \ctype{PyIntObject}, if
2370it is not already one, and then return its value.
2371\end{cfuncdesc}
2372
2373\begin{cfuncdesc}{long}{PyInt_AS_LONG}{PyObject *io}
2374Returns the value of the object \var{io}. No error checking is
2375performed.
2376\end{cfuncdesc}
2377
2378\begin{cfuncdesc}{long}{PyInt_GetMax}{}
2379Returns the system's idea of the largest integer it can handle
2380(\constant{LONG_MAX}\ttindex{LONG_MAX}, as defined in the system
2381header files).
2382\end{cfuncdesc}
2383
2384
2385\subsection{Long Integer Objects \label{longObjects}}
2386
2387\obindex{long integer}
2388\begin{ctypedesc}{PyLongObject}
2389This subtype of \ctype{PyObject} represents a Python long integer
2390object.
2391\end{ctypedesc}
2392
2393\begin{cvardesc}{PyTypeObject}{PyLong_Type}
2394This instance of \ctype{PyTypeObject} represents the Python long
2395integer type. This is the same object as \code{types.LongType}.
2396\withsubitem{(in modules types)}{\ttindex{LongType}}
2397\end{cvardesc}
2398
2399\begin{cfuncdesc}{int}{PyLong_Check}{PyObject *p}
2400Returns true if its argument is a \ctype{PyLongObject}.
2401\end{cfuncdesc}
2402
2403\begin{cfuncdesc}{PyObject*}{PyLong_FromLong}{long v}
2404Returns a new \ctype{PyLongObject} object from \var{v}, or \NULL{} on
2405failure.
2406\end{cfuncdesc}
2407
2408\begin{cfuncdesc}{PyObject*}{PyLong_FromUnsignedLong}{unsigned long v}
2409Returns a new \ctype{PyLongObject} object from a C \ctype{unsigned
2410long}, or \NULL{} on failure.
2411\end{cfuncdesc}
2412
2413\begin{cfuncdesc}{PyObject*}{PyLong_FromDouble}{double v}
2414Returns a new \ctype{PyLongObject} object from the integer part of
2415\var{v}, or \NULL{} on failure.
2416\end{cfuncdesc}
2417
2418\begin{cfuncdesc}{long}{PyLong_AsLong}{PyObject *pylong}
2419Returns a C \ctype{long} representation of the contents of
2420\var{pylong}. If \var{pylong} is greater than
2421\constant{LONG_MAX}\ttindex{LONG_MAX}, an \exception{OverflowError} is
2422raised.\withsubitem{(built-in exception)}{\ttindex{OverflowError}}
2423\end{cfuncdesc}
2424
2425\begin{cfuncdesc}{unsigned long}{PyLong_AsUnsignedLong}{PyObject *pylong}
2426Returns a C \ctype{unsigned long} representation of the contents of
2427\var{pylong}. If \var{pylong} is greater than
2428\constant{ULONG_MAX}\ttindex{ULONG_MAX}, an \exception{OverflowError}
2429is raised.\withsubitem{(built-in exception)}{\ttindex{OverflowError}}
2430\end{cfuncdesc}
2431
2432\begin{cfuncdesc}{double}{PyLong_AsDouble}{PyObject *pylong}
2433Returns a C \ctype{double} representation of the contents of \var{pylong}.
2434\end{cfuncdesc}
2435
2436\begin{cfuncdesc}{PyObject*}{PyLong_FromString}{char *str, char **pend,
2437 int base}
2438Return a new \ctype{PyLongObject} based on the string value in
2439\var{str}, which is interpreted according to the radix in \var{base}.
2440If \var{pend} is non-\NULL, \code{*\var{pend}} will point to the first
2441character in \var{str} which follows the representation of the
2442number. If \var{base} is \code{0}, the radix will be determined base
2443on the leading characters of \var{str}: if \var{str} starts with
2444\code{'0x'} or \code{'0X'}, radix 16 will be used; if \var{str} starts
2445with \code{'0'}, radix 8 will be used; otherwise radix 10 will be
2446used. If \var{base} is not \code{0}, it must be between \code{2} and
2447\code{36}, inclusive. Leading spaces are ignored. If there are no
2448digits, \exception{ValueError} will be raised.
2449\end{cfuncdesc}
2450
2451
2452\subsection{Floating Point Objects \label{floatObjects}}
2453
2454\obindex{floating point}
2455\begin{ctypedesc}{PyFloatObject}
2456This subtype of \ctype{PyObject} represents a Python floating point
2457object.
2458\end{ctypedesc}
2459
2460\begin{cvardesc}{PyTypeObject}{PyFloat_Type}
2461This instance of \ctype{PyTypeObject} represents the Python floating
2462point type. This is the same object as \code{types.FloatType}.
2463\withsubitem{(in modules types)}{\ttindex{FloatType}}
2464\end{cvardesc}
2465
2466\begin{cfuncdesc}{int}{PyFloat_Check}{PyObject *p}
2467Returns true if its argument is a \ctype{PyFloatObject}.
2468\end{cfuncdesc}
2469
2470\begin{cfuncdesc}{PyObject*}{PyFloat_FromDouble}{double v}
2471Creates a \ctype{PyFloatObject} object from \var{v}, or \NULL{} on
2472failure.
2473\end{cfuncdesc}
2474
2475\begin{cfuncdesc}{double}{PyFloat_AsDouble}{PyObject *pyfloat}
2476Returns a C \ctype{double} representation of the contents of \var{pyfloat}.
2477\end{cfuncdesc}
2478
2479\begin{cfuncdesc}{double}{PyFloat_AS_DOUBLE}{PyObject *pyfloat}
2480Returns a C \ctype{double} representation of the contents of
2481\var{pyfloat}, but without error checking.
2482\end{cfuncdesc}
2483
2484
2485\subsection{Complex Number Objects \label{complexObjects}}
2486
2487\obindex{complex number}
2488Python's complex number objects are implemented as two distinct types
2489when viewed from the C API: one is the Python object exposed to
2490Python programs, and the other is a C structure which represents the
2491actual complex number value. The API provides functions for working
2492with both.
2493
2494\subsubsection{Complex Numbers as C Structures}
2495
2496Note that the functions which accept these structures as parameters
2497and return them as results do so \emph{by value} rather than
2498dereferencing them through pointers. This is consistent throughout
2499the API.
2500
2501\begin{ctypedesc}{Py_complex}
2502The C structure which corresponds to the value portion of a Python
2503complex number object. Most of the functions for dealing with complex
2504number objects use structures of this type as input or output values,
2505as appropriate. It is defined as:
2506
2507\begin{verbatim}
2508typedef struct {
2509 double real;
2510 double imag;
2511} Py_complex;
2512\end{verbatim}
2513\end{ctypedesc}
2514
2515\begin{cfuncdesc}{Py_complex}{_Py_c_sum}{Py_complex left, Py_complex right}
2516Return the sum of two complex numbers, using the C
2517\ctype{Py_complex} representation.
2518\end{cfuncdesc}
2519
2520\begin{cfuncdesc}{Py_complex}{_Py_c_diff}{Py_complex left, Py_complex right}
2521Return the difference between two complex numbers, using the C
2522\ctype{Py_complex} representation.
2523\end{cfuncdesc}
2524
2525\begin{cfuncdesc}{Py_complex}{_Py_c_neg}{Py_complex complex}
2526Return the negation of the complex number \var{complex}, using the C
2527\ctype{Py_complex} representation.
2528\end{cfuncdesc}
2529
2530\begin{cfuncdesc}{Py_complex}{_Py_c_prod}{Py_complex left, Py_complex right}
2531Return the product of two complex numbers, using the C
2532\ctype{Py_complex} representation.
2533\end{cfuncdesc}
2534
2535\begin{cfuncdesc}{Py_complex}{_Py_c_quot}{Py_complex dividend,
2536 Py_complex divisor}
2537Return the quotient of two complex numbers, using the C
2538\ctype{Py_complex} representation.
2539\end{cfuncdesc}
2540
2541\begin{cfuncdesc}{Py_complex}{_Py_c_pow}{Py_complex num, Py_complex exp}
2542Return the exponentiation of \var{num} by \var{exp}, using the C
2543\ctype{Py_complex} representation.
2544\end{cfuncdesc}
2545
2546
2547\subsubsection{Complex Numbers as Python Objects}
2548
2549\begin{ctypedesc}{PyComplexObject}
2550This subtype of \ctype{PyObject} represents a Python complex number object.
2551\end{ctypedesc}
2552
2553\begin{cvardesc}{PyTypeObject}{PyComplex_Type}
2554This instance of \ctype{PyTypeObject} represents the Python complex
2555number type.
2556\end{cvardesc}
2557
2558\begin{cfuncdesc}{int}{PyComplex_Check}{PyObject *p}
2559Returns true if its argument is a \ctype{PyComplexObject}.
2560\end{cfuncdesc}
2561
2562\begin{cfuncdesc}{PyObject*}{PyComplex_FromCComplex}{Py_complex v}
2563Create a new Python complex number object from a C
2564\ctype{Py_complex} value.
2565\end{cfuncdesc}
2566
2567\begin{cfuncdesc}{PyObject*}{PyComplex_FromDoubles}{double real, double imag}
2568Returns a new \ctype{PyComplexObject} object from \var{real} and \var{imag}.
2569\end{cfuncdesc}
2570
2571\begin{cfuncdesc}{double}{PyComplex_RealAsDouble}{PyObject *op}
2572Returns the real part of \var{op} as a C \ctype{double}.
2573\end{cfuncdesc}
2574
2575\begin{cfuncdesc}{double}{PyComplex_ImagAsDouble}{PyObject *op}
2576Returns the imaginary part of \var{op} as a C \ctype{double}.
2577\end{cfuncdesc}
2578
2579\begin{cfuncdesc}{Py_complex}{PyComplex_AsCComplex}{PyObject *op}
2580Returns the \ctype{Py_complex} value of the complex number \var{op}.
2581\end{cfuncdesc}
2582
2583
2584
Fred Drakeefd146c1999-02-15 15:30:45 +00002585\section{Sequence Objects \label{sequenceObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002586
Fred Drake659ebfa2000-04-03 15:42:13 +00002587\obindex{sequence}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002588Generic operations on sequence objects were discussed in the previous
2589chapter; this section deals with the specific kinds of sequence
2590objects that are intrinsic to the Python language.
2591
2592
Fred Drakeefd146c1999-02-15 15:30:45 +00002593\subsection{String Objects \label{stringObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002594
Fred Drake89024422000-10-23 16:00:54 +00002595These functions raise \exception{TypeError} when expecting a string
2596parameter and are called with a non-string parameter.
2597
Fred Drake659ebfa2000-04-03 15:42:13 +00002598\obindex{string}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002599\begin{ctypedesc}{PyStringObject}
Fred Drakef8830d11998-04-23 14:06:01 +00002600This subtype of \ctype{PyObject} represents a Python string object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00002601\end{ctypedesc}
2602
2603\begin{cvardesc}{PyTypeObject}{PyString_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00002604This instance of \ctype{PyTypeObject} represents the Python string
2605type; it is the same object as \code{types.TypeType} in the Python
2606layer.\withsubitem{(in module types)}{\ttindex{StringType}}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00002607\end{cvardesc}
2608
2609\begin{cfuncdesc}{int}{PyString_Check}{PyObject *o}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00002610Returns true if the object \var{o} is a string object.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002611\end{cfuncdesc}
2612
Fred Drakec6fa34e1998-04-02 06:47:24 +00002613\begin{cfuncdesc}{PyObject*}{PyString_FromString}{const char *v}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00002614Returns a new string object with the value \var{v} on success, and
2615\NULL{} on failure.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002616\end{cfuncdesc}
2617
Fred Drake659ebfa2000-04-03 15:42:13 +00002618\begin{cfuncdesc}{PyObject*}{PyString_FromStringAndSize}{const char *v,
2619 int len}
2620Returns a new string object with the value \var{v} and length
2621\var{len} on success, and \NULL{} on failure. If \var{v} is \NULL{},
2622the contents of the string are uninitialized.
2623\end{cfuncdesc}
2624
Fred Drakec6fa34e1998-04-02 06:47:24 +00002625\begin{cfuncdesc}{int}{PyString_Size}{PyObject *string}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00002626Returns the length of the string in string object \var{string}.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002627\end{cfuncdesc}
2628
Fred Drake659ebfa2000-04-03 15:42:13 +00002629\begin{cfuncdesc}{int}{PyString_GET_SIZE}{PyObject *string}
Fred Drake5d644212000-10-07 12:31:50 +00002630Macro form of \cfunction{PyString_Size()} but without error
Fred Drake659ebfa2000-04-03 15:42:13 +00002631checking.
2632\end{cfuncdesc}
2633
Fred Drakec6fa34e1998-04-02 06:47:24 +00002634\begin{cfuncdesc}{char*}{PyString_AsString}{PyObject *string}
Fred Drake659ebfa2000-04-03 15:42:13 +00002635Returns a null-terminated representation of the contents of
2636\var{string}. The pointer refers to the internal buffer of
Fred Drake89024422000-10-23 16:00:54 +00002637\var{string}, not a copy. The data must not be modified in any way,
2638unless the string was just created using
2639\code{PyString_FromStringAndSize(NULL, \var{size})}.
2640It must not be deallocated.
Fred Drake659ebfa2000-04-03 15:42:13 +00002641\end{cfuncdesc}
2642
2643\begin{cfuncdesc}{char*}{PyString_AS_STRING}{PyObject *string}
2644Macro form of \cfunction{PyString_AsString()} but without error
2645checking.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002646\end{cfuncdesc}
2647
Marc-André Lemburgd1ba4432000-09-19 21:04:18 +00002648\begin{cfuncdesc}{int}{PyString_AsStringAndSize}{PyObject *obj,
2649 char **buffer,
2650 int *length}
2651Returns a null-terminated representation of the contents of the object
2652\var{obj} through the output variables \var{buffer} and \var{length}.
2653
2654The function accepts both string and Unicode objects as input. For
2655Unicode objects it returns the default encoded version of the object.
2656If \var{length} is set to \NULL{}, the resulting buffer may not contain
2657null characters; if it does, the function returns -1 and a
2658TypeError is raised.
2659
2660The buffer refers to an internal string buffer of \var{obj}, not a
Fred Drake89024422000-10-23 16:00:54 +00002661copy. The data must not be modified in any way, unless the string was
2662just created using \code{PyString_FromStringAndSize(NULL,
2663\var{size})}. It must not be deallocated.
Marc-André Lemburgd1ba4432000-09-19 21:04:18 +00002664\end{cfuncdesc}
2665
Fred Drakec6fa34e1998-04-02 06:47:24 +00002666\begin{cfuncdesc}{void}{PyString_Concat}{PyObject **string,
2667 PyObject *newpart}
Fred Drake66b989c1999-02-15 20:15:39 +00002668Creates a new string object in \var{*string} containing the
Fred Drakeddc6c272000-03-31 18:22:38 +00002669contents of \var{newpart} appended to \var{string}; the caller will
2670own the new reference. The reference to the old value of \var{string}
2671will be stolen. If the new string
Fred Drake66b989c1999-02-15 20:15:39 +00002672cannot be created, the old reference to \var{string} will still be
2673discarded and the value of \var{*string} will be set to
2674\NULL{}; the appropriate exception will be set.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002675\end{cfuncdesc}
2676
2677\begin{cfuncdesc}{void}{PyString_ConcatAndDel}{PyObject **string,
2678 PyObject *newpart}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00002679Creates a new string object in \var{*string} containing the contents
Guido van Rossum44475131998-04-21 15:30:01 +00002680of \var{newpart} appended to \var{string}. This version decrements
2681the reference count of \var{newpart}.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002682\end{cfuncdesc}
2683
2684\begin{cfuncdesc}{int}{_PyString_Resize}{PyObject **string, int newsize}
Guido van Rossum44475131998-04-21 15:30:01 +00002685A way to resize a string object even though it is ``immutable''.
2686Only use this to build up a brand new string object; don't use this if
2687the string may already be known in other parts of the code.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002688\end{cfuncdesc}
2689
2690\begin{cfuncdesc}{PyObject*}{PyString_Format}{PyObject *format,
2691 PyObject *args}
Guido van Rossum44475131998-04-21 15:30:01 +00002692Returns a new string object from \var{format} and \var{args}. Analogous
Fred Drake659ebfa2000-04-03 15:42:13 +00002693to \code{\var{format} \%\ \var{args}}. The \var{args} argument must be
Guido van Rossum44475131998-04-21 15:30:01 +00002694a tuple.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002695\end{cfuncdesc}
2696
2697\begin{cfuncdesc}{void}{PyString_InternInPlace}{PyObject **string}
Guido van Rossum44475131998-04-21 15:30:01 +00002698Intern the argument \var{*string} in place. The argument must be the
2699address of a pointer variable pointing to a Python string object.
2700If there is an existing interned string that is the same as
2701\var{*string}, it sets \var{*string} to it (decrementing the reference
2702count of the old string object and incrementing the reference count of
2703the interned string object), otherwise it leaves \var{*string} alone
2704and interns it (incrementing its reference count). (Clarification:
2705even though there is a lot of talk about reference counts, think of
Fred Drakef8830d11998-04-23 14:06:01 +00002706this function as reference-count-neutral; you own the object after
2707the call if and only if you owned it before the call.)
Fred Drakec6fa34e1998-04-02 06:47:24 +00002708\end{cfuncdesc}
2709
2710\begin{cfuncdesc}{PyObject*}{PyString_InternFromString}{const char *v}
Fred Drakef8830d11998-04-23 14:06:01 +00002711A combination of \cfunction{PyString_FromString()} and
2712\cfunction{PyString_InternInPlace()}, returning either a new string object
Guido van Rossum44475131998-04-21 15:30:01 +00002713that has been interned, or a new (``owned'') reference to an earlier
2714interned string object with the same value.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002715\end{cfuncdesc}
2716
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002717\begin{cfuncdesc}{PyObject*}{PyString_Decode}{const char *s,
2718 int size,
2719 const char *encoding,
2720 const char *errors}
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002721Creates an object by decoding \var{size} bytes of the encoded
2722buffer \var{s} using the codec registered
2723for \var{encoding}. \var{encoding} and \var{errors} have the same meaning
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002724as the parameters of the same name in the unicode() builtin
2725function. The codec to be used is looked up using the Python codec
2726registry. Returns \NULL{} in case an exception was raised by the
2727codec.
2728\end{cfuncdesc}
2729
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002730\begin{cfuncdesc}{PyObject*}{PyString_AsDecodedObject}{PyObject *str,
2731 const char *encoding,
2732 const char *errors}
2733Decodes a string object by passing it to the codec registered
2734for \var{encoding} and returns the result as Python
2735object. \var{encoding} and \var{errors} have the same meaning as the
2736parameters of the same name in the string .encode() method. The codec
2737to be used is looked up using the Python codec registry. Returns
2738\NULL{} in case an exception was raised by the codec.
2739\end{cfuncdesc}
2740
2741\begin{cfuncdesc}{PyObject*}{PyString_Encode}{const char *s,
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002742 int size,
2743 const char *encoding,
2744 const char *errors}
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002745Encodes the \ctype{char} buffer of the given size by passing it to
2746the codec registered for \var{encoding} and returns a Python object.
2747\var{encoding} and \var{errors} have the same
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002748meaning as the parameters of the same name in the string .encode()
2749method. The codec to be used is looked up using the Python codec
2750registry. Returns \NULL{} in case an exception was raised by the
2751codec.
2752\end{cfuncdesc}
2753
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002754\begin{cfuncdesc}{PyObject*}{PyString_AsEncodedObject}{PyObject *str,
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002755 const char *encoding,
2756 const char *errors}
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002757Encodes a string object using the codec registered
2758for \var{encoding} and returns the result as Python
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002759object. \var{encoding} and \var{errors} have the same meaning as the
2760parameters of the same name in the string .encode() method. The codec
2761to be used is looked up using the Python codec registry. Returns
2762\NULL{} in case an exception was raised by the codec.
2763\end{cfuncdesc}
2764
Fred Drakee5bf8b21998-02-12 21:22:28 +00002765
Fred Drakea4cd2612000-04-06 14:10:29 +00002766\subsection{Unicode Objects \label{unicodeObjects}}
2767\sectionauthor{Marc-Andre Lemburg}{mal@lemburg.com}
2768
2769%--- Unicode Type -------------------------------------------------------
2770
2771These are the basic Unicode object types used for the Unicode
2772implementation in Python:
2773
2774\begin{ctypedesc}{Py_UNICODE}
2775This type represents a 16-bit unsigned storage type which is used by
2776Python internally as basis for holding Unicode ordinals. On platforms
2777where \ctype{wchar_t} is available and also has 16-bits,
2778\ctype{Py_UNICODE} is a typedef alias for \ctype{wchar_t} to enhance
2779native platform compatibility. On all other platforms,
2780\ctype{Py_UNICODE} is a typedef alias for \ctype{unsigned short}.
2781\end{ctypedesc}
2782
2783\begin{ctypedesc}{PyUnicodeObject}
2784This subtype of \ctype{PyObject} represents a Python Unicode object.
2785\end{ctypedesc}
2786
2787\begin{cvardesc}{PyTypeObject}{PyUnicode_Type}
2788This instance of \ctype{PyTypeObject} represents the Python Unicode type.
2789\end{cvardesc}
2790
2791%--- These are really C macros... is there a macrodesc TeX macro ?
2792
2793The following APIs are really C macros and can be used to do fast
2794checks and to access internal read-only data of Unicode objects:
2795
2796\begin{cfuncdesc}{int}{PyUnicode_Check}{PyObject *o}
2797Returns true if the object \var{o} is a Unicode object.
2798\end{cfuncdesc}
2799
2800\begin{cfuncdesc}{int}{PyUnicode_GET_SIZE}{PyObject *o}
2801Returns the size of the object. o has to be a
2802PyUnicodeObject (not checked).
2803\end{cfuncdesc}
2804
2805\begin{cfuncdesc}{int}{PyUnicode_GET_DATA_SIZE}{PyObject *o}
2806Returns the size of the object's internal buffer in bytes. o has to be
2807a PyUnicodeObject (not checked).
2808\end{cfuncdesc}
2809
Fred Drake992fe5a2000-06-16 21:04:15 +00002810\begin{cfuncdesc}{Py_UNICODE*}{PyUnicode_AS_UNICODE}{PyObject *o}
Fred Drakea4cd2612000-04-06 14:10:29 +00002811Returns a pointer to the internal Py_UNICODE buffer of the object. o
2812has to be a PyUnicodeObject (not checked).
2813\end{cfuncdesc}
2814
Fred Drake992fe5a2000-06-16 21:04:15 +00002815\begin{cfuncdesc}{const char*}{PyUnicode_AS_DATA}{PyObject *o}
Fred Drakea4cd2612000-04-06 14:10:29 +00002816Returns a (const char *) pointer to the internal buffer of the object.
2817o has to be a PyUnicodeObject (not checked).
2818\end{cfuncdesc}
2819
2820% --- Unicode character properties ---------------------------------------
2821
2822Unicode provides many different character properties. The most often
2823needed ones are available through these macros which are mapped to C
2824functions depending on the Python configuration.
2825
2826\begin{cfuncdesc}{int}{Py_UNICODE_ISSPACE}{Py_UNICODE ch}
2827Returns 1/0 depending on whether \var{ch} is a whitespace character.
2828\end{cfuncdesc}
2829
2830\begin{cfuncdesc}{int}{Py_UNICODE_ISLOWER}{Py_UNICODE ch}
2831Returns 1/0 depending on whether \var{ch} is a lowercase character.
2832\end{cfuncdesc}
2833
2834\begin{cfuncdesc}{int}{Py_UNICODE_ISUPPER}{Py_UNICODE ch}
Fred Drakeae96aab2000-07-03 13:38:10 +00002835Returns 1/0 depending on whether \var{ch} is an uppercase character.
Fred Drakea4cd2612000-04-06 14:10:29 +00002836\end{cfuncdesc}
2837
2838\begin{cfuncdesc}{int}{Py_UNICODE_ISTITLE}{Py_UNICODE ch}
2839Returns 1/0 depending on whether \var{ch} is a titlecase character.
2840\end{cfuncdesc}
2841
2842\begin{cfuncdesc}{int}{Py_UNICODE_ISLINEBREAK}{Py_UNICODE ch}
2843Returns 1/0 depending on whether \var{ch} is a linebreak character.
2844\end{cfuncdesc}
2845
2846\begin{cfuncdesc}{int}{Py_UNICODE_ISDECIMAL}{Py_UNICODE ch}
2847Returns 1/0 depending on whether \var{ch} is a decimal character.
2848\end{cfuncdesc}
2849
2850\begin{cfuncdesc}{int}{Py_UNICODE_ISDIGIT}{Py_UNICODE ch}
2851Returns 1/0 depending on whether \var{ch} is a digit character.
2852\end{cfuncdesc}
2853
2854\begin{cfuncdesc}{int}{Py_UNICODE_ISNUMERIC}{Py_UNICODE ch}
2855Returns 1/0 depending on whether \var{ch} is a numeric character.
2856\end{cfuncdesc}
2857
Fred Drakeae96aab2000-07-03 13:38:10 +00002858\begin{cfuncdesc}{int}{Py_UNICODE_ISALPHA}{Py_UNICODE ch}
2859Returns 1/0 depending on whether \var{ch} is an alphabetic character.
2860\end{cfuncdesc}
2861
2862\begin{cfuncdesc}{int}{Py_UNICODE_ISALNUM}{Py_UNICODE ch}
2863Returns 1/0 depending on whether \var{ch} is an alphanumeric character.
2864\end{cfuncdesc}
2865
Fred Drakea4cd2612000-04-06 14:10:29 +00002866These APIs can be used for fast direct character conversions:
2867
2868\begin{cfuncdesc}{Py_UNICODE}{Py_UNICODE_TOLOWER}{Py_UNICODE ch}
2869Returns the character \var{ch} converted to lower case.
2870\end{cfuncdesc}
2871
2872\begin{cfuncdesc}{Py_UNICODE}{Py_UNICODE_TOUPPER}{Py_UNICODE ch}
2873Returns the character \var{ch} converted to upper case.
2874\end{cfuncdesc}
2875
2876\begin{cfuncdesc}{Py_UNICODE}{Py_UNICODE_TOTITLE}{Py_UNICODE ch}
2877Returns the character \var{ch} converted to title case.
2878\end{cfuncdesc}
2879
2880\begin{cfuncdesc}{int}{Py_UNICODE_TODECIMAL}{Py_UNICODE ch}
2881Returns the character \var{ch} converted to a decimal positive integer.
2882Returns -1 in case this is not possible. Does not raise exceptions.
2883\end{cfuncdesc}
2884
2885\begin{cfuncdesc}{int}{Py_UNICODE_TODIGIT}{Py_UNICODE ch}
2886Returns the character \var{ch} converted to a single digit integer.
2887Returns -1 in case this is not possible. Does not raise exceptions.
2888\end{cfuncdesc}
2889
2890\begin{cfuncdesc}{double}{Py_UNICODE_TONUMERIC}{Py_UNICODE ch}
2891Returns the character \var{ch} converted to a (positive) double.
2892Returns -1.0 in case this is not possible. Does not raise exceptions.
2893\end{cfuncdesc}
2894
2895% --- Plain Py_UNICODE ---------------------------------------------------
2896
2897To create Unicode objects and access their basic sequence properties,
2898use these APIs:
2899
2900\begin{cfuncdesc}{PyObject*}{PyUnicode_FromUnicode}{const Py_UNICODE *u,
2901 int size}
2902
2903Create a Unicode Object from the Py_UNICODE buffer \var{u} of the
2904given size. \var{u} may be \NULL{} which causes the contents to be
2905undefined. It is the user's responsibility to fill in the needed data.
Marc-André Lemburg8155e0e2001-04-23 14:44:21 +00002906The buffer is copied into the new object. If the buffer is not \NULL{},
2907the return value might be a shared object. Therefore, modification of
2908the resulting Unicode Object is only allowed when \var{u} is \NULL{}.
Fred Drakea4cd2612000-04-06 14:10:29 +00002909\end{cfuncdesc}
2910
Fred Drake1d158692000-06-18 05:21:21 +00002911\begin{cfuncdesc}{Py_UNICODE*}{PyUnicode_AsUnicode}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00002912Return a read-only pointer to the Unicode object's internal
2913\ctype{Py_UNICODE} buffer.
2914\end{cfuncdesc}
2915
2916\begin{cfuncdesc}{int}{PyUnicode_GetSize}{PyObject *unicode}
2917Return the length of the Unicode object.
2918\end{cfuncdesc}
2919
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002920\begin{cfuncdesc}{PyObject*}{PyUnicode_FromEncodedObject}{PyObject *obj,
2921 const char *encoding,
2922 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002923
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002924Coerce an encoded object obj to an Unicode object and return a
2925reference with incremented refcount.
Fred Drakea4cd2612000-04-06 14:10:29 +00002926
2927Coercion is done in the following way:
2928\begin{enumerate}
2929\item Unicode objects are passed back as-is with incremented
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002930 refcount. Note: these cannot be decoded; passing a non-NULL
2931 value for encoding will result in a TypeError.
Fred Drakea4cd2612000-04-06 14:10:29 +00002932
2933\item String and other char buffer compatible objects are decoded
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002934 according to the given encoding and using the error handling
2935 defined by errors. Both can be NULL to have the interface use
2936 the default values (see the next section for details).
Fred Drakea4cd2612000-04-06 14:10:29 +00002937
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002938\item All other objects cause an exception.
Fred Drakea4cd2612000-04-06 14:10:29 +00002939\end{enumerate}
2940The API returns NULL in case of an error. The caller is responsible
2941for decref'ing the returned objects.
2942\end{cfuncdesc}
2943
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002944\begin{cfuncdesc}{PyObject*}{PyUnicode_FromObject}{PyObject *obj}
2945
2946Shortcut for PyUnicode_FromEncodedObject(obj, NULL, ``strict'')
2947which is used throughout the interpreter whenever coercion to
2948Unicode is needed.
2949\end{cfuncdesc}
2950
Fred Drakea4cd2612000-04-06 14:10:29 +00002951% --- wchar_t support for platforms which support it ---------------------
2952
2953If the platform supports \ctype{wchar_t} and provides a header file
2954wchar.h, Python can interface directly to this type using the
2955following functions. Support is optimized if Python's own
2956\ctype{Py_UNICODE} type is identical to the system's \ctype{wchar_t}.
2957
2958\begin{cfuncdesc}{PyObject*}{PyUnicode_FromWideChar}{const wchar_t *w,
2959 int size}
2960Create a Unicode Object from the \ctype{whcar_t} buffer \var{w} of the
2961given size. Returns \NULL{} on failure.
2962\end{cfuncdesc}
2963
2964\begin{cfuncdesc}{int}{PyUnicode_AsWideChar}{PyUnicodeObject *unicode,
2965 wchar_t *w,
2966 int size}
Fred Drakea4cd2612000-04-06 14:10:29 +00002967Copies the Unicode Object contents into the \ctype{whcar_t} buffer
2968\var{w}. At most \var{size} \ctype{whcar_t} characters are copied.
2969Returns the number of \ctype{whcar_t} characters copied or -1 in case
2970of an error.
2971\end{cfuncdesc}
2972
2973
2974\subsubsection{Builtin Codecs \label{builtinCodecs}}
2975
2976Python provides a set of builtin codecs which are written in C
2977for speed. All of these codecs are directly usable via the
2978following functions.
2979
2980Many of the following APIs take two arguments encoding and
2981errors. These parameters encoding and errors have the same semantics
2982as the ones of the builtin unicode() Unicode object constructor.
2983
2984Setting encoding to NULL causes the default encoding to be used which
2985is UTF-8.
2986
2987Error handling is set by errors which may also be set to NULL meaning
2988to use the default handling defined for the codec. Default error
2989handling for all builtin codecs is ``strict'' (ValueErrors are raised).
2990
2991The codecs all use a similar interface. Only deviation from the
2992following generic ones are documented for simplicity.
2993
2994% --- Generic Codecs -----------------------------------------------------
2995
2996These are the generic codec APIs:
2997
2998\begin{cfuncdesc}{PyObject*}{PyUnicode_Decode}{const char *s,
2999 int size,
3000 const char *encoding,
3001 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003002Create a Unicode object by decoding \var{size} bytes of the encoded
3003string \var{s}. \var{encoding} and \var{errors} have the same meaning
3004as the parameters of the same name in the unicode() builtin
3005function. The codec to be used is looked up using the Python codec
3006registry. Returns \NULL{} in case an exception was raised by the
3007codec.
3008\end{cfuncdesc}
3009
3010\begin{cfuncdesc}{PyObject*}{PyUnicode_Encode}{const Py_UNICODE *s,
3011 int size,
3012 const char *encoding,
3013 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003014Encodes the \ctype{Py_UNICODE} buffer of the given size and returns a
3015Python string object. \var{encoding} and \var{errors} have the same
3016meaning as the parameters of the same name in the Unicode .encode()
3017method. The codec to be used is looked up using the Python codec
3018registry. Returns \NULL{} in case an exception was raised by the
3019codec.
3020\end{cfuncdesc}
3021
3022\begin{cfuncdesc}{PyObject*}{PyUnicode_AsEncodedString}{PyObject *unicode,
3023 const char *encoding,
3024 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003025Encodes a Unicode object and returns the result as Python string
3026object. \var{encoding} and \var{errors} have the same meaning as the
3027parameters of the same name in the Unicode .encode() method. The codec
3028to be used is looked up using the Python codec registry. Returns
3029\NULL{} in case an exception was raised by the codec.
3030\end{cfuncdesc}
3031
3032% --- UTF-8 Codecs -------------------------------------------------------
3033
3034These are the UTF-8 codec APIs:
3035
3036\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeUTF8}{const char *s,
3037 int size,
3038 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003039Creates a Unicode object by decoding \var{size} bytes of the UTF-8
3040encoded string \var{s}. Returns \NULL{} in case an exception was
3041raised by the codec.
3042\end{cfuncdesc}
3043
3044\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeUTF8}{const Py_UNICODE *s,
3045 int size,
3046 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003047Encodes the \ctype{Py_UNICODE} buffer of the given size using UTF-8
3048and returns a Python string object. Returns \NULL{} in case an
3049exception was raised by the codec.
3050\end{cfuncdesc}
3051
3052\begin{cfuncdesc}{PyObject*}{PyUnicode_AsUTF8String}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00003053Encodes a Unicode objects using UTF-8 and returns the result as Python
3054string object. Error handling is ``strict''. Returns
3055\NULL{} in case an exception was raised by the codec.
3056\end{cfuncdesc}
3057
3058% --- UTF-16 Codecs ------------------------------------------------------ */
3059
3060These are the UTF-16 codec APIs:
3061
3062\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeUTF16}{const char *s,
3063 int size,
3064 const char *errors,
3065 int *byteorder}
Fred Drakea4cd2612000-04-06 14:10:29 +00003066Decodes \var{length} bytes from a UTF-16 encoded buffer string and
3067returns the corresponding Unicode object.
3068
3069\var{errors} (if non-NULL) defines the error handling. It defaults
3070to ``strict''.
3071
3072If \var{byteorder} is non-\NULL{}, the decoder starts decoding using
3073the given byte order:
3074
3075\begin{verbatim}
3076 *byteorder == -1: little endian
3077 *byteorder == 0: native order
3078 *byteorder == 1: big endian
3079\end{verbatim}
3080
3081and then switches according to all byte order marks (BOM) it finds in
3082the input data. BOM marks are not copied into the resulting Unicode
3083string. After completion, \var{*byteorder} is set to the current byte
3084order at the end of input data.
3085
3086If \var{byteorder} is \NULL{}, the codec starts in native order mode.
3087
3088Returns \NULL{} in case an exception was raised by the codec.
3089\end{cfuncdesc}
3090
3091\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeUTF16}{const Py_UNICODE *s,
3092 int size,
3093 const char *errors,
3094 int byteorder}
Fred Drakea4cd2612000-04-06 14:10:29 +00003095Returns a Python string object holding the UTF-16 encoded value of the
3096Unicode data in \var{s}.
3097
Fred Drakea8455ab2000-06-16 19:58:42 +00003098If \var{byteorder} is not \code{0}, output is written according to the
Fred Drakea4cd2612000-04-06 14:10:29 +00003099following byte order:
3100
3101\begin{verbatim}
3102 byteorder == -1: little endian
3103 byteorder == 0: native byte order (writes a BOM mark)
3104 byteorder == 1: big endian
3105\end{verbatim}
3106
Fred Drakea8455ab2000-06-16 19:58:42 +00003107If byteorder is \code{0}, the output string will always start with the
Fred Drakea4cd2612000-04-06 14:10:29 +00003108Unicode BOM mark (U+FEFF). In the other two modes, no BOM mark is
3109prepended.
3110
3111Note that \ctype{Py_UNICODE} data is being interpreted as UTF-16
3112reduced to UCS-2. This trick makes it possible to add full UTF-16
3113capabilities at a later point without comprimising the APIs.
3114
3115Returns \NULL{} in case an exception was raised by the codec.
3116\end{cfuncdesc}
3117
3118\begin{cfuncdesc}{PyObject*}{PyUnicode_AsUTF16String}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00003119Returns a Python string using the UTF-16 encoding in native byte
3120order. The string always starts with a BOM mark. Error handling is
3121``strict''. Returns \NULL{} in case an exception was raised by the
3122codec.
3123\end{cfuncdesc}
3124
3125% --- Unicode-Escape Codecs ----------------------------------------------
3126
3127These are the ``Unicode Esacpe'' codec APIs:
3128
3129\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeUnicodeEscape}{const char *s,
3130 int size,
3131 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003132Creates a Unicode object by decoding \var{size} bytes of the Unicode-Esacpe
3133encoded string \var{s}. Returns \NULL{} in case an exception was
3134raised by the codec.
3135\end{cfuncdesc}
3136
3137\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeUnicodeEscape}{const Py_UNICODE *s,
3138 int size,
3139 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003140Encodes the \ctype{Py_UNICODE} buffer of the given size using Unicode-Escape
3141and returns a Python string object. Returns \NULL{} in case an
3142exception was raised by the codec.
3143\end{cfuncdesc}
3144
3145\begin{cfuncdesc}{PyObject*}{PyUnicode_AsUnicodeEscapeString}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00003146Encodes a Unicode objects using Unicode-Escape and returns the result
3147as Python string object. Error handling is ``strict''. Returns
3148\NULL{} in case an exception was raised by the codec.
3149\end{cfuncdesc}
3150
3151% --- Raw-Unicode-Escape Codecs ------------------------------------------
3152
3153These are the ``Raw Unicode Esacpe'' codec APIs:
3154
3155\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeRawUnicodeEscape}{const char *s,
3156 int size,
3157 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003158Creates a Unicode object by decoding \var{size} bytes of the Raw-Unicode-Esacpe
3159encoded string \var{s}. Returns \NULL{} in case an exception was
3160raised by the codec.
3161\end{cfuncdesc}
3162
3163\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeRawUnicodeEscape}{const Py_UNICODE *s,
3164 int size,
3165 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003166Encodes the \ctype{Py_UNICODE} buffer of the given size using Raw-Unicode-Escape
3167and returns a Python string object. Returns \NULL{} in case an
3168exception was raised by the codec.
3169\end{cfuncdesc}
3170
3171\begin{cfuncdesc}{PyObject*}{PyUnicode_AsRawUnicodeEscapeString}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00003172Encodes a Unicode objects using Raw-Unicode-Escape and returns the result
3173as Python string object. Error handling is ``strict''. Returns
3174\NULL{} in case an exception was raised by the codec.
3175\end{cfuncdesc}
3176
3177% --- Latin-1 Codecs -----------------------------------------------------
3178
3179These are the Latin-1 codec APIs:
3180
3181Latin-1 corresponds to the first 256 Unicode ordinals and only these
3182are accepted by the codecs during encoding.
3183
3184\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeLatin1}{const char *s,
Fred Drake1d158692000-06-18 05:21:21 +00003185 int size,
3186 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003187Creates a Unicode object by decoding \var{size} bytes of the Latin-1
3188encoded string \var{s}. Returns \NULL{} in case an exception was
3189raised by the codec.
3190\end{cfuncdesc}
3191
3192\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeLatin1}{const Py_UNICODE *s,
Fred Drake1d158692000-06-18 05:21:21 +00003193 int size,
3194 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003195Encodes the \ctype{Py_UNICODE} buffer of the given size using Latin-1
3196and returns a Python string object. Returns \NULL{} in case an
3197exception was raised by the codec.
3198\end{cfuncdesc}
3199
3200\begin{cfuncdesc}{PyObject*}{PyUnicode_AsLatin1String}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00003201Encodes a Unicode objects using Latin-1 and returns the result as
3202Python string object. Error handling is ``strict''. Returns
3203\NULL{} in case an exception was raised by the codec.
3204\end{cfuncdesc}
3205
3206% --- ASCII Codecs -------------------------------------------------------
3207
Fred Drake1d158692000-06-18 05:21:21 +00003208These are the \ASCII{} codec APIs. Only 7-bit \ASCII{} data is
3209accepted. All other codes generate errors.
Fred Drakea4cd2612000-04-06 14:10:29 +00003210
3211\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeASCII}{const char *s,
Fred Drake1d158692000-06-18 05:21:21 +00003212 int size,
3213 const char *errors}
3214Creates a Unicode object by decoding \var{size} bytes of the
3215\ASCII{} encoded string \var{s}. Returns \NULL{} in case an exception
3216was raised by the codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00003217\end{cfuncdesc}
3218
3219\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeASCII}{const Py_UNICODE *s,
Fred Drake1d158692000-06-18 05:21:21 +00003220 int size,
3221 const char *errors}
3222Encodes the \ctype{Py_UNICODE} buffer of the given size using
3223\ASCII{} and returns a Python string object. Returns \NULL{} in case
3224an exception was raised by the codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00003225\end{cfuncdesc}
3226
3227\begin{cfuncdesc}{PyObject*}{PyUnicode_AsASCIIString}{PyObject *unicode}
Fred Drake1d158692000-06-18 05:21:21 +00003228Encodes a Unicode objects using \ASCII{} and returns the result as Python
Fred Drakea4cd2612000-04-06 14:10:29 +00003229string object. Error handling is ``strict''. Returns
3230\NULL{} in case an exception was raised by the codec.
3231\end{cfuncdesc}
3232
3233% --- Character Map Codecs -----------------------------------------------
3234
3235These are the mapping codec APIs:
3236
3237This codec is special in that it can be used to implement many
3238different codecs (and this is in fact what was done to obtain most of
3239the standard codecs included in the \module{encodings} package). The
3240codec uses mapping to encode and decode characters.
3241
3242Decoding mappings must map single string characters to single Unicode
3243characters, integers (which are then interpreted as Unicode ordinals)
3244or None (meaning "undefined mapping" and causing an error).
3245
3246Encoding mappings must map single Unicode characters to single string
3247characters, integers (which are then interpreted as Latin-1 ordinals)
3248or None (meaning "undefined mapping" and causing an error).
3249
3250The mapping objects provided must only support the __getitem__ mapping
3251interface.
3252
3253If a character lookup fails with a LookupError, the character is
3254copied as-is meaning that its ordinal value will be interpreted as
3255Unicode or Latin-1 ordinal resp. Because of this, mappings only need
3256to contain those mappings which map characters to different code
3257points.
3258
3259\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeCharmap}{const char *s,
3260 int size,
3261 PyObject *mapping,
3262 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003263Creates a Unicode object by decoding \var{size} bytes of the encoded
3264string \var{s} using the given \var{mapping} object. Returns \NULL{}
3265in case an exception was raised by the codec.
3266\end{cfuncdesc}
3267
3268\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeCharmap}{const Py_UNICODE *s,
3269 int size,
3270 PyObject *mapping,
3271 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003272Encodes the \ctype{Py_UNICODE} buffer of the given size using the
3273given \var{mapping} object and returns a Python string object.
3274Returns \NULL{} in case an exception was raised by the codec.
3275\end{cfuncdesc}
3276
3277\begin{cfuncdesc}{PyObject*}{PyUnicode_AsCharmapString}{PyObject *unicode,
3278 PyObject *mapping}
Fred Drakea4cd2612000-04-06 14:10:29 +00003279Encodes a Unicode objects using the given \var{mapping} object and
3280returns the result as Python string object. Error handling is
3281``strict''. Returns \NULL{} in case an exception was raised by the
3282codec.
3283\end{cfuncdesc}
3284
3285The following codec API is special in that maps Unicode to Unicode.
3286
3287\begin{cfuncdesc}{PyObject*}{PyUnicode_TranslateCharmap}{const Py_UNICODE *s,
3288 int size,
3289 PyObject *table,
3290 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003291Translates a \ctype{Py_UNICODE} buffer of the given length by applying
3292a character mapping \var{table} to it and returns the resulting
Fred Drake1d158692000-06-18 05:21:21 +00003293Unicode object. Returns \NULL{} when an exception was raised by the
3294codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00003295
3296The \var{mapping} table must map Unicode ordinal integers to Unicode
3297ordinal integers or None (causing deletion of the character).
3298
3299Mapping tables must only provide the __getitem__ interface,
3300e.g. dictionaries or sequences. Unmapped character ordinals (ones
3301which cause a LookupError) are left untouched and are copied as-is.
Fred Drakea4cd2612000-04-06 14:10:29 +00003302\end{cfuncdesc}
3303
3304% --- MBCS codecs for Windows --------------------------------------------
3305
Fred Drake1d158692000-06-18 05:21:21 +00003306These are the MBCS codec APIs. They are currently only available on
Fred Drakea4cd2612000-04-06 14:10:29 +00003307Windows and use the Win32 MBCS converters to implement the
Fred Drake1d158692000-06-18 05:21:21 +00003308conversions. Note that MBCS (or DBCS) is a class of encodings, not
3309just one. The target encoding is defined by the user settings on the
3310machine running the codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00003311
3312\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeMBCS}{const char *s,
3313 int size,
3314 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003315Creates a Unicode object by decoding \var{size} bytes of the MBCS
Fred Drake1d158692000-06-18 05:21:21 +00003316encoded string \var{s}. Returns \NULL{} in case an exception was
Fred Drakea4cd2612000-04-06 14:10:29 +00003317raised by the codec.
3318\end{cfuncdesc}
3319
3320\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeMBCS}{const Py_UNICODE *s,
3321 int size,
3322 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003323Encodes the \ctype{Py_UNICODE} buffer of the given size using MBCS
3324and returns a Python string object. Returns \NULL{} in case an
3325exception was raised by the codec.
3326\end{cfuncdesc}
3327
3328\begin{cfuncdesc}{PyObject*}{PyUnicode_AsMBCSString}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00003329Encodes a Unicode objects using MBCS and returns the result as Python
Fred Drake1d158692000-06-18 05:21:21 +00003330string object. Error handling is ``strict''. Returns \NULL{} in case
3331an exception was raised by the codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00003332\end{cfuncdesc}
3333
3334% --- Methods & Slots ----------------------------------------------------
3335
3336\subsubsection{Methods and Slot Functions \label{unicodeMethodsAndSlots}}
3337
3338The following APIs are capable of handling Unicode objects and strings
3339on input (we refer to them as strings in the descriptions) and return
3340Unicode objects or integers as apporpriate.
3341
3342They all return \NULL{} or -1 in case an exception occurrs.
3343
3344\begin{cfuncdesc}{PyObject*}{PyUnicode_Concat}{PyObject *left,
3345 PyObject *right}
Fred Drakea4cd2612000-04-06 14:10:29 +00003346Concat two strings giving a new Unicode string.
3347\end{cfuncdesc}
3348
3349\begin{cfuncdesc}{PyObject*}{PyUnicode_Split}{PyObject *s,
3350 PyObject *sep,
3351 int maxsplit}
Fred Drakea4cd2612000-04-06 14:10:29 +00003352Split a string giving a list of Unicode strings.
3353
3354If sep is NULL, splitting will be done at all whitespace
3355substrings. Otherwise, splits occur at the given separator.
3356
3357At most maxsplit splits will be done. If negative, no limit is set.
3358
3359Separators are not included in the resulting list.
3360\end{cfuncdesc}
3361
3362\begin{cfuncdesc}{PyObject*}{PyUnicode_Splitlines}{PyObject *s,
3363 int maxsplit}
Fred Drake1d158692000-06-18 05:21:21 +00003364Split a Unicode string at line breaks, returning a list of Unicode
3365strings. CRLF is considered to be one line break. The Line break
3366characters are not included in the resulting strings.
Fred Drakea4cd2612000-04-06 14:10:29 +00003367\end{cfuncdesc}
3368
3369\begin{cfuncdesc}{PyObject*}{PyUnicode_Translate}{PyObject *str,
3370 PyObject *table,
3371 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003372Translate a string by applying a character mapping table to it and
3373return the resulting Unicode object.
3374
3375The mapping table must map Unicode ordinal integers to Unicode ordinal
3376integers or None (causing deletion of the character).
3377
3378Mapping tables must only provide the __getitem__ interface,
3379e.g. dictionaries or sequences. Unmapped character ordinals (ones
3380which cause a LookupError) are left untouched and are copied as-is.
3381
3382\var{errors} has the usual meaning for codecs. It may be \NULL{}
3383which indicates to use the default error handling.
Fred Drakea4cd2612000-04-06 14:10:29 +00003384\end{cfuncdesc}
3385
3386\begin{cfuncdesc}{PyObject*}{PyUnicode_Join}{PyObject *separator,
3387 PyObject *seq}
Fred Drakea4cd2612000-04-06 14:10:29 +00003388Join a sequence of strings using the given separator and return
3389the resulting Unicode string.
3390\end{cfuncdesc}
3391
3392\begin{cfuncdesc}{PyObject*}{PyUnicode_Tailmatch}{PyObject *str,
3393 PyObject *substr,
3394 int start,
3395 int end,
3396 int direction}
Fred Drakea4cd2612000-04-06 14:10:29 +00003397Return 1 if \var{substr} matches \var{str}[\var{start}:\var{end}] at
3398the given tail end (\var{direction} == -1 means to do a prefix match,
3399\var{direction} == 1 a suffix match), 0 otherwise.
3400\end{cfuncdesc}
3401
3402\begin{cfuncdesc}{PyObject*}{PyUnicode_Find}{PyObject *str,
3403 PyObject *substr,
3404 int start,
3405 int end,
3406 int direction}
Fred Drakea4cd2612000-04-06 14:10:29 +00003407Return the first position of \var{substr} in
3408\var{str}[\var{start}:\var{end}] using the given \var{direction}
3409(\var{direction} == 1 means to do a forward search,
3410\var{direction} == -1 a backward search), 0 otherwise.
3411\end{cfuncdesc}
3412
3413\begin{cfuncdesc}{PyObject*}{PyUnicode_Count}{PyObject *str,
3414 PyObject *substr,
3415 int start,
3416 int end}
Fred Drakea4cd2612000-04-06 14:10:29 +00003417Count the number of occurrences of \var{substr} in
3418\var{str}[\var{start}:\var{end}]
3419\end{cfuncdesc}
3420
3421\begin{cfuncdesc}{PyObject*}{PyUnicode_Replace}{PyObject *str,
3422 PyObject *substr,
3423 PyObject *replstr,
3424 int maxcount}
Fred Drakea4cd2612000-04-06 14:10:29 +00003425Replace at most \var{maxcount} occurrences of \var{substr} in
3426\var{str} with \var{replstr} and return the resulting Unicode object.
3427\var{maxcount} == -1 means: replace all occurrences.
3428\end{cfuncdesc}
3429
Fred Drake1d158692000-06-18 05:21:21 +00003430\begin{cfuncdesc}{int}{PyUnicode_Compare}{PyObject *left, PyObject *right}
Fred Drakea4cd2612000-04-06 14:10:29 +00003431Compare two strings and return -1, 0, 1 for less than, equal,
3432greater than resp.
3433\end{cfuncdesc}
3434
3435\begin{cfuncdesc}{PyObject*}{PyUnicode_Format}{PyObject *format,
3436 PyObject *args}
Fred Drake1d158692000-06-18 05:21:21 +00003437Returns a new string object from \var{format} and \var{args}; this is
3438analogous to \code{\var{format} \%\ \var{args}}. The
3439\var{args} argument must be a tuple.
Fred Drakea4cd2612000-04-06 14:10:29 +00003440\end{cfuncdesc}
3441
3442\begin{cfuncdesc}{int}{PyUnicode_Contains}{PyObject *container,
3443 PyObject *element}
Fred Drakea4cd2612000-04-06 14:10:29 +00003444Checks whether \var{element} is contained in \var{container} and
Fred Drake1d158692000-06-18 05:21:21 +00003445returns true or false accordingly.
Fred Drakea4cd2612000-04-06 14:10:29 +00003446
Fred Drake1d158692000-06-18 05:21:21 +00003447\var{element} has to coerce to a one element Unicode string. \code{-1} is
Fred Drakea4cd2612000-04-06 14:10:29 +00003448returned in case of an error.
3449\end{cfuncdesc}
3450
3451
Fred Drake58c5a2a1999-08-04 13:13:24 +00003452\subsection{Buffer Objects \label{bufferObjects}}
Fred Drake659ebfa2000-04-03 15:42:13 +00003453\sectionauthor{Greg Stein}{gstein@lyra.org}
Fred Drake58c5a2a1999-08-04 13:13:24 +00003454
Fred Drake659ebfa2000-04-03 15:42:13 +00003455\obindex{buffer}
3456Python objects implemented in C can export a group of functions called
3457the ``buffer\index{buffer interface} interface.'' These functions can
3458be used by an object to expose its data in a raw, byte-oriented
3459format. Clients of the object can use the buffer interface to access
3460the object data directly, without needing to copy it first.
3461
3462Two examples of objects that support
3463the buffer interface are strings and arrays. The string object exposes
3464the character contents in the buffer interface's byte-oriented
3465form. An array can also expose its contents, but it should be noted
3466that array elements may be multi-byte values.
3467
3468An example user of the buffer interface is the file object's
3469\method{write()} method. Any object that can export a series of bytes
3470through the buffer interface can be written to a file. There are a
Fred Drake88fdaa72001-07-20 20:56:11 +00003471number of format codes to \cfunction{PyArg_ParseTuple()} that operate
Fred Drake659ebfa2000-04-03 15:42:13 +00003472against an object's buffer interface, returning data from the target
3473object.
3474
3475More information on the buffer interface is provided in the section
3476``Buffer Object Structures'' (section \ref{buffer-structs}), under
3477the description for \ctype{PyBufferProcs}\ttindex{PyBufferProcs}.
3478
3479A ``buffer object'' is defined in the \file{bufferobject.h} header
3480(included by \file{Python.h}). These objects look very similar to
3481string objects at the Python programming level: they support slicing,
3482indexing, concatenation, and some other standard string
3483operations. However, their data can come from one of two sources: from
3484a block of memory, or from another object which exports the buffer
3485interface.
3486
3487Buffer objects are useful as a way to expose the data from another
3488object's buffer interface to the Python programmer. They can also be
3489used as a zero-copy slicing mechanism. Using their ability to
3490reference a block of memory, it is possible to expose any data to the
3491Python programmer quite easily. The memory could be a large, constant
3492array in a C extension, it could be a raw block of memory for
3493manipulation before passing to an operating system library, or it
3494could be used to pass around structured data in its native, in-memory
3495format.
3496
3497\begin{ctypedesc}{PyBufferObject}
3498This subtype of \ctype{PyObject} represents a buffer object.
3499\end{ctypedesc}
Fred Drake58c5a2a1999-08-04 13:13:24 +00003500
3501\begin{cvardesc}{PyTypeObject}{PyBuffer_Type}
3502The instance of \ctype{PyTypeObject} which represents the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00003503buffer type; it is the same object as \code{types.BufferType} in the
3504Python layer.\withsubitem{(in module types)}{\ttindex{BufferType}}.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003505\end{cvardesc}
3506
3507\begin{cvardesc}{int}{Py_END_OF_BUFFER}
Fred Drake659ebfa2000-04-03 15:42:13 +00003508This constant may be passed as the \var{size} parameter to
3509\cfunction{PyBuffer_FromObject()} or
3510\cfunction{PyBuffer_FromReadWriteObject()}. It indicates that the new
3511\ctype{PyBufferObject} should refer to \var{base} object from the
3512specified \var{offset} to the end of its exported buffer. Using this
3513enables the caller to avoid querying the \var{base} object for its
3514length.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003515\end{cvardesc}
3516
3517\begin{cfuncdesc}{int}{PyBuffer_Check}{PyObject *p}
3518Return true if the argument has type \cdata{PyBuffer_Type}.
3519\end{cfuncdesc}
3520
3521\begin{cfuncdesc}{PyObject*}{PyBuffer_FromObject}{PyObject *base,
3522 int offset, int size}
Fred Drake659ebfa2000-04-03 15:42:13 +00003523Return a new read-only buffer object. This raises
3524\exception{TypeError} if \var{base} doesn't support the read-only
3525buffer protocol or doesn't provide exactly one buffer segment, or it
3526raises \exception{ValueError} if \var{offset} is less than zero. The
3527buffer will hold a reference to the \var{base} object, and the
3528buffer's contents will refer to the \var{base} object's buffer
3529interface, starting as position \var{offset} and extending for
3530\var{size} bytes. If \var{size} is \constant{Py_END_OF_BUFFER}, then
3531the new buffer's contents extend to the length of the
3532\var{base} object's exported buffer data.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003533\end{cfuncdesc}
3534
3535\begin{cfuncdesc}{PyObject*}{PyBuffer_FromReadWriteObject}{PyObject *base,
3536 int offset,
3537 int size}
3538Return a new writable buffer object. Parameters and exceptions are
3539similar to those for \cfunction{PyBuffer_FromObject()}.
Fred Drake659ebfa2000-04-03 15:42:13 +00003540If the \var{base} object does not export the writeable buffer
3541protocol, then \exception{TypeError} is raised.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003542\end{cfuncdesc}
3543
3544\begin{cfuncdesc}{PyObject*}{PyBuffer_FromMemory}{void *ptr, int size}
Fred Drake659ebfa2000-04-03 15:42:13 +00003545Return a new read-only buffer object that reads from a specified
3546location in memory, with a specified size.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003547The caller is responsible for ensuring that the memory buffer, passed
3548in as \var{ptr}, is not deallocated while the returned buffer object
3549exists. Raises \exception{ValueError} if \var{size} is less than
Fred Drake659ebfa2000-04-03 15:42:13 +00003550zero. Note that \constant{Py_END_OF_BUFFER} may \emph{not} be passed
3551for the \var{size} parameter; \exception{ValueError} will be raised in
3552that case.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003553\end{cfuncdesc}
3554
3555\begin{cfuncdesc}{PyObject*}{PyBuffer_FromReadWriteMemory}{void *ptr, int size}
Fred Drake659ebfa2000-04-03 15:42:13 +00003556Similar to \cfunction{PyBuffer_FromMemory()}, but the returned buffer
3557is writable.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003558\end{cfuncdesc}
3559
3560\begin{cfuncdesc}{PyObject*}{PyBuffer_New}{int size}
3561Returns a new writable buffer object that maintains its own memory
Fred Drake659ebfa2000-04-03 15:42:13 +00003562buffer of \var{size} bytes. \exception{ValueError} is returned if
3563\var{size} is not zero or positive.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003564\end{cfuncdesc}
3565
Guido van Rossum44475131998-04-21 15:30:01 +00003566
Fred Drakeefd146c1999-02-15 15:30:45 +00003567\subsection{Tuple Objects \label{tupleObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003568
Fred Drake659ebfa2000-04-03 15:42:13 +00003569\obindex{tuple}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003570\begin{ctypedesc}{PyTupleObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003571This subtype of \ctype{PyObject} represents a Python tuple object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003572\end{ctypedesc}
3573
3574\begin{cvardesc}{PyTypeObject}{PyTuple_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00003575This instance of \ctype{PyTypeObject} represents the Python tuple
3576type; it is the same object as \code{types.TupleType} in the Python
3577layer.\withsubitem{(in module types)}{\ttindex{TupleType}}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003578\end{cvardesc}
3579
3580\begin{cfuncdesc}{int}{PyTuple_Check}{PyObject *p}
3581Return true if the argument is a tuple object.
3582\end{cfuncdesc}
3583
Fred Drake659ebfa2000-04-03 15:42:13 +00003584\begin{cfuncdesc}{PyObject*}{PyTuple_New}{int len}
3585Return a new tuple object of size \var{len}, or \NULL{} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003586\end{cfuncdesc}
3587
Fred Drakea05460c2001-02-12 17:38:18 +00003588\begin{cfuncdesc}{int}{PyTuple_Size}{PyObject *p}
Fred Drakee058b4f1998-02-16 06:15:35 +00003589Takes a pointer to a tuple object, and returns the size
Fred Drakee5bf8b21998-02-12 21:22:28 +00003590of that tuple.
3591\end{cfuncdesc}
3592
Fred Drakea05460c2001-02-12 17:38:18 +00003593\begin{cfuncdesc}{PyObject*}{PyTuple_GetItem}{PyObject *p, int pos}
Fred Drakee058b4f1998-02-16 06:15:35 +00003594Returns the object at position \var{pos} in the tuple pointed
3595to by \var{p}. If \var{pos} is out of bounds, returns \NULL{} and
Fred Drake659ebfa2000-04-03 15:42:13 +00003596sets an \exception{IndexError} exception.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003597\end{cfuncdesc}
3598
Fred Drakea05460c2001-02-12 17:38:18 +00003599\begin{cfuncdesc}{PyObject*}{PyTuple_GET_ITEM}{PyObject *p, int pos}
Fred Drakefac312f2001-05-29 15:13:00 +00003600Like \cfunction{PyTuple_GetItem()}, but does no checking of its
3601arguments.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003602\end{cfuncdesc}
3603
Fred Drakea05460c2001-02-12 17:38:18 +00003604\begin{cfuncdesc}{PyObject*}{PyTuple_GetSlice}{PyObject *p,
3605 int low, int high}
Fred Drakee058b4f1998-02-16 06:15:35 +00003606Takes a slice of the tuple pointed to by \var{p} from
3607\var{low} to \var{high} and returns it as a new tuple.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003608\end{cfuncdesc}
3609
Fred Drake659ebfa2000-04-03 15:42:13 +00003610\begin{cfuncdesc}{int}{PyTuple_SetItem}{PyObject *p,
3611 int pos, PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00003612Inserts a reference to object \var{o} at position \var{pos} of
3613the tuple pointed to by \var{p}. It returns \code{0} on success.
Fred Drake659ebfa2000-04-03 15:42:13 +00003614\strong{Note:} This function ``steals'' a reference to \var{o}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003615\end{cfuncdesc}
3616
Fred Drake659ebfa2000-04-03 15:42:13 +00003617\begin{cfuncdesc}{void}{PyTuple_SET_ITEM}{PyObject *p,
3618 int pos, PyObject *o}
Fred Drakefac312f2001-05-29 15:13:00 +00003619Like \cfunction{PyTuple_SetItem()}, but does no error checking, and
Fred Drakee5bf8b21998-02-12 21:22:28 +00003620should \emph{only} be used to fill in brand new tuples.
Fred Drake659ebfa2000-04-03 15:42:13 +00003621\strong{Note:} This function ``steals'' a reference to \var{o}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003622\end{cfuncdesc}
3623
Fred Drakefac312f2001-05-29 15:13:00 +00003624\begin{cfuncdesc}{int}{_PyTuple_Resize}{PyObject **p, int newsize}
Fred Drake659ebfa2000-04-03 15:42:13 +00003625Can be used to resize a tuple. \var{newsize} will be the new length
3626of the tuple. Because tuples are \emph{supposed} to be immutable,
3627this should only be used if there is only one reference to the object.
3628Do \emph{not} use this if the tuple may already be known to some other
Fred Drakefac312f2001-05-29 15:13:00 +00003629part of the code. The tuple will always grow or shrink at the end.
3630Think of this as destroying the old tuple and creating a new one, only
3631more efficiently. Returns \code{0} on success. Client code should
3632never assume that the resulting value of \code{*\var{p}} will be the
3633same as before calling this function. If the object referenced by
3634\code{*\var{p}} is replaced, the original \code{*\var{p}} is
3635destroyed. On failure, returns \code{-1} and sets \code{*\var{p}} to
3636\NULL, and raises \exception{MemoryError} or \exception{SystemError}.
3637\versionchanged[Removed unused third parameter, \var{last_is_sticky}]{2.2}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003638\end{cfuncdesc}
3639
3640
Fred Drakeefd146c1999-02-15 15:30:45 +00003641\subsection{List Objects \label{listObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003642
Fred Drake659ebfa2000-04-03 15:42:13 +00003643\obindex{list}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003644\begin{ctypedesc}{PyListObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003645This subtype of \ctype{PyObject} represents a Python list object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003646\end{ctypedesc}
3647
3648\begin{cvardesc}{PyTypeObject}{PyList_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00003649This instance of \ctype{PyTypeObject} represents the Python list
3650type. This is the same object as \code{types.ListType}.
3651\withsubitem{(in module types)}{\ttindex{ListType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003652\end{cvardesc}
3653
3654\begin{cfuncdesc}{int}{PyList_Check}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003655Returns true if its argument is a \ctype{PyListObject}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003656\end{cfuncdesc}
3657
Fred Drake659ebfa2000-04-03 15:42:13 +00003658\begin{cfuncdesc}{PyObject*}{PyList_New}{int len}
3659Returns a new list of length \var{len} on success, or \NULL{} on
Guido van Rossum3c4378b1998-04-14 20:21:10 +00003660failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003661\end{cfuncdesc}
3662
Fred Drakec6fa34e1998-04-02 06:47:24 +00003663\begin{cfuncdesc}{int}{PyList_Size}{PyObject *list}
Fred Drake659ebfa2000-04-03 15:42:13 +00003664Returns the length of the list object in \var{list}; this is
3665equivalent to \samp{len(\var{list})} on a list object.
3666\bifuncindex{len}
3667\end{cfuncdesc}
3668
3669\begin{cfuncdesc}{int}{PyList_GET_SIZE}{PyObject *list}
Fred Drake5d644212000-10-07 12:31:50 +00003670Macro form of \cfunction{PyList_Size()} without error checking.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003671\end{cfuncdesc}
3672
Fred Drakec6fa34e1998-04-02 06:47:24 +00003673\begin{cfuncdesc}{PyObject*}{PyList_GetItem}{PyObject *list, int index}
Guido van Rossum44475131998-04-21 15:30:01 +00003674Returns the object at position \var{pos} in the list pointed
3675to by \var{p}. If \var{pos} is out of bounds, returns \NULL{} and
Fred Drake659ebfa2000-04-03 15:42:13 +00003676sets an \exception{IndexError} exception.
3677\end{cfuncdesc}
3678
3679\begin{cfuncdesc}{PyObject*}{PyList_GET_ITEM}{PyObject *list, int i}
3680Macro form of \cfunction{PyList_GetItem()} without error checking.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003681\end{cfuncdesc}
3682
Fred Drakec6fa34e1998-04-02 06:47:24 +00003683\begin{cfuncdesc}{int}{PyList_SetItem}{PyObject *list, int index,
3684 PyObject *item}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00003685Sets the item at index \var{index} in list to \var{item}.
Fred Drakebab29652001-07-10 16:10:08 +00003686Returns \code{0} on success or \code{-1} on failure.
Fred Drake00d0cb62001-06-03 03:12:57 +00003687\strong{Note:} This function ``steals'' a reference to \var{item} and
3688discards a reference to an item already in the list at the affected
3689position.
Fred Drake659ebfa2000-04-03 15:42:13 +00003690\end{cfuncdesc}
3691
Fred Drakebab29652001-07-10 16:10:08 +00003692\begin{cfuncdesc}{void}{PyList_SET_ITEM}{PyObject *list, int i,
Fred Drake659ebfa2000-04-03 15:42:13 +00003693 PyObject *o}
3694Macro form of \cfunction{PyList_SetItem()} without error checking.
Fred Drake00d0cb62001-06-03 03:12:57 +00003695\strong{Note:} This function ``steals'' a reference to \var{item},
3696and, unlike \cfunction{PyList_SetItem()}, does \emph{not} discard a
Fred Drakebab29652001-07-10 16:10:08 +00003697reference to any item that it being replaced; any reference in
3698\var{list} at position \var{i} will be leaked. This is normally only
3699used to fill in new lists where there is no previous content.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003700\end{cfuncdesc}
3701
Fred Drakec6fa34e1998-04-02 06:47:24 +00003702\begin{cfuncdesc}{int}{PyList_Insert}{PyObject *list, int index,
Guido van Rossum44475131998-04-21 15:30:01 +00003703 PyObject *item}
3704Inserts the item \var{item} into list \var{list} in front of index
Fred Drake659ebfa2000-04-03 15:42:13 +00003705\var{index}. Returns \code{0} if successful; returns \code{-1} and
3706raises an exception if unsuccessful. Analogous to
3707\code{\var{list}.insert(\var{index}, \var{item})}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003708\end{cfuncdesc}
3709
Fred Drakec6fa34e1998-04-02 06:47:24 +00003710\begin{cfuncdesc}{int}{PyList_Append}{PyObject *list, PyObject *item}
Guido van Rossum44475131998-04-21 15:30:01 +00003711Appends the object \var{item} at the end of list \var{list}. Returns
Fred Drake659ebfa2000-04-03 15:42:13 +00003712\code{0} if successful; returns \code{-1} and sets an exception if
3713unsuccessful. Analogous to \code{\var{list}.append(\var{item})}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003714\end{cfuncdesc}
3715
Fred Drakec6fa34e1998-04-02 06:47:24 +00003716\begin{cfuncdesc}{PyObject*}{PyList_GetSlice}{PyObject *list,
3717 int low, int high}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00003718Returns a list of the objects in \var{list} containing the objects
Guido van Rossum44475131998-04-21 15:30:01 +00003719\emph{between} \var{low} and \var{high}. Returns NULL and sets an
3720exception if unsuccessful.
Fred Drake659ebfa2000-04-03 15:42:13 +00003721Analogous to \code{\var{list}[\var{low}:\var{high}]}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003722\end{cfuncdesc}
3723
Fred Drakec6fa34e1998-04-02 06:47:24 +00003724\begin{cfuncdesc}{int}{PyList_SetSlice}{PyObject *list,
3725 int low, int high,
3726 PyObject *itemlist}
Fred Drake659ebfa2000-04-03 15:42:13 +00003727Sets the slice of \var{list} between \var{low} and \var{high} to the
3728contents of \var{itemlist}. Analogous to
3729\code{\var{list}[\var{low}:\var{high}] = \var{itemlist}}. Returns
3730\code{0} on success, \code{-1} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003731\end{cfuncdesc}
3732
Fred Drakec6fa34e1998-04-02 06:47:24 +00003733\begin{cfuncdesc}{int}{PyList_Sort}{PyObject *list}
Fred Drake659ebfa2000-04-03 15:42:13 +00003734Sorts the items of \var{list} in place. Returns \code{0} on success,
3735\code{-1} on failure. This is equivalent to
3736\samp{\var{list}.sort()}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003737\end{cfuncdesc}
3738
Fred Drakec6fa34e1998-04-02 06:47:24 +00003739\begin{cfuncdesc}{int}{PyList_Reverse}{PyObject *list}
Fred Drake659ebfa2000-04-03 15:42:13 +00003740Reverses the items of \var{list} in place. Returns \code{0} on
3741success, \code{-1} on failure. This is the equivalent of
3742\samp{\var{list}.reverse()}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003743\end{cfuncdesc}
3744
Fred Drakec6fa34e1998-04-02 06:47:24 +00003745\begin{cfuncdesc}{PyObject*}{PyList_AsTuple}{PyObject *list}
Fred Drake659ebfa2000-04-03 15:42:13 +00003746Returns a new tuple object containing the contents of \var{list};
3747equivalent to \samp{tuple(\var{list})}.\bifuncindex{tuple}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003748\end{cfuncdesc}
3749
3750
Fred Drakeefd146c1999-02-15 15:30:45 +00003751\section{Mapping Objects \label{mapObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003752
Fred Drake659ebfa2000-04-03 15:42:13 +00003753\obindex{mapping}
3754
3755
Fred Drakeefd146c1999-02-15 15:30:45 +00003756\subsection{Dictionary Objects \label{dictObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003757
Fred Drake659ebfa2000-04-03 15:42:13 +00003758\obindex{dictionary}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003759\begin{ctypedesc}{PyDictObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003760This subtype of \ctype{PyObject} represents a Python dictionary object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003761\end{ctypedesc}
3762
3763\begin{cvardesc}{PyTypeObject}{PyDict_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00003764This instance of \ctype{PyTypeObject} represents the Python dictionary
3765type. This is exposed to Python programs as \code{types.DictType} and
3766\code{types.DictionaryType}.
3767\withsubitem{(in module types)}{\ttindex{DictType}\ttindex{DictionaryType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003768\end{cvardesc}
3769
3770\begin{cfuncdesc}{int}{PyDict_Check}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003771Returns true if its argument is a \ctype{PyDictObject}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003772\end{cfuncdesc}
3773
Fred Drakec6fa34e1998-04-02 06:47:24 +00003774\begin{cfuncdesc}{PyObject*}{PyDict_New}{}
Fred Drake659ebfa2000-04-03 15:42:13 +00003775Returns a new empty dictionary, or \NULL{} on failure.
3776\end{cfuncdesc}
3777
3778\begin{cfuncdesc}{void}{PyDict_Clear}{PyObject *p}
3779Empties an existing dictionary of all key-value pairs.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003780\end{cfuncdesc}
3781
Jeremy Hyltona12c7a72000-03-30 22:27:31 +00003782\begin{cfuncdesc}{PyObject*}{PyDict_Copy}{PyObject *p}
Fred Drake659ebfa2000-04-03 15:42:13 +00003783Returns a new dictionary that contains the same key-value pairs as p.
3784Empties an existing dictionary of all key-value pairs.
Jeremy Hyltona12c7a72000-03-30 22:27:31 +00003785\end{cfuncdesc}
3786
Fred Drake659ebfa2000-04-03 15:42:13 +00003787\begin{cfuncdesc}{int}{PyDict_SetItem}{PyObject *p, PyObject *key,
3788 PyObject *val}
Fred Drakebab29652001-07-10 16:10:08 +00003789Inserts \var{value} into the dictionary \var{p} with a key of \var{key}.
Fred Drake659ebfa2000-04-03 15:42:13 +00003790\var{key} must be hashable; if it isn't, \exception{TypeError} will be
3791raised.
Fred Drakebab29652001-07-10 16:10:08 +00003792Returns \code{0} on success or \code{-1} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003793\end{cfuncdesc}
3794
Fred Drake83e01bf2001-03-16 15:41:29 +00003795\begin{cfuncdesc}{int}{PyDict_SetItemString}{PyObject *p,
Fred Drakee5bf8b21998-02-12 21:22:28 +00003796 char *key,
3797 PyObject *val}
Fred Drakebab29652001-07-10 16:10:08 +00003798Inserts \var{value} into the dictionary \var{p} using \var{key}
Fred Drake1d158692000-06-18 05:21:21 +00003799as a key. \var{key} should be a \ctype{char*}. The key object is
Fred Drakee058b4f1998-02-16 06:15:35 +00003800created using \code{PyString_FromString(\var{key})}.
Fred Drakebab29652001-07-10 16:10:08 +00003801Returns \code{0} on success or \code{-1} on failure.
Fred Drake659ebfa2000-04-03 15:42:13 +00003802\ttindex{PyString_FromString()}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003803\end{cfuncdesc}
3804
Fred Drake659ebfa2000-04-03 15:42:13 +00003805\begin{cfuncdesc}{int}{PyDict_DelItem}{PyObject *p, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00003806Removes the entry in dictionary \var{p} with key \var{key}.
Fred Drake659ebfa2000-04-03 15:42:13 +00003807\var{key} must be hashable; if it isn't, \exception{TypeError} is
3808raised.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003809\end{cfuncdesc}
3810
Fred Drake659ebfa2000-04-03 15:42:13 +00003811\begin{cfuncdesc}{int}{PyDict_DelItemString}{PyObject *p, char *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00003812Removes the entry in dictionary \var{p} which has a key
Fred Drake659ebfa2000-04-03 15:42:13 +00003813specified by the string \var{key}.
Fred Drakebab29652001-07-10 16:10:08 +00003814Returns \code{0} on success or \code{-1} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003815\end{cfuncdesc}
3816
Fred Drake659ebfa2000-04-03 15:42:13 +00003817\begin{cfuncdesc}{PyObject*}{PyDict_GetItem}{PyObject *p, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00003818Returns the object from dictionary \var{p} which has a key
Guido van Rossum44475131998-04-21 15:30:01 +00003819\var{key}. Returns \NULL{} if the key \var{key} is not present, but
Fred Drake659ebfa2000-04-03 15:42:13 +00003820\emph{without} setting an exception.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003821\end{cfuncdesc}
3822
Fred Drake659ebfa2000-04-03 15:42:13 +00003823\begin{cfuncdesc}{PyObject*}{PyDict_GetItemString}{PyObject *p, char *key}
Fred Drakef8830d11998-04-23 14:06:01 +00003824This is the same as \cfunction{PyDict_GetItem()}, but \var{key} is
Fred Drake659ebfa2000-04-03 15:42:13 +00003825specified as a \ctype{char*}, rather than a \ctype{PyObject*}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003826\end{cfuncdesc}
3827
Fred Drake659ebfa2000-04-03 15:42:13 +00003828\begin{cfuncdesc}{PyObject*}{PyDict_Items}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003829Returns a \ctype{PyListObject} containing all the items
Guido van Rossum44475131998-04-21 15:30:01 +00003830from the dictionary, as in the dictinoary method \method{items()} (see
Fred Drakebe486461999-11-09 17:03:03 +00003831the \citetitle[../lib/lib.html]{Python Library Reference}).
Fred Drakee5bf8b21998-02-12 21:22:28 +00003832\end{cfuncdesc}
3833
Fred Drake659ebfa2000-04-03 15:42:13 +00003834\begin{cfuncdesc}{PyObject*}{PyDict_Keys}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003835Returns a \ctype{PyListObject} containing all the keys
Guido van Rossum44475131998-04-21 15:30:01 +00003836from the dictionary, as in the dictionary method \method{keys()} (see the
Fred Drakebe486461999-11-09 17:03:03 +00003837\citetitle[../lib/lib.html]{Python Library Reference}).
Fred Drakee5bf8b21998-02-12 21:22:28 +00003838\end{cfuncdesc}
3839
Fred Drake659ebfa2000-04-03 15:42:13 +00003840\begin{cfuncdesc}{PyObject*}{PyDict_Values}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003841Returns a \ctype{PyListObject} containing all the values
Guido van Rossum44475131998-04-21 15:30:01 +00003842from the dictionary \var{p}, as in the dictionary method
Fred Drakebe486461999-11-09 17:03:03 +00003843\method{values()} (see the \citetitle[../lib/lib.html]{Python Library
3844Reference}).
Fred Drakee5bf8b21998-02-12 21:22:28 +00003845\end{cfuncdesc}
3846
Fred Drake659ebfa2000-04-03 15:42:13 +00003847\begin{cfuncdesc}{int}{PyDict_Size}{PyObject *p}
3848Returns the number of items in the dictionary. This is equivalent to
3849\samp{len(\var{p})} on a dictionary.\bifuncindex{len}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003850\end{cfuncdesc}
3851
Fred Drake83e01bf2001-03-16 15:41:29 +00003852\begin{cfuncdesc}{int}{PyDict_Next}{PyObject *p, int *ppos,
Fred Drake7d45d342000-08-11 17:07:32 +00003853 PyObject **pkey, PyObject **pvalue}
Fred Drake83e01bf2001-03-16 15:41:29 +00003854Iterate over all key-value pairs in the dictionary \var{p}. The
3855\ctype{int} referred to by \var{ppos} must be initialized to \code{0}
3856prior to the first call to this function to start the iteration; the
3857function returns true for each pair in the dictionary, and false once
3858all pairs have been reported. The parameters \var{pkey} and
3859\var{pvalue} should either point to \ctype{PyObject*} variables that
3860will be filled in with each key and value, respectively, or may be
Fred Drake8d00a0f2001-04-13 17:55:02 +00003861\NULL.
3862
Fred Drake83e01bf2001-03-16 15:41:29 +00003863For example:
Fred Drakee5bf8b21998-02-12 21:22:28 +00003864
Fred Drake83e01bf2001-03-16 15:41:29 +00003865\begin{verbatim}
3866PyObject *key, *value;
3867int pos = 0;
3868
3869while (PyDict_Next(self->dict, &pos, &key, &value)) {
3870 /* do something interesting with the values... */
3871 ...
3872}
3873\end{verbatim}
Fred Drake8d00a0f2001-04-13 17:55:02 +00003874
3875The dictionary \var{p} should not be mutated during iteration. It is
3876safe (since Python 2.1) to modify the values of the keys as you
3877iterate over the dictionary, for example:
3878
3879\begin{verbatim}
3880PyObject *key, *value;
3881int pos = 0;
3882
3883while (PyDict_Next(self->dict, &pos, &key, &value)) {
3884 int i = PyInt_AS_LONG(value) + 1;
3885 PyObject *o = PyInt_FromLong(i);
3886 if (o == NULL)
3887 return -1;
3888 if (PyDict_SetItem(self->dict, key, o) < 0) {
3889 Py_DECREF(o);
3890 return -1;
3891 }
3892 Py_DECREF(o);
3893}
3894\end{verbatim}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003895\end{cfuncdesc}
3896
3897
Fred Drakeefd146c1999-02-15 15:30:45 +00003898\section{Other Objects \label{otherObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003899
Fred Drakeefd146c1999-02-15 15:30:45 +00003900\subsection{File Objects \label{fileObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003901
Fred Drake659ebfa2000-04-03 15:42:13 +00003902\obindex{file}
3903Python's built-in file objects are implemented entirely on the
3904\ctype{FILE*} support from the C standard library. This is an
3905implementation detail and may change in future releases of Python.
3906
Fred Drakee5bf8b21998-02-12 21:22:28 +00003907\begin{ctypedesc}{PyFileObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003908This subtype of \ctype{PyObject} represents a Python file object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003909\end{ctypedesc}
3910
3911\begin{cvardesc}{PyTypeObject}{PyFile_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00003912This instance of \ctype{PyTypeObject} represents the Python file
3913type. This is exposed to Python programs as \code{types.FileType}.
3914\withsubitem{(in module types)}{\ttindex{FileType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003915\end{cvardesc}
3916
3917\begin{cfuncdesc}{int}{PyFile_Check}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003918Returns true if its argument is a \ctype{PyFileObject}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003919\end{cfuncdesc}
3920
Fred Drake659ebfa2000-04-03 15:42:13 +00003921\begin{cfuncdesc}{PyObject*}{PyFile_FromString}{char *filename, char *mode}
3922On success, returns a new file object that is opened on the
3923file given by \var{filename}, with a file mode given by \var{mode},
3924where \var{mode} has the same semantics as the standard C routine
3925\cfunction{fopen()}\ttindex{fopen()}. On failure, returns \NULL.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003926\end{cfuncdesc}
3927
Fred Drakec6fa34e1998-04-02 06:47:24 +00003928\begin{cfuncdesc}{PyObject*}{PyFile_FromFile}{FILE *fp,
Fred Drake659ebfa2000-04-03 15:42:13 +00003929 char *name, char *mode,
3930 int (*close)(FILE*)}
3931Creates a new \ctype{PyFileObject} from the already-open standard C
3932file pointer, \var{fp}. The function \var{close} will be called when
3933the file should be closed. Returns \NULL{} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003934\end{cfuncdesc}
3935
Fred Drake659ebfa2000-04-03 15:42:13 +00003936\begin{cfuncdesc}{FILE*}{PyFile_AsFile}{PyFileObject *p}
3937Returns the file object associated with \var{p} as a \ctype{FILE*}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003938\end{cfuncdesc}
3939
Fred Drakec6fa34e1998-04-02 06:47:24 +00003940\begin{cfuncdesc}{PyObject*}{PyFile_GetLine}{PyObject *p, int n}
Fred Drake659ebfa2000-04-03 15:42:13 +00003941Equivalent to \code{\var{p}.readline(\optional{\var{n}})}, this
3942function reads one line from the object \var{p}. \var{p} may be a
3943file object or any object with a \method{readline()} method. If
3944\var{n} is \code{0}, exactly one line is read, regardless of the
3945length of the line. If \var{n} is greater than \code{0}, no more than
3946\var{n} bytes will be read from the file; a partial line can be
3947returned. In both cases, an empty string is returned if the end of
3948the file is reached immediately. If \var{n} is less than \code{0},
3949however, one line is read regardless of length, but
3950\exception{EOFError} is raised if the end of the file is reached
3951immediately.
3952\withsubitem{(built-in exception)}{\ttindex{EOFError}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003953\end{cfuncdesc}
3954
Fred Drakec6fa34e1998-04-02 06:47:24 +00003955\begin{cfuncdesc}{PyObject*}{PyFile_Name}{PyObject *p}
Fred Drake659ebfa2000-04-03 15:42:13 +00003956Returns the name of the file specified by \var{p} as a string object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003957\end{cfuncdesc}
3958
3959\begin{cfuncdesc}{void}{PyFile_SetBufSize}{PyFileObject *p, int n}
Fred Drake659ebfa2000-04-03 15:42:13 +00003960Available on systems with \cfunction{setvbuf()}\ttindex{setvbuf()}
3961only. This should only be called immediately after file object
3962creation.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003963\end{cfuncdesc}
3964
Fred Drake659ebfa2000-04-03 15:42:13 +00003965\begin{cfuncdesc}{int}{PyFile_SoftSpace}{PyObject *p, int newflag}
3966This function exists for internal use by the interpreter.
3967Sets the \member{softspace} attribute of \var{p} to \var{newflag} and
3968\withsubitem{(file attribute)}{\ttindex{softspace}}returns the
3969previous value. \var{p} does not have to be a file object
3970for this function to work properly; any object is supported (thought
3971its only interesting if the \member{softspace} attribute can be set).
3972This function clears any errors, and will return \code{0} as the
3973previous value if the attribute either does not exist or if there were
3974errors in retrieving it. There is no way to detect errors from this
3975function, but doing so should not be needed.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003976\end{cfuncdesc}
3977
Fred Drakec6fa34e1998-04-02 06:47:24 +00003978\begin{cfuncdesc}{int}{PyFile_WriteObject}{PyObject *obj, PyFileObject *p,
3979 int flags}
Fred Drake659ebfa2000-04-03 15:42:13 +00003980Writes object \var{obj} to file object \var{p}. The only supported
3981flag for \var{flags} is \constant{Py_PRINT_RAW}\ttindex{Py_PRINT_RAW};
3982if given, the \function{str()} of the object is written instead of the
3983\function{repr()}. Returns \code{0} on success or \code{-1} on
3984failure; the appropriate exception will be set.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003985\end{cfuncdesc}
3986
Fred Drakec6fa34e1998-04-02 06:47:24 +00003987\begin{cfuncdesc}{int}{PyFile_WriteString}{char *s, PyFileObject *p,
3988 int flags}
Fred Drake659ebfa2000-04-03 15:42:13 +00003989Writes string \var{s} to file object \var{p}. Returns \code{0} on
3990success or \code{-1} on failure; the appropriate exception will be
3991set.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003992\end{cfuncdesc}
3993
3994
Fred Drake5838d0f2001-01-28 06:39:35 +00003995\subsection{Instance Objects \label{instanceObjects}}
3996
3997\obindex{instance}
3998There are very few functions specific to instance objects.
3999
4000\begin{cvardesc}{PyTypeObject}{PyInstance_Type}
4001 Type object for class instances.
4002\end{cvardesc}
4003
4004\begin{cfuncdesc}{int}{PyInstance_Check}{PyObject *obj}
4005 Returns true if \var{obj} is an instance.
4006\end{cfuncdesc}
4007
4008\begin{cfuncdesc}{PyObject*}{PyInstance_New}{PyObject *class,
4009 PyObject *arg,
4010 PyObject *kw}
4011 Create a new instance of a specific class. The parameters \var{arg}
4012 and \var{kw} are used as the positional and keyword parameters to
4013 the object's constructor.
4014\end{cfuncdesc}
4015
4016\begin{cfuncdesc}{PyObject*}{PyInstance_NewRaw}{PyObject *class,
4017 PyObject *dict}
4018 Create a new instance of a specific class without calling it's
4019 constructor. \var{class} is the class of new object. The
4020 \var{dict} parameter will be used as the object's \member{__dict__};
4021 if \NULL, a new dictionary will be created for the instance.
4022\end{cfuncdesc}
4023
4024
Fred Drakeefd146c1999-02-15 15:30:45 +00004025\subsection{Module Objects \label{moduleObjects}}
4026
4027\obindex{module}
4028There are only a few functions special to module objects.
4029
Fred Drake659ebfa2000-04-03 15:42:13 +00004030\begin{cvardesc}{PyTypeObject}{PyModule_Type}
4031This instance of \ctype{PyTypeObject} represents the Python module
4032type. This is exposed to Python programs as \code{types.ModuleType}.
4033\withsubitem{(in module types)}{\ttindex{ModuleType}}
4034\end{cvardesc}
4035
4036\begin{cfuncdesc}{int}{PyModule_Check}{PyObject *p}
4037Returns true if its argument is a module object.
Fred Drakeefd146c1999-02-15 15:30:45 +00004038\end{cfuncdesc}
4039
Fred Drake659ebfa2000-04-03 15:42:13 +00004040\begin{cfuncdesc}{PyObject*}{PyModule_New}{char *name}
4041Return a new module object with the \member{__name__} attribute set to
4042\var{name}. Only the module's \member{__doc__} and
4043\member{__name__} attributes are filled in; the caller is responsible
4044for providing a \member{__file__} attribute.
4045\withsubitem{(module attribute)}{
4046 \ttindex{__name__}\ttindex{__doc__}\ttindex{__file__}}
4047\end{cfuncdesc}
4048
4049\begin{cfuncdesc}{PyObject*}{PyModule_GetDict}{PyObject *module}
Fred Drakeefd146c1999-02-15 15:30:45 +00004050Return the dictionary object that implements \var{module}'s namespace;
4051this object is the same as the \member{__dict__} attribute of the
4052module object. This function never fails.
Fred Drake659ebfa2000-04-03 15:42:13 +00004053\withsubitem{(module attribute)}{\ttindex{__dict__}}
Fred Drakeefd146c1999-02-15 15:30:45 +00004054\end{cfuncdesc}
4055
Fred Drake659ebfa2000-04-03 15:42:13 +00004056\begin{cfuncdesc}{char*}{PyModule_GetName}{PyObject *module}
Fred Drakeefd146c1999-02-15 15:30:45 +00004057Return \var{module}'s \member{__name__} value. If the module does not
Fred Drake659ebfa2000-04-03 15:42:13 +00004058provide one, or if it is not a string, \exception{SystemError} is
4059raised and \NULL{} is returned.
4060\withsubitem{(module attribute)}{\ttindex{__name__}}
4061\withsubitem{(built-in exception)}{\ttindex{SystemError}}
Fred Drakeefd146c1999-02-15 15:30:45 +00004062\end{cfuncdesc}
4063
Fred Drake659ebfa2000-04-03 15:42:13 +00004064\begin{cfuncdesc}{char*}{PyModule_GetFilename}{PyObject *module}
Fred Drakeefd146c1999-02-15 15:30:45 +00004065Return the name of the file from which \var{module} was loaded using
4066\var{module}'s \member{__file__} attribute. If this is not defined,
Fred Drake659ebfa2000-04-03 15:42:13 +00004067or if it is not a string, raise \exception{SystemError} and return
4068\NULL.
4069\withsubitem{(module attribute)}{\ttindex{__file__}}
4070\withsubitem{(built-in exception)}{\ttindex{SystemError}}
Fred Drakeefd146c1999-02-15 15:30:45 +00004071\end{cfuncdesc}
4072
Fred Drake891150b2000-09-23 03:25:42 +00004073\begin{cfuncdesc}{int}{PyModule_AddObject}{PyObject *module,
4074 char *name, PyObject *value}
4075Add an object to \var{module} as \var{name}. This is a convenience
4076function which can be used from the module's initialization function.
4077This steals a reference to \var{value}. Returns \code{-1} on error,
4078\code{0} on success.
4079\versionadded{2.0}
4080\end{cfuncdesc}
4081
4082\begin{cfuncdesc}{int}{PyModule_AddIntConstant}{PyObject *module,
4083 char *name, int value}
4084Add an integer constant to \var{module} as \var{name}. This convenience
4085function can be used from the module's initialization function.
4086Returns \code{-1} on error, \code{0} on success.
4087\versionadded{2.0}
4088\end{cfuncdesc}
4089
4090\begin{cfuncdesc}{int}{PyModule_AddStringConstant}{PyObject *module,
4091 char *name, char *value}
4092Add a string constant to \var{module} as \var{name}. This convenience
4093function can be used from the module's initialization function. The
4094string \var{value} must be null-terminated. Returns \code{-1} on
4095error, \code{0} on success.
4096\versionadded{2.0}
4097\end{cfuncdesc}
4098
Fred Drakeefd146c1999-02-15 15:30:45 +00004099
4100\subsection{CObjects \label{cObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00004101
Fred Drake659ebfa2000-04-03 15:42:13 +00004102\obindex{CObject}
4103Refer to \emph{Extending and Embedding the Python Interpreter},
4104section 1.12 (``Providing a C API for an Extension Module''), for more
4105information on using these objects.
4106
4107
Guido van Rossum44475131998-04-21 15:30:01 +00004108\begin{ctypedesc}{PyCObject}
Fred Drakef8830d11998-04-23 14:06:01 +00004109This subtype of \ctype{PyObject} represents an opaque value, useful for
Fred Drake659ebfa2000-04-03 15:42:13 +00004110C extension modules who need to pass an opaque value (as a
4111\ctype{void*} pointer) through Python code to other C code. It is
Guido van Rossum44475131998-04-21 15:30:01 +00004112often used to make a C function pointer defined in one module
4113available to other modules, so the regular import mechanism can be
4114used to access C APIs defined in dynamically loaded modules.
4115\end{ctypedesc}
Fred Drakee5bf8b21998-02-12 21:22:28 +00004116
Fred Drake659ebfa2000-04-03 15:42:13 +00004117\begin{cfuncdesc}{int}{PyCObject_Check}{PyObject *p}
4118Returns true if its argument is a \ctype{PyCObject}.
4119\end{cfuncdesc}
4120
4121\begin{cfuncdesc}{PyObject*}{PyCObject_FromVoidPtr}{void* cobj,
Marc-André Lemburga544ea22001-01-17 18:04:31 +00004122 void (*destr)(void *)}
Fred Drake1d158692000-06-18 05:21:21 +00004123Creates a \ctype{PyCObject} from the \code{void *}\var{cobj}. The
Fred Drakedab44681999-05-13 18:41:14 +00004124\var{destr} function will be called when the object is reclaimed, unless
4125it is \NULL.
Guido van Rossum44475131998-04-21 15:30:01 +00004126\end{cfuncdesc}
4127
Fred Drake659ebfa2000-04-03 15:42:13 +00004128\begin{cfuncdesc}{PyObject*}{PyCObject_FromVoidPtrAndDesc}{void* cobj,
Marc-André Lemburga544ea22001-01-17 18:04:31 +00004129 void* desc, void (*destr)(void *, void *) }
Fred Drakef8830d11998-04-23 14:06:01 +00004130Creates a \ctype{PyCObject} from the \ctype{void *}\var{cobj}. The
4131\var{destr} function will be called when the object is reclaimed. The
4132\var{desc} argument can be used to pass extra callback data for the
4133destructor function.
Guido van Rossum44475131998-04-21 15:30:01 +00004134\end{cfuncdesc}
4135
Fred Drake659ebfa2000-04-03 15:42:13 +00004136\begin{cfuncdesc}{void*}{PyCObject_AsVoidPtr}{PyObject* self}
4137Returns the object \ctype{void *} that the
4138\ctype{PyCObject} \var{self} was created with.
Guido van Rossum44475131998-04-21 15:30:01 +00004139\end{cfuncdesc}
4140
Fred Drake659ebfa2000-04-03 15:42:13 +00004141\begin{cfuncdesc}{void*}{PyCObject_GetDesc}{PyObject* self}
4142Returns the description \ctype{void *} that the
4143\ctype{PyCObject} \var{self} was created with.
Guido van Rossum44475131998-04-21 15:30:01 +00004144\end{cfuncdesc}
Fred Drakee5bf8b21998-02-12 21:22:28 +00004145
Fred Drake659ebfa2000-04-03 15:42:13 +00004146
Fred Drakeefd146c1999-02-15 15:30:45 +00004147\chapter{Initialization, Finalization, and Threads
4148 \label{initialization}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004149
Guido van Rossum4a944d71997-08-14 20:35:38 +00004150\begin{cfuncdesc}{void}{Py_Initialize}{}
4151Initialize the Python interpreter. In an application embedding
4152Python, this should be called before using any other Python/C API
Fred Drake659ebfa2000-04-03 15:42:13 +00004153functions; with the exception of
4154\cfunction{Py_SetProgramName()}\ttindex{Py_SetProgramName()},
4155\cfunction{PyEval_InitThreads()}\ttindex{PyEval_InitThreads()},
4156\cfunction{PyEval_ReleaseLock()}\ttindex{PyEval_ReleaseLock()},
4157and \cfunction{PyEval_AcquireLock()}\ttindex{PyEval_AcquireLock()}.
4158This initializes the table of loaded modules (\code{sys.modules}), and
4159\withsubitem{(in module sys)}{\ttindex{modules}\ttindex{path}}creates the
4160fundamental modules \module{__builtin__}\refbimodindex{__builtin__},
Fred Drake4de05a91998-02-16 14:25:26 +00004161\module{__main__}\refbimodindex{__main__} and
4162\module{sys}\refbimodindex{sys}. It also initializes the module
Fred Drake659ebfa2000-04-03 15:42:13 +00004163search\indexiii{module}{search}{path} path (\code{sys.path}).
4164It does not set \code{sys.argv}; use
4165\cfunction{PySys_SetArgv()}\ttindex{PySys_SetArgv()} for that. This
4166is a no-op when called for a second time (without calling
4167\cfunction{Py_Finalize()}\ttindex{Py_Finalize()} first). There is no
4168return value; it is a fatal error if the initialization fails.
Guido van Rossum42cefd01997-10-05 15:27:29 +00004169\end{cfuncdesc}
4170
4171\begin{cfuncdesc}{int}{Py_IsInitialized}{}
Guido van Rossum42cefd01997-10-05 15:27:29 +00004172Return true (nonzero) when the Python interpreter has been
Fred Drakee058b4f1998-02-16 06:15:35 +00004173initialized, false (zero) if not. After \cfunction{Py_Finalize()} is
4174called, this returns false until \cfunction{Py_Initialize()} is called
Guido van Rossum42cefd01997-10-05 15:27:29 +00004175again.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004176\end{cfuncdesc}
4177
4178\begin{cfuncdesc}{void}{Py_Finalize}{}
Fred Drakee058b4f1998-02-16 06:15:35 +00004179Undo all initializations made by \cfunction{Py_Initialize()} and
4180subsequent use of Python/C API functions, and destroy all
4181sub-interpreters (see \cfunction{Py_NewInterpreter()} below) that were
4182created and not yet destroyed since the last call to
4183\cfunction{Py_Initialize()}. Ideally, this frees all memory allocated
4184by the Python interpreter. This is a no-op when called for a second
4185time (without calling \cfunction{Py_Initialize()} again first). There
4186is no return value; errors during finalization are ignored.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004187
4188This function is provided for a number of reasons. An embedding
4189application might want to restart Python without having to restart the
4190application itself. An application that has loaded the Python
4191interpreter from a dynamically loadable library (or DLL) might want to
4192free all memory allocated by Python before unloading the DLL. During a
4193hunt for memory leaks in an application a developer might want to free
4194all memory allocated by Python before exiting from the application.
4195
Fred Drakee058b4f1998-02-16 06:15:35 +00004196\strong{Bugs and caveats:} The destruction of modules and objects in
Guido van Rossum4a944d71997-08-14 20:35:38 +00004197modules is done in random order; this may cause destructors
Fred Drakee058b4f1998-02-16 06:15:35 +00004198(\method{__del__()} methods) to fail when they depend on other objects
Guido van Rossum4a944d71997-08-14 20:35:38 +00004199(even functions) or modules. Dynamically loaded extension modules
4200loaded by Python are not unloaded. Small amounts of memory allocated
4201by the Python interpreter may not be freed (if you find a leak, please
4202report it). Memory tied up in circular references between objects is
4203not freed. Some memory allocated by extension modules may not be
4204freed. Some extension may not work properly if their initialization
4205routine is called more than once; this can happen if an applcation
Fred Drakee058b4f1998-02-16 06:15:35 +00004206calls \cfunction{Py_Initialize()} and \cfunction{Py_Finalize()} more
4207than once.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004208\end{cfuncdesc}
4209
Fred Drakec6fa34e1998-04-02 06:47:24 +00004210\begin{cfuncdesc}{PyThreadState*}{Py_NewInterpreter}{}
Fred Drake4de05a91998-02-16 14:25:26 +00004211Create a new sub-interpreter. This is an (almost) totally separate
4212environment for the execution of Python code. In particular, the new
4213interpreter has separate, independent versions of all imported
4214modules, including the fundamental modules
4215\module{__builtin__}\refbimodindex{__builtin__},
4216\module{__main__}\refbimodindex{__main__} and
4217\module{sys}\refbimodindex{sys}. The table of loaded modules
4218(\code{sys.modules}) and the module search path (\code{sys.path}) are
4219also separate. The new environment has no \code{sys.argv} variable.
4220It has new standard I/O stream file objects \code{sys.stdin},
4221\code{sys.stdout} and \code{sys.stderr} (however these refer to the
Fred Drake659ebfa2000-04-03 15:42:13 +00004222same underlying \ctype{FILE} structures in the C library).
4223\withsubitem{(in module sys)}{
4224 \ttindex{stdout}\ttindex{stderr}\ttindex{stdin}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004225
4226The return value points to the first thread state created in the new
4227sub-interpreter. This thread state is made the current thread state.
4228Note that no actual thread is created; see the discussion of thread
4229states below. If creation of the new interpreter is unsuccessful,
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004230\NULL{} is returned; no exception is set since the exception state
Guido van Rossum4a944d71997-08-14 20:35:38 +00004231is stored in the current thread state and there may not be a current
4232thread state. (Like all other Python/C API functions, the global
4233interpreter lock must be held before calling this function and is
4234still held when it returns; however, unlike most other Python/C API
4235functions, there needn't be a current thread state on entry.)
4236
4237Extension modules are shared between (sub-)interpreters as follows:
4238the first time a particular extension is imported, it is initialized
4239normally, and a (shallow) copy of its module's dictionary is
4240squirreled away. When the same extension is imported by another
4241(sub-)interpreter, a new module is initialized and filled with the
Fred Drakee058b4f1998-02-16 06:15:35 +00004242contents of this copy; the extension's \code{init} function is not
4243called. Note that this is different from what happens when an
4244extension is imported after the interpreter has been completely
Fred Drake659ebfa2000-04-03 15:42:13 +00004245re-initialized by calling
4246\cfunction{Py_Finalize()}\ttindex{Py_Finalize()} and
4247\cfunction{Py_Initialize()}\ttindex{Py_Initialize()}; in that case,
4248the extension's \code{init\var{module}} function \emph{is} called
4249again.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004250
Fred Drakee058b4f1998-02-16 06:15:35 +00004251\strong{Bugs and caveats:} Because sub-interpreters (and the main
Guido van Rossum4a944d71997-08-14 20:35:38 +00004252interpreter) are part of the same process, the insulation between them
Fred Drakee058b4f1998-02-16 06:15:35 +00004253isn't perfect --- for example, using low-level file operations like
Fred Drake659ebfa2000-04-03 15:42:13 +00004254\withsubitem{(in module os)}{\ttindex{close()}}
Fred Drakef8830d11998-04-23 14:06:01 +00004255\function{os.close()} they can (accidentally or maliciously) affect each
Guido van Rossum4a944d71997-08-14 20:35:38 +00004256other's open files. Because of the way extensions are shared between
4257(sub-)interpreters, some extensions may not work properly; this is
4258especially likely when the extension makes use of (static) global
4259variables, or when the extension manipulates its module's dictionary
4260after its initialization. It is possible to insert objects created in
4261one sub-interpreter into a namespace of another sub-interpreter; this
4262should be done with great care to avoid sharing user-defined
4263functions, methods, instances or classes between sub-interpreters,
4264since import operations executed by such objects may affect the
4265wrong (sub-)interpreter's dictionary of loaded modules. (XXX This is
4266a hard-to-fix bug that will be addressed in a future release.)
4267\end{cfuncdesc}
4268
4269\begin{cfuncdesc}{void}{Py_EndInterpreter}{PyThreadState *tstate}
4270Destroy the (sub-)interpreter represented by the given thread state.
4271The given thread state must be the current thread state. See the
4272discussion of thread states below. When the call returns, the current
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004273thread state is \NULL{}. All thread states associated with this
Guido van Rossum4a944d71997-08-14 20:35:38 +00004274interpreted are destroyed. (The global interpreter lock must be held
4275before calling this function and is still held when it returns.)
Fred Drake659ebfa2000-04-03 15:42:13 +00004276\cfunction{Py_Finalize()}\ttindex{Py_Finalize()} will destroy all
4277sub-interpreters that haven't been explicitly destroyed at that point.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004278\end{cfuncdesc}
4279
4280\begin{cfuncdesc}{void}{Py_SetProgramName}{char *name}
Fred Drake659ebfa2000-04-03 15:42:13 +00004281This function should be called before
4282\cfunction{Py_Initialize()}\ttindex{Py_Initialize()} is called
Guido van Rossum4a944d71997-08-14 20:35:38 +00004283for the first time, if it is called at all. It tells the interpreter
Fred Drake659ebfa2000-04-03 15:42:13 +00004284the value of the \code{argv[0]} argument to the
4285\cfunction{main()}\ttindex{main()} function of the program. This is
4286used by \cfunction{Py_GetPath()}\ttindex{Py_GetPath()} and some other
Guido van Rossum4a944d71997-08-14 20:35:38 +00004287functions below to find the Python run-time libraries relative to the
Fred Drakea8455ab2000-06-16 19:58:42 +00004288interpreter executable. The default value is \code{'python'}. The
Guido van Rossum4a944d71997-08-14 20:35:38 +00004289argument should point to a zero-terminated character string in static
4290storage whose contents will not change for the duration of the
4291program's execution. No code in the Python interpreter will change
4292the contents of this storage.
4293\end{cfuncdesc}
4294
Fred Drakec6fa34e1998-04-02 06:47:24 +00004295\begin{cfuncdesc}{char*}{Py_GetProgramName}{}
Fred Drake659ebfa2000-04-03 15:42:13 +00004296Return the program name set with
4297\cfunction{Py_SetProgramName()}\ttindex{Py_SetProgramName()}, or the
Guido van Rossum4a944d71997-08-14 20:35:38 +00004298default. The returned string points into static storage; the caller
4299should not modify its value.
4300\end{cfuncdesc}
4301
Fred Drakec6fa34e1998-04-02 06:47:24 +00004302\begin{cfuncdesc}{char*}{Py_GetPrefix}{}
Fred Drakee058b4f1998-02-16 06:15:35 +00004303Return the \emph{prefix} for installed platform-independent files. This
Guido van Rossum4a944d71997-08-14 20:35:38 +00004304is derived through a number of complicated rules from the program name
Fred Drakee058b4f1998-02-16 06:15:35 +00004305set with \cfunction{Py_SetProgramName()} and some environment variables;
Fred Drakea8455ab2000-06-16 19:58:42 +00004306for example, if the program name is \code{'/usr/local/bin/python'},
4307the prefix is \code{'/usr/local'}. The returned string points into
Guido van Rossum4a944d71997-08-14 20:35:38 +00004308static storage; the caller should not modify its value. This
Fred Drakec94d9341998-04-12 02:39:13 +00004309corresponds to the \makevar{prefix} variable in the top-level
Fred Drakea8455ab2000-06-16 19:58:42 +00004310\file{Makefile} and the \longprogramopt{prefix} argument to the
Fred Drakee058b4f1998-02-16 06:15:35 +00004311\program{configure} script at build time. The value is available to
Fred Drakeb0a78731998-01-13 18:51:10 +00004312Python code as \code{sys.prefix}. It is only useful on \UNIX{}. See
Guido van Rossum4a944d71997-08-14 20:35:38 +00004313also the next function.
4314\end{cfuncdesc}
4315
Fred Drakec6fa34e1998-04-02 06:47:24 +00004316\begin{cfuncdesc}{char*}{Py_GetExecPrefix}{}
Fred Drakee058b4f1998-02-16 06:15:35 +00004317Return the \emph{exec-prefix} for installed platform-\emph{de}pendent
Guido van Rossum4a944d71997-08-14 20:35:38 +00004318files. This is derived through a number of complicated rules from the
Fred Drakee058b4f1998-02-16 06:15:35 +00004319program name set with \cfunction{Py_SetProgramName()} and some environment
Guido van Rossum4a944d71997-08-14 20:35:38 +00004320variables; for example, if the program name is
Fred Drakea8455ab2000-06-16 19:58:42 +00004321\code{'/usr/local/bin/python'}, the exec-prefix is
4322\code{'/usr/local'}. The returned string points into static storage;
Guido van Rossum4a944d71997-08-14 20:35:38 +00004323the caller should not modify its value. This corresponds to the
Fred Drakec94d9341998-04-12 02:39:13 +00004324\makevar{exec_prefix} variable in the top-level \file{Makefile} and the
Fred Drakea8455ab2000-06-16 19:58:42 +00004325\longprogramopt{exec-prefix} argument to the
Fred Drake310ee611999-11-09 17:31:42 +00004326\program{configure} script at build time. The value is available to
4327Python code as \code{sys.exec_prefix}. It is only useful on \UNIX{}.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004328
4329Background: The exec-prefix differs from the prefix when platform
4330dependent files (such as executables and shared libraries) are
4331installed in a different directory tree. In a typical installation,
4332platform dependent files may be installed in the
Fred Drakea8455ab2000-06-16 19:58:42 +00004333\file{/usr/local/plat} subtree while platform independent may be
4334installed in \file{/usr/local}.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004335
4336Generally speaking, a platform is a combination of hardware and
4337software families, e.g. Sparc machines running the Solaris 2.x
4338operating system are considered the same platform, but Intel machines
4339running Solaris 2.x are another platform, and Intel machines running
4340Linux are yet another platform. Different major revisions of the same
Fred Drakeb0a78731998-01-13 18:51:10 +00004341operating system generally also form different platforms. Non-\UNIX{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004342operating systems are a different story; the installation strategies
4343on those systems are so different that the prefix and exec-prefix are
4344meaningless, and set to the empty string. Note that compiled Python
4345bytecode files are platform independent (but not independent from the
4346Python version by which they were compiled!).
4347
Fred Drakee058b4f1998-02-16 06:15:35 +00004348System administrators will know how to configure the \program{mount} or
Fred Drakea8455ab2000-06-16 19:58:42 +00004349\program{automount} programs to share \file{/usr/local} between platforms
4350while having \file{/usr/local/plat} be a different filesystem for each
Guido van Rossum4a944d71997-08-14 20:35:38 +00004351platform.
4352\end{cfuncdesc}
4353
Fred Drakec6fa34e1998-04-02 06:47:24 +00004354\begin{cfuncdesc}{char*}{Py_GetProgramFullPath}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004355Return the full program name of the Python executable; this is
4356computed as a side-effect of deriving the default module search path
Fred Drake659ebfa2000-04-03 15:42:13 +00004357from the program name (set by
4358\cfunction{Py_SetProgramName()}\ttindex{Py_SetProgramName()} above).
4359The returned string points into static storage; the caller should not
Guido van Rossum4a944d71997-08-14 20:35:38 +00004360modify its value. The value is available to Python code as
Guido van Rossum42cefd01997-10-05 15:27:29 +00004361\code{sys.executable}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004362\withsubitem{(in module sys)}{\ttindex{executable}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004363\end{cfuncdesc}
4364
Fred Drakec6fa34e1998-04-02 06:47:24 +00004365\begin{cfuncdesc}{char*}{Py_GetPath}{}
Fred Drake4de05a91998-02-16 14:25:26 +00004366\indexiii{module}{search}{path}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004367Return the default module search path; this is computed from the
Fred Drakee058b4f1998-02-16 06:15:35 +00004368program name (set by \cfunction{Py_SetProgramName()} above) and some
Guido van Rossum4a944d71997-08-14 20:35:38 +00004369environment variables. The returned string consists of a series of
4370directory names separated by a platform dependent delimiter character.
Fred Drakef8830d11998-04-23 14:06:01 +00004371The delimiter character is \character{:} on \UNIX{}, \character{;} on
Fred Drake659ebfa2000-04-03 15:42:13 +00004372DOS/Windows, and \character{\e n} (the \ASCII{} newline character) on
Fred Drakee5bc4971998-02-12 23:36:49 +00004373Macintosh. The returned string points into static storage; the caller
Guido van Rossum4a944d71997-08-14 20:35:38 +00004374should not modify its value. The value is available to Python code
Fred Drake659ebfa2000-04-03 15:42:13 +00004375as the list \code{sys.path}\withsubitem{(in module sys)}{\ttindex{path}},
4376which may be modified to change the future search path for loaded
4377modules.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004378
4379% XXX should give the exact rules
4380\end{cfuncdesc}
4381
Fred Drakec6fa34e1998-04-02 06:47:24 +00004382\begin{cfuncdesc}{const char*}{Py_GetVersion}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004383Return the version of this Python interpreter. This is a string that
4384looks something like
4385
Guido van Rossum09270b51997-08-15 18:57:32 +00004386\begin{verbatim}
Fred Drakee058b4f1998-02-16 06:15:35 +00004387"1.5 (#67, Dec 31 1997, 22:34:28) [GCC 2.7.2.2]"
Guido van Rossum09270b51997-08-15 18:57:32 +00004388\end{verbatim}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004389
4390The first word (up to the first space character) is the current Python
4391version; the first three characters are the major and minor version
4392separated by a period. The returned string points into static storage;
4393the caller should not modify its value. The value is available to
4394Python code as the list \code{sys.version}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004395\withsubitem{(in module sys)}{\ttindex{version}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004396\end{cfuncdesc}
4397
Fred Drakec6fa34e1998-04-02 06:47:24 +00004398\begin{cfuncdesc}{const char*}{Py_GetPlatform}{}
Fred Drakeb0a78731998-01-13 18:51:10 +00004399Return the platform identifier for the current platform. On \UNIX{},
Guido van Rossum4a944d71997-08-14 20:35:38 +00004400this is formed from the ``official'' name of the operating system,
4401converted to lower case, followed by the major revision number; e.g.,
4402for Solaris 2.x, which is also known as SunOS 5.x, the value is
Fred Drakea8455ab2000-06-16 19:58:42 +00004403\code{'sunos5'}. On Macintosh, it is \code{'mac'}. On Windows, it
4404is \code{'win'}. The returned string points into static storage;
Guido van Rossum4a944d71997-08-14 20:35:38 +00004405the caller should not modify its value. The value is available to
4406Python code as \code{sys.platform}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004407\withsubitem{(in module sys)}{\ttindex{platform}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004408\end{cfuncdesc}
4409
Fred Drakec6fa34e1998-04-02 06:47:24 +00004410\begin{cfuncdesc}{const char*}{Py_GetCopyright}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004411Return the official copyright string for the current Python version,
4412for example
4413
Fred Drakea8455ab2000-06-16 19:58:42 +00004414\code{'Copyright 1991-1995 Stichting Mathematisch Centrum, Amsterdam'}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004415
4416The returned string points into static storage; the caller should not
4417modify its value. The value is available to Python code as the list
4418\code{sys.copyright}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004419\withsubitem{(in module sys)}{\ttindex{copyright}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004420\end{cfuncdesc}
4421
Fred Drakec6fa34e1998-04-02 06:47:24 +00004422\begin{cfuncdesc}{const char*}{Py_GetCompiler}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004423Return an indication of the compiler used to build the current Python
Fred Drakee058b4f1998-02-16 06:15:35 +00004424version, in square brackets, for example:
Guido van Rossum4a944d71997-08-14 20:35:38 +00004425
Fred Drakee058b4f1998-02-16 06:15:35 +00004426\begin{verbatim}
4427"[GCC 2.7.2.2]"
4428\end{verbatim}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004429
4430The returned string points into static storage; the caller should not
4431modify its value. The value is available to Python code as part of
4432the variable \code{sys.version}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004433\withsubitem{(in module sys)}{\ttindex{version}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004434\end{cfuncdesc}
4435
Fred Drakec6fa34e1998-04-02 06:47:24 +00004436\begin{cfuncdesc}{const char*}{Py_GetBuildInfo}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004437Return information about the sequence number and build date and time
4438of the current Python interpreter instance, for example
4439
Guido van Rossum09270b51997-08-15 18:57:32 +00004440\begin{verbatim}
4441"#67, Aug 1 1997, 22:34:28"
4442\end{verbatim}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004443
4444The returned string points into static storage; the caller should not
4445modify its value. The value is available to Python code as part of
4446the variable \code{sys.version}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004447\withsubitem{(in module sys)}{\ttindex{version}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004448\end{cfuncdesc}
4449
4450\begin{cfuncdesc}{int}{PySys_SetArgv}{int argc, char **argv}
Fred Drake659ebfa2000-04-03 15:42:13 +00004451Set \code{sys.argv} based on \var{argc} and \var{argv}. These
4452parameters are similar to those passed to the program's
4453\cfunction{main()}\ttindex{main()} function with the difference that
4454the first entry should refer to the script file to be executed rather
4455than the executable hosting the Python interpreter. If there isn't a
4456script that will be run, the first entry in \var{argv} can be an empty
4457string. If this function fails to initialize \code{sys.argv}, a fatal
4458condition is signalled using
4459\cfunction{Py_FatalError()}\ttindex{Py_FatalError()}.
4460\withsubitem{(in module sys)}{\ttindex{argv}}
4461% XXX impl. doesn't seem consistent in allowing 0/NULL for the params;
4462% check w/ Guido.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004463\end{cfuncdesc}
4464
4465% XXX Other PySys thingies (doesn't really belong in this chapter)
4466
Fred Drakeefd146c1999-02-15 15:30:45 +00004467\section{Thread State and the Global Interpreter Lock
4468 \label{threads}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004469
Fred Drake659ebfa2000-04-03 15:42:13 +00004470\index{global interpreter lock}
4471\index{interpreter lock}
4472\index{lock, interpreter}
4473
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004474The Python interpreter is not fully thread safe. In order to support
4475multi-threaded Python programs, there's a global lock that must be
4476held by the current thread before it can safely access Python objects.
4477Without the lock, even the simplest operations could cause problems in
Fred Drake7baf3d41998-02-20 00:45:52 +00004478a multi-threaded program: for example, when two threads simultaneously
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004479increment the reference count of the same object, the reference count
4480could end up being incremented only once instead of twice.
4481
4482Therefore, the rule exists that only the thread that has acquired the
4483global interpreter lock may operate on Python objects or call Python/C
4484API functions. In order to support multi-threaded Python programs,
Fred Drake659ebfa2000-04-03 15:42:13 +00004485the interpreter regularly releases and reacquires the lock --- by
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004486default, every ten bytecode instructions (this can be changed with
Fred Drake659ebfa2000-04-03 15:42:13 +00004487\withsubitem{(in module sys)}{\ttindex{setcheckinterval()}}
Fred Drakee058b4f1998-02-16 06:15:35 +00004488\function{sys.setcheckinterval()}). The lock is also released and
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004489reacquired around potentially blocking I/O operations like reading or
4490writing a file, so that other threads can run while the thread that
4491requests the I/O is waiting for the I/O operation to complete.
4492
4493The Python interpreter needs to keep some bookkeeping information
Fred Drakee058b4f1998-02-16 06:15:35 +00004494separate per thread --- for this it uses a data structure called
Fred Drake659ebfa2000-04-03 15:42:13 +00004495\ctype{PyThreadState}\ttindex{PyThreadState}. This is new in Python
44961.5; in earlier versions, such state was stored in global variables,
4497and switching threads could cause problems. In particular, exception
4498handling is now thread safe, when the application uses
4499\withsubitem{(in module sys)}{\ttindex{exc_info()}}
4500\function{sys.exc_info()} to access the exception last raised in the
4501current thread.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004502
4503There's one global variable left, however: the pointer to the current
Fred Drake659ebfa2000-04-03 15:42:13 +00004504\ctype{PyThreadState}\ttindex{PyThreadState} structure. While most
4505thread packages have a way to store ``per-thread global data,''
4506Python's internal platform independent thread abstraction doesn't
4507support this yet. Therefore, the current thread state must be
4508manipulated explicitly.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004509
4510This is easy enough in most cases. Most code manipulating the global
4511interpreter lock has the following simple structure:
4512
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004513\begin{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004514Save the thread state in a local variable.
4515Release the interpreter lock.
4516...Do some blocking I/O operation...
4517Reacquire the interpreter lock.
4518Restore the thread state from the local variable.
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004519\end{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004520
4521This is so common that a pair of macros exists to simplify it:
4522
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004523\begin{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004524Py_BEGIN_ALLOW_THREADS
4525...Do some blocking I/O operation...
4526Py_END_ALLOW_THREADS
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004527\end{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004528
Fred Drake659ebfa2000-04-03 15:42:13 +00004529The \code{Py_BEGIN_ALLOW_THREADS}\ttindex{Py_BEGIN_ALLOW_THREADS} macro
4530opens a new block and declares a hidden local variable; the
4531\code{Py_END_ALLOW_THREADS}\ttindex{Py_END_ALLOW_THREADS} macro closes
Fred Drakee058b4f1998-02-16 06:15:35 +00004532the block. Another advantage of using these two macros is that when
4533Python is compiled without thread support, they are defined empty,
4534thus saving the thread state and lock manipulations.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004535
4536When thread support is enabled, the block above expands to the
4537following code:
4538
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004539\begin{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004540 PyThreadState *_save;
Fred Drake659ebfa2000-04-03 15:42:13 +00004541
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004542 _save = PyEval_SaveThread();
4543 ...Do some blocking I/O operation...
4544 PyEval_RestoreThread(_save);
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004545\end{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004546
4547Using even lower level primitives, we can get roughly the same effect
4548as follows:
4549
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004550\begin{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004551 PyThreadState *_save;
Fred Drake659ebfa2000-04-03 15:42:13 +00004552
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004553 _save = PyThreadState_Swap(NULL);
4554 PyEval_ReleaseLock();
4555 ...Do some blocking I/O operation...
4556 PyEval_AcquireLock();
4557 PyThreadState_Swap(_save);
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004558\end{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004559
4560There are some subtle differences; in particular,
Fred Drake659ebfa2000-04-03 15:42:13 +00004561\cfunction{PyEval_RestoreThread()}\ttindex{PyEval_RestoreThread()} saves
4562and restores the value of the global variable
4563\cdata{errno}\ttindex{errno}, since the lock manipulation does not
Fred Drakef8830d11998-04-23 14:06:01 +00004564guarantee that \cdata{errno} is left alone. Also, when thread support
Fred Drake659ebfa2000-04-03 15:42:13 +00004565is disabled,
4566\cfunction{PyEval_SaveThread()}\ttindex{PyEval_SaveThread()} and
Fred Drakee058b4f1998-02-16 06:15:35 +00004567\cfunction{PyEval_RestoreThread()} don't manipulate the lock; in this
Fred Drake659ebfa2000-04-03 15:42:13 +00004568case, \cfunction{PyEval_ReleaseLock()}\ttindex{PyEval_ReleaseLock()} and
4569\cfunction{PyEval_AcquireLock()}\ttindex{PyEval_AcquireLock()} are not
4570available. This is done so that dynamically loaded extensions
4571compiled with thread support enabled can be loaded by an interpreter
4572that was compiled with disabled thread support.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004573
4574The global interpreter lock is used to protect the pointer to the
4575current thread state. When releasing the lock and saving the thread
4576state, the current thread state pointer must be retrieved before the
4577lock is released (since another thread could immediately acquire the
4578lock and store its own thread state in the global variable).
Fred Drakeffe58ca2000-09-29 17:31:54 +00004579Conversely, when acquiring the lock and restoring the thread state,
4580the lock must be acquired before storing the thread state pointer.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004581
4582Why am I going on with so much detail about this? Because when
Fred Drake659ebfa2000-04-03 15:42:13 +00004583threads are created from C, they don't have the global interpreter
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004584lock, nor is there a thread state data structure for them. Such
4585threads must bootstrap themselves into existence, by first creating a
4586thread state data structure, then acquiring the lock, and finally
4587storing their thread state pointer, before they can start using the
4588Python/C API. When they are done, they should reset the thread state
4589pointer, release the lock, and finally free their thread state data
4590structure.
4591
4592When creating a thread data structure, you need to provide an
4593interpreter state data structure. The interpreter state data
4594structure hold global data that is shared by all threads in an
4595interpreter, for example the module administration
4596(\code{sys.modules}). Depending on your needs, you can either create
4597a new interpreter state data structure, or share the interpreter state
4598data structure used by the Python main thread (to access the latter,
Fred Drakef8830d11998-04-23 14:06:01 +00004599you must obtain the thread state and access its \member{interp} member;
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004600this must be done by a thread that is created by Python or by the main
4601thread after Python is initialized).
4602
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004603
4604\begin{ctypedesc}{PyInterpreterState}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004605This data structure represents the state shared by a number of
4606cooperating threads. Threads belonging to the same interpreter
4607share their module administration and a few other internal items.
4608There are no public members in this structure.
4609
4610Threads belonging to different interpreters initially share nothing,
4611except process state like available memory, open file descriptors and
4612such. The global interpreter lock is also shared by all threads,
4613regardless of to which interpreter they belong.
4614\end{ctypedesc}
4615
4616\begin{ctypedesc}{PyThreadState}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004617This data structure represents the state of a single thread. The only
Fred Drakef8830d11998-04-23 14:06:01 +00004618public data member is \ctype{PyInterpreterState *}\member{interp},
4619which points to this thread's interpreter state.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004620\end{ctypedesc}
4621
4622\begin{cfuncdesc}{void}{PyEval_InitThreads}{}
4623Initialize and acquire the global interpreter lock. It should be
4624called in the main thread before creating a second thread or engaging
Fred Drakee058b4f1998-02-16 06:15:35 +00004625in any other thread operations such as
Fred Drake659ebfa2000-04-03 15:42:13 +00004626\cfunction{PyEval_ReleaseLock()}\ttindex{PyEval_ReleaseLock()} or
4627\code{PyEval_ReleaseThread(\var{tstate})}\ttindex{PyEval_ReleaseThread()}.
4628It is not needed before calling
4629\cfunction{PyEval_SaveThread()}\ttindex{PyEval_SaveThread()} or
4630\cfunction{PyEval_RestoreThread()}\ttindex{PyEval_RestoreThread()}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004631
4632This is a no-op when called for a second time. It is safe to call
Fred Drake659ebfa2000-04-03 15:42:13 +00004633this function before calling
4634\cfunction{Py_Initialize()}\ttindex{Py_Initialize()}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004635
4636When only the main thread exists, no lock operations are needed. This
4637is a common situation (most Python programs do not use threads), and
4638the lock operations slow the interpreter down a bit. Therefore, the
4639lock is not created initially. This situation is equivalent to having
4640acquired the lock: when there is only a single thread, all object
4641accesses are safe. Therefore, when this function initializes the
Fred Drake4de05a91998-02-16 14:25:26 +00004642lock, it also acquires it. Before the Python
4643\module{thread}\refbimodindex{thread} module creates a new thread,
4644knowing that either it has the lock or the lock hasn't been created
4645yet, it calls \cfunction{PyEval_InitThreads()}. When this call
4646returns, it is guaranteed that the lock has been created and that it
4647has acquired it.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004648
4649It is \strong{not} safe to call this function when it is unknown which
4650thread (if any) currently has the global interpreter lock.
4651
4652This function is not available when thread support is disabled at
4653compile time.
4654\end{cfuncdesc}
4655
Guido van Rossum4a944d71997-08-14 20:35:38 +00004656\begin{cfuncdesc}{void}{PyEval_AcquireLock}{}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004657Acquire the global interpreter lock. The lock must have been created
4658earlier. If this thread already has the lock, a deadlock ensues.
4659This function is not available when thread support is disabled at
4660compile time.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004661\end{cfuncdesc}
4662
4663\begin{cfuncdesc}{void}{PyEval_ReleaseLock}{}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004664Release the global interpreter lock. The lock must have been created
4665earlier. This function is not available when thread support is
Fred Drakee058b4f1998-02-16 06:15:35 +00004666disabled at compile time.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004667\end{cfuncdesc}
4668
4669\begin{cfuncdesc}{void}{PyEval_AcquireThread}{PyThreadState *tstate}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004670Acquire the global interpreter lock and then set the current thread
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004671state to \var{tstate}, which should not be \NULL{}. The lock must
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004672have been created earlier. If this thread already has the lock,
4673deadlock ensues. This function is not available when thread support
Fred Drakee058b4f1998-02-16 06:15:35 +00004674is disabled at compile time.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004675\end{cfuncdesc}
4676
4677\begin{cfuncdesc}{void}{PyEval_ReleaseThread}{PyThreadState *tstate}
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004678Reset the current thread state to \NULL{} and release the global
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004679interpreter lock. The lock must have been created earlier and must be
4680held by the current thread. The \var{tstate} argument, which must not
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004681be \NULL{}, is only used to check that it represents the current
Fred Drakee058b4f1998-02-16 06:15:35 +00004682thread state --- if it isn't, a fatal error is reported. This
4683function is not available when thread support is disabled at compile
4684time.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004685\end{cfuncdesc}
4686
Fred Drakec6fa34e1998-04-02 06:47:24 +00004687\begin{cfuncdesc}{PyThreadState*}{PyEval_SaveThread}{}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004688Release the interpreter lock (if it has been created and thread
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004689support is enabled) and reset the thread state to \NULL{},
4690returning the previous thread state (which is not \NULL{}). If
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004691the lock has been created, the current thread must have acquired it.
4692(This function is available even when thread support is disabled at
4693compile time.)
Guido van Rossum4a944d71997-08-14 20:35:38 +00004694\end{cfuncdesc}
4695
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004696\begin{cfuncdesc}{void}{PyEval_RestoreThread}{PyThreadState *tstate}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004697Acquire the interpreter lock (if it has been created and thread
4698support is enabled) and set the thread state to \var{tstate}, which
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004699must not be \NULL{}. If the lock has been created, the current
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004700thread must not have acquired it, otherwise deadlock ensues. (This
4701function is available even when thread support is disabled at compile
4702time.)
Guido van Rossum4a944d71997-08-14 20:35:38 +00004703\end{cfuncdesc}
4704
Fred Drake659ebfa2000-04-03 15:42:13 +00004705The following macros are normally used without a trailing semicolon;
4706look for example usage in the Python source distribution.
4707
4708\begin{csimplemacrodesc}{Py_BEGIN_ALLOW_THREADS}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004709This macro expands to
Fred Drakee058b4f1998-02-16 06:15:35 +00004710\samp{\{ PyThreadState *_save; _save = PyEval_SaveThread();}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004711Note that it contains an opening brace; it must be matched with a
4712following \code{Py_END_ALLOW_THREADS} macro. See above for further
4713discussion of this macro. It is a no-op when thread support is
4714disabled at compile time.
Fred Drake659ebfa2000-04-03 15:42:13 +00004715\end{csimplemacrodesc}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004716
Fred Drake659ebfa2000-04-03 15:42:13 +00004717\begin{csimplemacrodesc}{Py_END_ALLOW_THREADS}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004718This macro expands to
Fred Drakee058b4f1998-02-16 06:15:35 +00004719\samp{PyEval_RestoreThread(_save); \}}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004720Note that it contains a closing brace; it must be matched with an
4721earlier \code{Py_BEGIN_ALLOW_THREADS} macro. See above for further
4722discussion of this macro. It is a no-op when thread support is
4723disabled at compile time.
Fred Drake659ebfa2000-04-03 15:42:13 +00004724\end{csimplemacrodesc}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004725
Thomas Wouterse30ac572001-07-09 14:35:01 +00004726\begin{csimplemacrodesc}{Py_BLOCK_THREADS}
Fred Drakebab29652001-07-10 16:10:08 +00004727This macro expands to \samp{PyEval_RestoreThread(_save);}: it
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004728is equivalent to \code{Py_END_ALLOW_THREADS} without the closing
4729brace. It is a no-op when thread support is disabled at compile
4730time.
Fred Drake659ebfa2000-04-03 15:42:13 +00004731\end{csimplemacrodesc}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004732
Thomas Wouterse30ac572001-07-09 14:35:01 +00004733\begin{csimplemacrodesc}{Py_UNBLOCK_THREADS}
Fred Drakebab29652001-07-10 16:10:08 +00004734This macro expands to \samp{_save = PyEval_SaveThread();}: it is
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004735equivalent to \code{Py_BEGIN_ALLOW_THREADS} without the opening brace
4736and variable declaration. It is a no-op when thread support is
4737disabled at compile time.
Fred Drake659ebfa2000-04-03 15:42:13 +00004738\end{csimplemacrodesc}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004739
4740All of the following functions are only available when thread support
4741is enabled at compile time, and must be called only when the
Fred Drake9d20ac31998-02-16 15:27:08 +00004742interpreter lock has been created.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004743
Fred Drakec6fa34e1998-04-02 06:47:24 +00004744\begin{cfuncdesc}{PyInterpreterState*}{PyInterpreterState_New}{}
Guido van Rossumed9dcc11998-08-07 18:28:03 +00004745Create a new interpreter state object. The interpreter lock need not
4746be held, but may be held if it is necessary to serialize calls to this
4747function.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004748\end{cfuncdesc}
4749
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004750\begin{cfuncdesc}{void}{PyInterpreterState_Clear}{PyInterpreterState *interp}
4751Reset all information in an interpreter state object. The interpreter
4752lock must be held.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004753\end{cfuncdesc}
4754
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004755\begin{cfuncdesc}{void}{PyInterpreterState_Delete}{PyInterpreterState *interp}
4756Destroy an interpreter state object. The interpreter lock need not be
4757held. The interpreter state must have been reset with a previous
Fred Drakee058b4f1998-02-16 06:15:35 +00004758call to \cfunction{PyInterpreterState_Clear()}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004759\end{cfuncdesc}
4760
Fred Drakec6fa34e1998-04-02 06:47:24 +00004761\begin{cfuncdesc}{PyThreadState*}{PyThreadState_New}{PyInterpreterState *interp}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004762Create a new thread state object belonging to the given interpreter
Guido van Rossumed9dcc11998-08-07 18:28:03 +00004763object. The interpreter lock need not be held, but may be held if it
4764is necessary to serialize calls to this function.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004765\end{cfuncdesc}
4766
4767\begin{cfuncdesc}{void}{PyThreadState_Clear}{PyThreadState *tstate}
4768Reset all information in a thread state object. The interpreter lock
4769must be held.
4770\end{cfuncdesc}
4771
4772\begin{cfuncdesc}{void}{PyThreadState_Delete}{PyThreadState *tstate}
4773Destroy a thread state object. The interpreter lock need not be
4774held. The thread state must have been reset with a previous
Fred Drakee058b4f1998-02-16 06:15:35 +00004775call to \cfunction{PyThreadState_Clear()}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004776\end{cfuncdesc}
4777
Fred Drakec6fa34e1998-04-02 06:47:24 +00004778\begin{cfuncdesc}{PyThreadState*}{PyThreadState_Get}{}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004779Return the current thread state. The interpreter lock must be held.
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004780When the current thread state is \NULL{}, this issues a fatal
Guido van Rossum5b8a5231997-12-30 04:38:44 +00004781error (so that the caller needn't check for \NULL{}).
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004782\end{cfuncdesc}
4783
Fred Drakec6fa34e1998-04-02 06:47:24 +00004784\begin{cfuncdesc}{PyThreadState*}{PyThreadState_Swap}{PyThreadState *tstate}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004785Swap the current thread state with the thread state given by the
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004786argument \var{tstate}, which may be \NULL{}. The interpreter lock
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004787must be held.
4788\end{cfuncdesc}
4789
Fred Drake24e62192001-05-21 15:56:55 +00004790\begin{cfuncdesc}{PyObject*}{PyThreadState_GetDict}{}
4791Return a dictionary in which extensions can store thread-specific
4792state information. Each extension should use a unique key to use to
4793store state in the dictionary. If this function returns \NULL, an
4794exception has been raised and the caller should allow it to
4795propogate.
4796\end{cfuncdesc}
4797
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004798
Fred Drake68db7302001-07-17 19:48:30 +00004799\section{Profiling and Tracing \label{profiling}}
4800
4801\sectionauthor{Fred L. Drake, Jr.}{fdrake@acm.org}
4802
4803The Python interpreter provides some low-level support for attaching
4804profiling and execution tracing facilities. These are used for
4805profiling, debugging, and coverage analysis tools.
4806
4807Starting with Python 2.2, the implementation of this facility was
4808substantially revised, and an interface from C was added. This C
4809interface allows the profiling or tracing code to avoid the overhead
4810of calling through Python-level callable objects, making a direct C
4811function call instead. The essential attributes of the facility have
4812not changed; the interface allows trace functions to be installed
4813per-thread, and the basic events reported to the trace function are
4814the same as had been reported to the Python-level trace functions in
4815previous versions.
4816
4817\begin{ctypedesc}[Py_tracefunc]{int (*Py_tracefunc)(PyObject *obj,
4818 PyFrameObject *frame, int what,
4819 PyObject *arg)}
4820 The type of the trace function registered using
4821 \cfunction{PyEval_SetProfile()} and \cfunction{PyEval_SetTrace()}.
4822 The first parameter is the object passed to the registration
4823 function,
4824\end{ctypedesc}
4825
4826\begin{cvardesc}{int}{PyTrace_CALL}
4827 The value of the \var{what} parameter to a \ctype{Py_tracefunc}
4828 function when a new function or method call is being reported.
4829\end{cvardesc}
4830
4831\begin{cvardesc}{int}{PyTrace_EXCEPT}
4832\end{cvardesc}
4833
4834\begin{cvardesc}{int}{PyTrace_LINE}
4835 The value passed as the \var{what} parameter to a trace function
4836 (but not a profiling function) when a line-number event is being
4837 reported.
4838\end{cvardesc}
4839
4840\begin{cvardesc}{int}{PyTrace_RETURN}
4841 The value for the \var{what} parameter to \ctype{Py_tracefunc}
4842 functions when a call is returning without propogating an exception.
4843\end{cvardesc}
4844
4845\begin{cfuncdesc}{void}{PyEval_SetProfile}{Py_tracefunc func, PyObject *obj}
Fred Drakef90490e2001-08-02 18:00:28 +00004846 Set the profiler function to \var{func}. The \var{obj} parameter is
4847 passed to the function as its first parameter, and may be any Python
4848 object, or \NULL. If the profile function needs to maintain state,
4849 using a different value for \var{obj} for each thread provides a
4850 convenient and thread-safe place to store it. The profile function
4851 is called for all monitored events except the line-number events.
Fred Drake68db7302001-07-17 19:48:30 +00004852\end{cfuncdesc}
4853
4854\begin{cfuncdesc}{void}{PyEval_SetTrace}{Py_tracefunc func, PyObject *obj}
Fred Drakef90490e2001-08-02 18:00:28 +00004855 Set the the tracing function to \var{func}. This is similar to
4856 \cfunction{PyEval_SetProfile()}, except the tracing function does
4857 receive line-number events.
Fred Drake68db7302001-07-17 19:48:30 +00004858\end{cfuncdesc}
4859
4860
Fred Drake01978582001-08-08 19:14:53 +00004861\section{Advanced Debugger Support \label{advanced-debugging}}
4862\sectionauthor{Fred L. Drake, Jr.}{fdrake@acm.org}
4863
4864These functions are only intended to be used by advanced debugging
4865tools.
4866
4867\begin{cfuncdesc}{PyInterpreterState*}{PyInterpreterState_Head}{}
4868Return the interpreter state object at the head of the list of all
4869such objects.
4870\versionadded{2.2}
4871\end{cfuncdesc}
4872
4873\begin{cfuncdesc}{PyInterpreterState*}{PyInterpreterState_Next}{PyInterpreterState *interp}
4874Return the next interpreter state object after \var{interp} from the
4875list of all such objects.
4876\versionadded{2.2}
4877\end{cfuncdesc}
4878
4879\begin{cfuncdesc}{PyThreadState *}{PyInterpreterState_ThreadHead}{PyInterpreterState *interp}
4880Return the a pointer to the first \ctype{PyThreadState} object in the
4881list of threads associated with the interpreter \var{interp}.
4882\versionadded{2.2}
4883\end{cfuncdesc}
4884
4885\begin{cfuncdesc}{PyThreadState*}{PyThreadState_Next}{PyThreadState *tstate}
4886Return the next thread state object after \var{tstate} from the list
4887of all such objects belonging to the same \ctype{PyInterpreterState}
4888object.
4889\versionadded{2.2}
4890\end{cfuncdesc}
4891
4892
Fred Drake659ebfa2000-04-03 15:42:13 +00004893\chapter{Memory Management \label{memory}}
4894\sectionauthor{Vladimir Marangozov}{Vladimir.Marangozov@inrialpes.fr}
4895
4896
4897\section{Overview \label{memoryOverview}}
4898
4899Memory management in Python involves a private heap containing all
4900Python objects and data structures. The management of this private
4901heap is ensured internally by the \emph{Python memory manager}. The
4902Python memory manager has different components which deal with various
4903dynamic storage management aspects, like sharing, segmentation,
4904preallocation or caching.
4905
4906At the lowest level, a raw memory allocator ensures that there is
4907enough room in the private heap for storing all Python-related data
4908by interacting with the memory manager of the operating system. On top
4909of the raw memory allocator, several object-specific allocators
4910operate on the same heap and implement distinct memory management
4911policies adapted to the peculiarities of every object type. For
4912example, integer objects are managed differently within the heap than
4913strings, tuples or dictionaries because integers imply different
4914storage requirements and speed/space tradeoffs. The Python memory
4915manager thus delegates some of the work to the object-specific
4916allocators, but ensures that the latter operate within the bounds of
4917the private heap.
4918
4919It is important to understand that the management of the Python heap
4920is performed by the interpreter itself and that the user has no
4921control on it, even if she regularly manipulates object pointers to
4922memory blocks inside that heap. The allocation of heap space for
4923Python objects and other internal buffers is performed on demand by
4924the Python memory manager through the Python/C API functions listed in
4925this document.
4926
4927To avoid memory corruption, extension writers should never try to
4928operate on Python objects with the functions exported by the C
4929library: \cfunction{malloc()}\ttindex{malloc()},
4930\cfunction{calloc()}\ttindex{calloc()},
4931\cfunction{realloc()}\ttindex{realloc()} and
4932\cfunction{free()}\ttindex{free()}. This will result in
4933mixed calls between the C allocator and the Python memory manager
4934with fatal consequences, because they implement different algorithms
4935and operate on different heaps. However, one may safely allocate and
4936release memory blocks with the C library allocator for individual
4937purposes, as shown in the following example:
4938
4939\begin{verbatim}
4940 PyObject *res;
4941 char *buf = (char *) malloc(BUFSIZ); /* for I/O */
4942
4943 if (buf == NULL)
4944 return PyErr_NoMemory();
4945 ...Do some I/O operation involving buf...
4946 res = PyString_FromString(buf);
4947 free(buf); /* malloc'ed */
4948 return res;
4949\end{verbatim}
4950
4951In this example, the memory request for the I/O buffer is handled by
4952the C library allocator. The Python memory manager is involved only
4953in the allocation of the string object returned as a result.
4954
4955In most situations, however, it is recommended to allocate memory from
4956the Python heap specifically because the latter is under control of
4957the Python memory manager. For example, this is required when the
4958interpreter is extended with new object types written in C. Another
4959reason for using the Python heap is the desire to \emph{inform} the
4960Python memory manager about the memory needs of the extension module.
4961Even when the requested memory is used exclusively for internal,
4962highly-specific purposes, delegating all memory requests to the Python
4963memory manager causes the interpreter to have a more accurate image of
4964its memory footprint as a whole. Consequently, under certain
4965circumstances, the Python memory manager may or may not trigger
4966appropriate actions, like garbage collection, memory compaction or
4967other preventive procedures. Note that by using the C library
4968allocator as shown in the previous example, the allocated memory for
4969the I/O buffer escapes completely the Python memory manager.
4970
4971
4972\section{Memory Interface \label{memoryInterface}}
4973
4974The following function sets, modeled after the ANSI C standard, are
4975available for allocating and releasing memory from the Python heap:
4976
4977
Fred Drake7d45d342000-08-11 17:07:32 +00004978\begin{cfuncdesc}{void*}{PyMem_Malloc}{size_t n}
4979Allocates \var{n} bytes and returns a pointer of type \ctype{void*} to
Fred Drakebab29652001-07-10 16:10:08 +00004980the allocated memory, or \NULL{} if the request fails. Requesting zero
Fred Drake659ebfa2000-04-03 15:42:13 +00004981bytes returns a non-\NULL{} pointer.
Fred Drakebab29652001-07-10 16:10:08 +00004982The memory will not have been initialized in any way.
Fred Drake659ebfa2000-04-03 15:42:13 +00004983\end{cfuncdesc}
4984
Fred Drake7d45d342000-08-11 17:07:32 +00004985\begin{cfuncdesc}{void*}{PyMem_Realloc}{void *p, size_t n}
Fred Drake659ebfa2000-04-03 15:42:13 +00004986Resizes the memory block pointed to by \var{p} to \var{n} bytes. The
4987contents will be unchanged to the minimum of the old and the new
4988sizes. If \var{p} is \NULL{}, the call is equivalent to
Fred Drakebab29652001-07-10 16:10:08 +00004989\cfunction{PyMem_Malloc(\var{n})}; if \var{n} is equal to zero, the
4990memory block is resized but is not freed, and the returned pointer is
4991non-\NULL{}. Unless \var{p} is \NULL{}, it must have been returned by
4992a previous call to \cfunction{PyMem_Malloc()} or
4993\cfunction{PyMem_Realloc()}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004994\end{cfuncdesc}
4995
Fred Drake7d45d342000-08-11 17:07:32 +00004996\begin{cfuncdesc}{void}{PyMem_Free}{void *p}
Fred Drake659ebfa2000-04-03 15:42:13 +00004997Frees the memory block pointed to by \var{p}, which must have been
4998returned by a previous call to \cfunction{PyMem_Malloc()} or
4999\cfunction{PyMem_Realloc()}. Otherwise, or if
5000\cfunction{PyMem_Free(p)} has been called before, undefined behaviour
5001occurs. If \var{p} is \NULL{}, no operation is performed.
5002\end{cfuncdesc}
5003
Fred Drake659ebfa2000-04-03 15:42:13 +00005004The following type-oriented macros are provided for convenience. Note
5005that \var{TYPE} refers to any C type.
5006
Fred Drakef913e542000-09-12 20:17:17 +00005007\begin{cfuncdesc}{\var{TYPE}*}{PyMem_New}{TYPE, size_t n}
Fred Drake659ebfa2000-04-03 15:42:13 +00005008Same as \cfunction{PyMem_Malloc()}, but allocates \code{(\var{n} *
5009sizeof(\var{TYPE}))} bytes of memory. Returns a pointer cast to
5010\ctype{\var{TYPE}*}.
Fred Drakebab29652001-07-10 16:10:08 +00005011The memory will not have been initialized in any way.
Fred Drake659ebfa2000-04-03 15:42:13 +00005012\end{cfuncdesc}
5013
Fred Drakef913e542000-09-12 20:17:17 +00005014\begin{cfuncdesc}{\var{TYPE}*}{PyMem_Resize}{void *p, TYPE, size_t n}
Fred Drake659ebfa2000-04-03 15:42:13 +00005015Same as \cfunction{PyMem_Realloc()}, but the memory block is resized
5016to \code{(\var{n} * sizeof(\var{TYPE}))} bytes. Returns a pointer
5017cast to \ctype{\var{TYPE}*}.
5018\end{cfuncdesc}
5019
Fred Drakef913e542000-09-12 20:17:17 +00005020\begin{cfuncdesc}{void}{PyMem_Del}{void *p}
Fred Drake659ebfa2000-04-03 15:42:13 +00005021Same as \cfunction{PyMem_Free()}.
5022\end{cfuncdesc}
5023
Fred Drakef913e542000-09-12 20:17:17 +00005024In addition, the following macro sets are provided for calling the
5025Python memory allocator directly, without involving the C API functions
5026listed above. However, note that their use does not preserve binary
5027compatibility accross Python versions and is therefore deprecated in
5028extension modules.
5029
5030\cfunction{PyMem_MALLOC()}, \cfunction{PyMem_REALLOC()}, \cfunction{PyMem_FREE()}.
5031
5032\cfunction{PyMem_NEW()}, \cfunction{PyMem_RESIZE()}, \cfunction{PyMem_DEL()}.
5033
Fred Drake659ebfa2000-04-03 15:42:13 +00005034
5035\section{Examples \label{memoryExamples}}
5036
5037Here is the example from section \ref{memoryOverview}, rewritten so
5038that the I/O buffer is allocated from the Python heap by using the
5039first function set:
5040
5041\begin{verbatim}
5042 PyObject *res;
5043 char *buf = (char *) PyMem_Malloc(BUFSIZ); /* for I/O */
5044
5045 if (buf == NULL)
5046 return PyErr_NoMemory();
5047 /* ...Do some I/O operation involving buf... */
5048 res = PyString_FromString(buf);
5049 PyMem_Free(buf); /* allocated with PyMem_Malloc */
5050 return res;
5051\end{verbatim}
5052
Fred Drakef913e542000-09-12 20:17:17 +00005053The same code using the type-oriented function set:
Fred Drake659ebfa2000-04-03 15:42:13 +00005054
5055\begin{verbatim}
5056 PyObject *res;
Fred Drakef913e542000-09-12 20:17:17 +00005057 char *buf = PyMem_New(char, BUFSIZ); /* for I/O */
Fred Drake659ebfa2000-04-03 15:42:13 +00005058
5059 if (buf == NULL)
5060 return PyErr_NoMemory();
5061 /* ...Do some I/O operation involving buf... */
5062 res = PyString_FromString(buf);
Fred Drakef913e542000-09-12 20:17:17 +00005063 PyMem_Del(buf); /* allocated with PyMem_New */
Fred Drake659ebfa2000-04-03 15:42:13 +00005064 return res;
5065\end{verbatim}
5066
Fred Drakef913e542000-09-12 20:17:17 +00005067Note that in the two examples above, the buffer is always
5068manipulated via functions belonging to the same set. Indeed, it
Fred Drake659ebfa2000-04-03 15:42:13 +00005069is required to use the same memory API family for a given
5070memory block, so that the risk of mixing different allocators is
5071reduced to a minimum. The following code sequence contains two errors,
5072one of which is labeled as \emph{fatal} because it mixes two different
5073allocators operating on different heaps.
5074
5075\begin{verbatim}
Fred Drakef913e542000-09-12 20:17:17 +00005076char *buf1 = PyMem_New(char, BUFSIZ);
Fred Drake659ebfa2000-04-03 15:42:13 +00005077char *buf2 = (char *) malloc(BUFSIZ);
5078char *buf3 = (char *) PyMem_Malloc(BUFSIZ);
5079...
Fred Drakef913e542000-09-12 20:17:17 +00005080PyMem_Del(buf3); /* Wrong -- should be PyMem_Free() */
Fred Drake659ebfa2000-04-03 15:42:13 +00005081free(buf2); /* Right -- allocated via malloc() */
Fred Drakef913e542000-09-12 20:17:17 +00005082free(buf1); /* Fatal -- should be PyMem_Del() */
Fred Drake659ebfa2000-04-03 15:42:13 +00005083\end{verbatim}
5084
5085In addition to the functions aimed at handling raw memory blocks from
5086the Python heap, objects in Python are allocated and released with
Fred Drakef913e542000-09-12 20:17:17 +00005087\cfunction{PyObject_New()}, \cfunction{PyObject_NewVar()} and
5088\cfunction{PyObject_Del()}, or with their corresponding macros
5089\cfunction{PyObject_NEW()}, \cfunction{PyObject_NEW_VAR()} and
Fred Drakee06f0f92000-06-30 15:52:39 +00005090\cfunction{PyObject_DEL()}.
Fred Drake659ebfa2000-04-03 15:42:13 +00005091
Fred Drakee06f0f92000-06-30 15:52:39 +00005092These will be explained in the next chapter on defining and
5093implementing new object types in C.
Fred Drake659ebfa2000-04-03 15:42:13 +00005094
5095
Fred Drakeefd146c1999-02-15 15:30:45 +00005096\chapter{Defining New Object Types \label{newTypes}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00005097
Fred Drake88fdaa72001-07-20 20:56:11 +00005098
5099\section{Allocating Objects on the Heap
5100 \label{allocating-objects}}
5101
Fred Drakec6fa34e1998-04-02 06:47:24 +00005102\begin{cfuncdesc}{PyObject*}{_PyObject_New}{PyTypeObject *type}
Fred Drakee058b4f1998-02-16 06:15:35 +00005103\end{cfuncdesc}
5104
Fred Drakef913e542000-09-12 20:17:17 +00005105\begin{cfuncdesc}{PyVarObject*}{_PyObject_NewVar}{PyTypeObject *type, int size}
Fred Drakee058b4f1998-02-16 06:15:35 +00005106\end{cfuncdesc}
5107
Fred Drakef913e542000-09-12 20:17:17 +00005108\begin{cfuncdesc}{void}{_PyObject_Del}{PyObject *op}
Fred Drakee058b4f1998-02-16 06:15:35 +00005109\end{cfuncdesc}
5110
Fred Drakef913e542000-09-12 20:17:17 +00005111\begin{cfuncdesc}{PyObject*}{PyObject_Init}{PyObject *op,
Fred Drakebab29652001-07-10 16:10:08 +00005112 PyTypeObject *type}
5113 Initialize a newly-allocated object \var{op} with its type and
5114 initial reference. Returns the initialized object. If \var{type}
5115 indicates that the object participates in the cyclic garbage
5116 detector, it it added to the detector's set of observed objects.
5117 Other fields of the object are not affected.
Fred Drakef913e542000-09-12 20:17:17 +00005118\end{cfuncdesc}
5119
5120\begin{cfuncdesc}{PyVarObject*}{PyObject_InitVar}{PyVarObject *op,
Fred Drakebab29652001-07-10 16:10:08 +00005121 PyTypeObject *type, int size}
5122 This does everything \cfunction{PyObject_Init()} does, and also
5123 initializes the length information for a variable-size object.
Fred Drakef913e542000-09-12 20:17:17 +00005124\end{cfuncdesc}
5125
5126\begin{cfuncdesc}{\var{TYPE}*}{PyObject_New}{TYPE, PyTypeObject *type}
Fred Drakebab29652001-07-10 16:10:08 +00005127 Allocate a new Python object using the C structure type \var{TYPE}
5128 and the Python type object \var{type}. Fields not defined by the
5129 Python object header are not initialized; the object's reference
5130 count will be one. The size of the memory
5131 allocation is determined from the \member{tp_basicsize} field of the
5132 type object.
Fred Drakef913e542000-09-12 20:17:17 +00005133\end{cfuncdesc}
5134
5135\begin{cfuncdesc}{\var{TYPE}*}{PyObject_NewVar}{TYPE, PyTypeObject *type,
5136 int size}
Fred Drakebab29652001-07-10 16:10:08 +00005137 Allocate a new Python object using the C structure type \var{TYPE}
5138 and the Python type object \var{type}. Fields not defined by the
5139 Python object header are not initialized. The allocated memory
5140 allows for the \var{TYPE} structure plus \var{size} fields of the
5141 size given by the \member{tp_itemsize} field of \var{type}. This is
5142 useful for implementing objects like tuples, which are able to
5143 determine their size at construction time. Embedding the array of
5144 fields into the same allocation decreases the number of allocations,
5145 improving the memory management efficiency.
Fred Drakef913e542000-09-12 20:17:17 +00005146\end{cfuncdesc}
5147
5148\begin{cfuncdesc}{void}{PyObject_Del}{PyObject *op}
Fred Drakebab29652001-07-10 16:10:08 +00005149 Releases memory allocated to an object using
5150 \cfunction{PyObject_New()} or \cfunction{PyObject_NewVar()}. This
5151 is normally called from the \member{tp_dealloc} handler specified in
5152 the object's type. The fields of the object should not be accessed
5153 after this call as the memory is no longer a valid Python object.
Fred Drakef913e542000-09-12 20:17:17 +00005154\end{cfuncdesc}
5155
5156\begin{cfuncdesc}{\var{TYPE}*}{PyObject_NEW}{TYPE, PyTypeObject *type}
Fred Drakebab29652001-07-10 16:10:08 +00005157 Macro version of \cfunction{PyObject_New()}, to gain performance at
5158 the expense of safety. This does not check \var{type} for a \NULL{}
5159 value.
Fred Drakef913e542000-09-12 20:17:17 +00005160\end{cfuncdesc}
5161
5162\begin{cfuncdesc}{\var{TYPE}*}{PyObject_NEW_VAR}{TYPE, PyTypeObject *type,
5163 int size}
Fred Drakebab29652001-07-10 16:10:08 +00005164 Macro version of \cfunction{PyObject_NewVar()}, to gain performance
5165 at the expense of safety. This does not check \var{type} for a
5166 \NULL{} value.
Fred Drakef913e542000-09-12 20:17:17 +00005167\end{cfuncdesc}
5168
5169\begin{cfuncdesc}{void}{PyObject_DEL}{PyObject *op}
Fred Drakebab29652001-07-10 16:10:08 +00005170 Macro version of \cfunction{PyObject_Del()}.
Fred Drakee058b4f1998-02-16 06:15:35 +00005171\end{cfuncdesc}
5172
Fred Drakeee814bf2000-11-28 22:34:32 +00005173\begin{cfuncdesc}{PyObject*}{Py_InitModule}{char *name,
5174 PyMethodDef *methods}
5175 Create a new module object based on a name and table of functions,
5176 returning the new module object.
5177\end{cfuncdesc}
5178
5179\begin{cfuncdesc}{PyObject*}{Py_InitModule3}{char *name,
5180 PyMethodDef *methods,
5181 char *doc}
5182 Create a new module object based on a name and table of functions,
5183 returning the new module object. If \var{doc} is non-\NULL, it will
5184 be used to define the docstring for the module.
5185\end{cfuncdesc}
5186
5187\begin{cfuncdesc}{PyObject*}{Py_InitModule4}{char *name,
5188 PyMethodDef *methods,
5189 char *doc, PyObject *self,
5190 int apiver}
5191 Create a new module object based on a name and table of functions,
5192 returning the new module object. If \var{doc} is non-\NULL, it will
5193 be used to define the docstring for the module. If \var{self} is
5194 non-\NULL, it will passed to the functions of the module as their
5195 (otherwise \NULL) first parameter. (This was added as an
5196 experimental feature, and there are no known uses in the current
5197 version of Python.) For \var{apiver}, the only value which should
5198 be passed is defined by the constant \constant{PYTHON_API_VERSION}.
5199
5200 \strong{Note:} Most uses of this function should probably be using
5201 the \cfunction{Py_InitModule3()} instead; only use this if you are
5202 sure you need it.
5203\end{cfuncdesc}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00005204
Fred Drake659ebfa2000-04-03 15:42:13 +00005205DL_IMPORT
5206
Fred Drakebab29652001-07-10 16:10:08 +00005207\begin{cvardesc}{PyObject}{_Py_NoneStruct}
5208 Object which is visible in Python as \code{None}. This should only
5209 be accessed using the \code{Py_None} macro, which evaluates to a
5210 pointer to this object.
5211\end{cvardesc}
Fred Drake659ebfa2000-04-03 15:42:13 +00005212
5213
5214\section{Common Object Structures \label{common-structs}}
5215
Guido van Rossumae110af1997-05-22 20:11:52 +00005216PyObject, PyVarObject
5217
5218PyObject_HEAD, PyObject_HEAD_INIT, PyObject_VAR_HEAD
5219
5220Typedefs:
5221unaryfunc, binaryfunc, ternaryfunc, inquiry, coercion, intargfunc,
5222intintargfunc, intobjargproc, intintobjargproc, objobjargproc,
Guido van Rossumae110af1997-05-22 20:11:52 +00005223destructor, printfunc, getattrfunc, getattrofunc, setattrfunc,
5224setattrofunc, cmpfunc, reprfunc, hashfunc
5225
Fred Drakea8455ab2000-06-16 19:58:42 +00005226\begin{ctypedesc}{PyCFunction}
5227Type of the functions used to implement most Python callables in C.
5228\end{ctypedesc}
5229
5230\begin{ctypedesc}{PyMethodDef}
5231Structure used to describe a method of an extension type. This
5232structure has four fields:
5233
5234\begin{tableiii}{l|l|l}{member}{Field}{C Type}{Meaning}
5235 \lineiii{ml_name}{char *}{name of the method}
5236 \lineiii{ml_meth}{PyCFunction}{pointer to the C implementation}
5237 \lineiii{ml_flags}{int}{flag bits indicating how the call should be
5238 constructed}
5239 \lineiii{ml_doc}{char *}{points to the contents of the docstring}
5240\end{tableiii}
5241\end{ctypedesc}
5242
5243\begin{cfuncdesc}{PyObject*}{Py_FindMethod}{PyMethodDef[] table,
5244 PyObject *ob, char *name}
5245Return a bound method object for an extension type implemented in C.
5246This function also handles the special attribute \member{__methods__},
5247returning a list of all the method names defined in \var{table}.
5248\end{cfuncdesc}
5249
Fred Drake659ebfa2000-04-03 15:42:13 +00005250
5251\section{Mapping Object Structures \label{mapping-structs}}
5252
5253\begin{ctypedesc}{PyMappingMethods}
5254Structure used to hold pointers to the functions used to implement the
5255mapping protocol for an extension type.
5256\end{ctypedesc}
5257
5258
5259\section{Number Object Structures \label{number-structs}}
5260
5261\begin{ctypedesc}{PyNumberMethods}
5262Structure used to hold pointers to the functions an extension type
5263uses to implement the number protocol.
5264\end{ctypedesc}
5265
5266
5267\section{Sequence Object Structures \label{sequence-structs}}
5268
5269\begin{ctypedesc}{PySequenceMethods}
5270Structure used to hold pointers to the functions which an object uses
5271to implement the sequence protocol.
5272\end{ctypedesc}
5273
5274
5275\section{Buffer Object Structures \label{buffer-structs}}
5276\sectionauthor{Greg J. Stein}{greg@lyra.org}
5277
5278The buffer interface exports a model where an object can expose its
5279internal data as a set of chunks of data, where each chunk is
5280specified as a pointer/length pair. These chunks are called
5281\dfn{segments} and are presumed to be non-contiguous in memory.
5282
5283If an object does not export the buffer interface, then its
5284\member{tp_as_buffer} member in the \ctype{PyTypeObject} structure
5285should be \NULL{}. Otherwise, the \member{tp_as_buffer} will point to
5286a \ctype{PyBufferProcs} structure.
5287
5288\strong{Note:} It is very important that your
Fred Drakec392b572001-03-21 22:15:01 +00005289\ctype{PyTypeObject} structure uses \constant{Py_TPFLAGS_DEFAULT} for
5290the value of the \member{tp_flags} member rather than \code{0}. This
Fred Drake659ebfa2000-04-03 15:42:13 +00005291tells the Python runtime that your \ctype{PyBufferProcs} structure
5292contains the \member{bf_getcharbuffer} slot. Older versions of Python
5293did not have this member, so a new Python interpreter using an old
5294extension needs to be able to test for its presence before using it.
5295
5296\begin{ctypedesc}{PyBufferProcs}
5297Structure used to hold the function pointers which define an
5298implementation of the buffer protocol.
5299
5300The first slot is \member{bf_getreadbuffer}, of type
5301\ctype{getreadbufferproc}. If this slot is \NULL{}, then the object
5302does not support reading from the internal data. This is
5303non-sensical, so implementors should fill this in, but callers should
5304test that the slot contains a non-\NULL{} value.
5305
5306The next slot is \member{bf_getwritebuffer} having type
5307\ctype{getwritebufferproc}. This slot may be \NULL{} if the object
5308does not allow writing into its returned buffers.
5309
5310The third slot is \member{bf_getsegcount}, with type
5311\ctype{getsegcountproc}. This slot must not be \NULL{} and is used to
5312inform the caller how many segments the object contains. Simple
5313objects such as \ctype{PyString_Type} and
5314\ctype{PyBuffer_Type} objects contain a single segment.
5315
5316The last slot is \member{bf_getcharbuffer}, of type
5317\ctype{getcharbufferproc}. This slot will only be present if the
Fred Drakec392b572001-03-21 22:15:01 +00005318\constant{Py_TPFLAGS_HAVE_GETCHARBUFFER} flag is present in the
Fred Drake659ebfa2000-04-03 15:42:13 +00005319\member{tp_flags} field of the object's \ctype{PyTypeObject}. Before using
5320this slot, the caller should test whether it is present by using the
5321\cfunction{PyType_HasFeature()}\ttindex{PyType_HasFeature()} function.
5322If present, it may be \NULL, indicating that the object's contents
5323cannot be used as \emph{8-bit characters}.
5324The slot function may also raise an error if the object's contents
5325cannot be interpreted as 8-bit characters. For example, if the object
5326is an array which is configured to hold floating point values, an
5327exception may be raised if a caller attempts to use
5328\member{bf_getcharbuffer} to fetch a sequence of 8-bit characters.
5329This notion of exporting the internal buffers as ``text'' is used to
5330distinguish between objects that are binary in nature, and those which
5331have character-based content.
5332
5333\strong{Note:} The current policy seems to state that these characters
5334may be multi-byte characters. This implies that a buffer size of
5335\var{N} does not mean there are \var{N} characters present.
5336\end{ctypedesc}
5337
5338\begin{datadesc}{Py_TPFLAGS_HAVE_GETCHARBUFFER}
5339Flag bit set in the type structure to indicate that the
5340\member{bf_getcharbuffer} slot is known. This being set does not
5341indicate that the object supports the buffer interface or that the
5342\member{bf_getcharbuffer} slot is non-\NULL.
5343\end{datadesc}
5344
5345\begin{ctypedesc}[getreadbufferproc]{int (*getreadbufferproc)
5346 (PyObject *self, int segment, void **ptrptr)}
5347Return a pointer to a readable segment of the buffer. This function
5348is allowed to raise an exception, in which case it must return
5349\code{-1}. The \var{segment} which is passed must be zero or
5350positive, and strictly less than the number of segments returned by
Greg Stein4d4d0032001-04-07 16:14:49 +00005351the \member{bf_getsegcount} slot function. On success, it returns the
5352length of the buffer memory, and sets \code{*\var{ptrptr}} to a
5353pointer to that memory.
Fred Drake659ebfa2000-04-03 15:42:13 +00005354\end{ctypedesc}
5355
5356\begin{ctypedesc}[getwritebufferproc]{int (*getwritebufferproc)
5357 (PyObject *self, int segment, void **ptrptr)}
Greg Stein4d4d0032001-04-07 16:14:49 +00005358Return a pointer to a writable memory buffer in \code{*\var{ptrptr}},
5359and the length of that segment as the function return value.
5360The memory buffer must correspond to buffer segment \var{segment}.
Fred Drake58c5a2a1999-08-04 13:13:24 +00005361Must return \code{-1} and set an exception on error.
5362\exception{TypeError} should be raised if the object only supports
5363read-only buffers, and \exception{SystemError} should be raised when
5364\var{segment} specifies a segment that doesn't exist.
5365% Why doesn't it raise ValueError for this one?
Fred Drake659ebfa2000-04-03 15:42:13 +00005366% GJS: because you shouldn't be calling it with an invalid
5367% segment. That indicates a blatant programming error in the C
5368% code.
Fred Drake58c5a2a1999-08-04 13:13:24 +00005369\end{ctypedesc}
5370
Fred Drake659ebfa2000-04-03 15:42:13 +00005371\begin{ctypedesc}[getsegcountproc]{int (*getsegcountproc)
5372 (PyObject *self, int *lenp)}
5373Return the number of memory segments which comprise the buffer. If
5374\var{lenp} is not \NULL, the implementation must report the sum of the
5375sizes (in bytes) of all segments in \code{*\var{lenp}}.
5376The function cannot fail.
5377\end{ctypedesc}
Guido van Rossumae110af1997-05-22 20:11:52 +00005378
Fred Drake659ebfa2000-04-03 15:42:13 +00005379\begin{ctypedesc}[getcharbufferproc]{int (*getcharbufferproc)
5380 (PyObject *self, int segment, const char **ptrptr)}
5381\end{ctypedesc}
Guido van Rossumae110af1997-05-22 20:11:52 +00005382
Guido van Rossumae110af1997-05-22 20:11:52 +00005383
Fred Drakef90490e2001-08-02 18:00:28 +00005384\section{Supporting the Iterator Protocol
5385 \label{supporting-iteration}}
5386
5387
Fred Drakec392b572001-03-21 22:15:01 +00005388\section{Supporting Cyclic Garbarge Collection
5389 \label{supporting-cycle-detection}}
5390
5391Python's support for detecting and collecting garbage which involves
5392circular references requires support from object types which are
5393``containers'' for other objects which may also be containers. Types
5394which do not store references to other objects, or which only store
5395references to atomic types (such as numbers or strings), do not need
5396to provide any explicit support for garbage collection.
5397
5398To create a container type, the \member{tp_flags} field of the type
5399object must include the \constant{Py_TPFLAGS_GC} and provide an
Fred Drakee28d8ae2001-03-22 16:30:17 +00005400implementation of the \member{tp_traverse} handler. The computed
5401value of the \member{tp_basicsize} field must include
5402\constant{PyGC_HEAD_SIZE} as well. If instances of the type are
5403mutable, a \member{tp_clear} implementation must also be provided.
Fred Drakec392b572001-03-21 22:15:01 +00005404
5405\begin{datadesc}{Py_TPFLAGS_GC}
5406 Objects with a type with this flag set must conform with the rules
5407 documented here. For convenience these objects will be referred to
5408 as container objects.
5409\end{datadesc}
5410
5411\begin{datadesc}{PyGC_HEAD_SIZE}
5412 Extra memory needed for the garbage collector. Container objects
5413 must include this in the calculation of their tp_basicsize. If the
5414 collector is disabled at compile time then this is \code{0}.
5415\end{datadesc}
5416
Fred Drakee28d8ae2001-03-22 16:30:17 +00005417Constructors for container types must conform to two rules:
5418
5419\begin{enumerate}
5420\item The memory for the object must be allocated using
5421 \cfunction{PyObject_New()} or \cfunction{PyObject_VarNew()}.
5422
5423\item Once all the fields which may contain references to other
5424 containers are initialized, it must call
5425 \cfunction{PyObject_GC_Init()}.
5426\end{enumerate}
5427
Fred Drakec392b572001-03-21 22:15:01 +00005428\begin{cfuncdesc}{void}{PyObject_GC_Init}{PyObject *op}
5429 Adds the object \var{op} to the set of container objects tracked by
5430 the collector. The collector can run at unexpected times so objects
5431 must be valid while being tracked. This should be called once all
5432 the fields followed by the \member{tp_traverse} handler become valid,
5433 usually near the end of the constructor.
5434\end{cfuncdesc}
5435
Fred Drakee28d8ae2001-03-22 16:30:17 +00005436Similarly, the deallocator for the object must conform to a similar
5437pair of rules:
5438
5439\begin{enumerate}
5440\item Before fields which refer to other containers are invalidated,
5441 \cfunction{PyObject_GC_Fini()} must be called.
5442
5443\item The object's memory must be deallocated using
5444 \cfunction{PyObject_Del()}.
5445\end{enumerate}
5446
Fred Drakec392b572001-03-21 22:15:01 +00005447\begin{cfuncdesc}{void}{PyObject_GC_Fini}{PyObject *op}
5448 Remove the object \var{op} from the set of container objects tracked
5449 by the collector. Note that \cfunction{PyObject_GC_Init()} can be
5450 called again on this object to add it back to the set of tracked
5451 objects. The deallocator (\member{tp_dealloc} handler) should call
5452 this for the object before any of the fields used by the
5453 \member{tp_traverse} handler become invalid.
Fred Drake8f6df462001-03-23 17:42:09 +00005454
5455 \strong{Note:} Any container which may be referenced from another
5456 object reachable by the collector must itself be tracked by the
5457 collector, so it is generally not safe to call this function
5458 anywhere but in the object's deallocator.
Fred Drakec392b572001-03-21 22:15:01 +00005459\end{cfuncdesc}
5460
5461The \member{tp_traverse} handler accepts a function parameter of this
5462type:
5463
5464\begin{ctypedesc}[visitproc]{int (*visitproc)(PyObject *object, void *arg)}
5465 Type of the visitor function passed to the \member{tp_traverse}
5466 handler. The function should be called with an object to traverse
5467 as \var{object} and the third parameter to the \member{tp_traverse}
5468 handler as \var{arg}.
5469\end{ctypedesc}
5470
5471The \member{tp_traverse} handler must have the following type:
5472
5473\begin{ctypedesc}[traverseproc]{int (*traverseproc)(PyObject *self,
5474 visitproc visit, void *arg)}
5475 Traversal function for a container object. Implementations must
5476 call the \var{visit} function for each object directly contained by
5477 \var{self}, with the parameters to \var{visit} being the contained
5478 object and the \var{arg} value passed to the handler. If
5479 \var{visit} returns a non-zero value then an error has occurred and
5480 that value should be returned immediately.
5481\end{ctypedesc}
5482
5483The \member{tp_clear} handler must be of the \ctype{inquiry} type, or
5484\NULL{} if the object is immutable.
5485
5486\begin{ctypedesc}[inquiry]{int (*inquiry)(PyObject *self)}
5487 Drop references that may have created reference cycles. Immutable
5488 objects do not have to define this method since they can never
5489 directly create reference cycles. Note that the object must still
Fred Drakebab29652001-07-10 16:10:08 +00005490 be valid after calling this method (don't just call
Fred Drakec392b572001-03-21 22:15:01 +00005491 \cfunction{Py_DECREF()} on a reference). The collector will call
5492 this method if it detects that this object is involved in a
5493 reference cycle.
5494\end{ctypedesc}
5495
5496
Fred Drakee28d8ae2001-03-22 16:30:17 +00005497\subsection{Example Cycle Collector Support
5498 \label{example-cycle-support}}
5499
5500This example shows only enough of the implementation of an extension
5501type to show how the garbage collector support needs to be added. It
5502shows the definition of the object structure, the
5503\member{tp_traverse}, \member{tp_clear} and \member{tp_dealloc}
5504implementations, the type structure, and a constructor --- the module
5505initialization needed to export the constructor to Python is not shown
5506as there are no special considerations there for the collector. To
5507make this interesting, assume that the module exposes ways for the
5508\member{container} field of the object to be modified. Note that
5509since no checks are made on the type of the object used to initialize
5510\member{container}, we have to assume that it may be a container.
5511
5512\begin{verbatim}
5513#include "Python.h"
5514
5515typedef struct {
5516 PyObject_HEAD
5517 PyObject *container;
5518} MyObject;
5519
5520static int
5521my_traverse(MyObject *self, visitproc visit, void *arg)
5522{
5523 if (self->container != NULL)
5524 return visit(self->container, arg);
5525 else
5526 return 0;
5527}
5528
5529static int
5530my_clear(MyObject *self)
5531{
5532 Py_XDECREF(self->container);
5533 self->container = NULL;
5534
5535 return 0;
5536}
5537
5538static void
5539my_dealloc(MyObject *self)
5540{
5541 PyObject_GC_Fini((PyObject *) self);
5542 Py_XDECREF(self->container);
5543 PyObject_Del(self);
5544}
5545\end{verbatim}
5546
5547\begin{verbatim}
5548statichere PyTypeObject
5549MyObject_Type = {
5550 PyObject_HEAD_INIT(NULL)
5551 0,
5552 "MyObject",
5553 sizeof(MyObject) + PyGC_HEAD_SIZE,
5554 0,
5555 (destructor)my_dealloc, /* tp_dealloc */
5556 0, /* tp_print */
5557 0, /* tp_getattr */
5558 0, /* tp_setattr */
5559 0, /* tp_compare */
5560 0, /* tp_repr */
5561 0, /* tp_as_number */
5562 0, /* tp_as_sequence */
5563 0, /* tp_as_mapping */
5564 0, /* tp_hash */
5565 0, /* tp_call */
5566 0, /* tp_str */
5567 0, /* tp_getattro */
5568 0, /* tp_setattro */
5569 0, /* tp_as_buffer */
5570 Py_TPFLAGS_DEFAULT | Py_TPFLAGS_GC,
5571 0, /* tp_doc */
5572 (traverseproc)my_traverse, /* tp_traverse */
5573 (inquiry)my_clear, /* tp_clear */
5574 0, /* tp_richcompare */
5575 0, /* tp_weaklistoffset */
5576};
5577
5578/* This constructor should be made accessible from Python. */
5579static PyObject *
5580new_object(PyObject *unused, PyObject *args)
5581{
5582 PyObject *container = NULL;
5583 MyObject *result = NULL;
5584
5585 if (PyArg_ParseTuple(args, "|O:new_object", &container)) {
5586 result = PyObject_New(MyObject, &MyObject_Type);
5587 if (result != NULL) {
5588 result->container = container;
5589 PyObject_GC_Init();
5590 }
5591 }
5592 return (PyObject *) result;
5593}
5594\end{verbatim}
5595
5596
Fred Drake659ebfa2000-04-03 15:42:13 +00005597% \chapter{Debugging \label{debugging}}
5598%
5599% XXX Explain Py_DEBUG, Py_TRACE_REFS, Py_REF_DEBUG.
Guido van Rossum5b8a5231997-12-30 04:38:44 +00005600
5601
Fred Drakeed773ef2000-09-21 21:35:22 +00005602\appendix
5603\chapter{Reporting Bugs}
5604\input{reportingbugs}
5605
Fred Drake490d34d2001-06-20 21:39:12 +00005606\chapter{History and License}
5607\input{license}
5608
Marc-André Lemburga544ea22001-01-17 18:04:31 +00005609\input{api.ind} % Index -- must be last
Guido van Rossum9231c8f1997-05-15 21:43:21 +00005610
5611\end{document}