blob: 4c55b9691bbc4e863803019d630ba3506bc0cb7c [file] [log] [blame]
Fred Drake6659c301998-03-03 22:02:19 +00001\documentclass{manual}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002
Guido van Rossum9faf4c51997-10-07 14:38:54 +00003\title{Python/C API Reference Manual}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00004
5\input{boilerplate}
6
Marc-André Lemburga544ea22001-01-17 18:04:31 +00007\makeindex % tell \index to actually write the .idx file
Guido van Rossum9231c8f1997-05-15 21:43:21 +00008
9
10\begin{document}
11
Guido van Rossum9231c8f1997-05-15 21:43:21 +000012\maketitle
13
Fred Drake9f86b661998-07-28 21:55:19 +000014\ifhtml
15\chapter*{Front Matter\label{front}}
16\fi
17
Guido van Rossum9231c8f1997-05-15 21:43:21 +000018\input{copyright}
19
20\begin{abstract}
21
22\noindent
Fred Drake659ebfa2000-04-03 15:42:13 +000023This manual documents the API used by C and \Cpp{} programmers who
Fred Drakee058b4f1998-02-16 06:15:35 +000024want to write extension modules or embed Python. It is a companion to
Fred Drakebe486461999-11-09 17:03:03 +000025\citetitle[../ext/ext.html]{Extending and Embedding the Python
26Interpreter}, which describes the general principles of extension
27writing but does not document the API functions in detail.
Guido van Rossum9231c8f1997-05-15 21:43:21 +000028
Guido van Rossum5b8a5231997-12-30 04:38:44 +000029\strong{Warning:} The current version of this document is incomplete.
30I hope that it is nevertheless useful. I will continue to work on it,
31and release new versions from time to time, independent from Python
32source code releases.
33
Guido van Rossum9231c8f1997-05-15 21:43:21 +000034\end{abstract}
35
Fred Drake4d4f9e71998-01-13 22:25:02 +000036\tableofcontents
Guido van Rossum9231c8f1997-05-15 21:43:21 +000037
Guido van Rossum5060b3b1997-08-17 18:02:23 +000038% XXX Consider moving all this back to ext.tex and giving api.tex
39% XXX a *really* short intro only.
Guido van Rossum9231c8f1997-05-15 21:43:21 +000040
Fred Drakeefd146c1999-02-15 15:30:45 +000041\chapter{Introduction \label{intro}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +000042
Fred Drake659ebfa2000-04-03 15:42:13 +000043The Application Programmer's Interface to Python gives C and
44\Cpp{} programmers access to the Python interpreter at a variety of
45levels. The API is equally usable from \Cpp{}, but for brevity it is
46generally referred to as the Python/C API. There are two
47fundamentally different reasons for using the Python/C API. The first
48reason is to write \emph{extension modules} for specific purposes;
49these are C modules that extend the Python interpreter. This is
50probably the most common use. The second reason is to use Python as a
51component in a larger application; this technique is generally
52referred to as \dfn{embedding} Python in an application.
Guido van Rossum59a61351997-08-14 20:34:33 +000053
Guido van Rossum4a944d71997-08-14 20:35:38 +000054Writing an extension module is a relatively well-understood process,
55where a ``cookbook'' approach works well. There are several tools
56that automate the process to some extent. While people have embedded
57Python in other applications since its early existence, the process of
Fred Drakefc43d002001-05-21 15:03:35 +000058embedding Python is less straightforward than writing an extension.
Guido van Rossum59a61351997-08-14 20:34:33 +000059
Guido van Rossum4a944d71997-08-14 20:35:38 +000060Many API functions are useful independent of whether you're embedding
61or extending Python; moreover, most applications that embed Python
62will need to provide a custom extension as well, so it's probably a
63good idea to become familiar with writing an extension before
Guido van Rossum59a61351997-08-14 20:34:33 +000064attempting to embed Python in a real application.
65
Fred Drakeefd146c1999-02-15 15:30:45 +000066
67\section{Include Files \label{includes}}
Guido van Rossum580aa8d1997-11-25 15:34:51 +000068
69All function, type and macro definitions needed to use the Python/C
70API are included in your code by the following line:
71
Fred Drakee058b4f1998-02-16 06:15:35 +000072\begin{verbatim}
73#include "Python.h"
74\end{verbatim}
Guido van Rossum580aa8d1997-11-25 15:34:51 +000075
Fred Drakee058b4f1998-02-16 06:15:35 +000076This implies inclusion of the following standard headers:
Fred Drake0b71cea2000-09-26 05:51:50 +000077\code{<stdio.h>}, \code{<string.h>}, \code{<errno.h>},
78\code{<limits.h>}, and \code{<stdlib.h>} (if available).
Guido van Rossum580aa8d1997-11-25 15:34:51 +000079
80All user visible names defined by Python.h (except those defined by
Fred Drakee058b4f1998-02-16 06:15:35 +000081the included standard headers) have one of the prefixes \samp{Py} or
Fred Drake659ebfa2000-04-03 15:42:13 +000082\samp{_Py}. Names beginning with \samp{_Py} are for internal use by
83the Python implementation and should not be used by extension writers.
84Structure member names do not have a reserved prefix.
Guido van Rossum580aa8d1997-11-25 15:34:51 +000085
Fred Drakee058b4f1998-02-16 06:15:35 +000086\strong{Important:} user code should never define names that begin
87with \samp{Py} or \samp{_Py}. This confuses the reader, and
88jeopardizes the portability of the user code to future Python
89versions, which may define additional names beginning with one of
90these prefixes.
Guido van Rossum580aa8d1997-11-25 15:34:51 +000091
Fred Drake659ebfa2000-04-03 15:42:13 +000092The header files are typically installed with Python. On \UNIX, these
93are located in the directories
94\file{\envvar{prefix}/include/python\var{version}/} and
95\file{\envvar{exec_prefix}/include/python\var{version}/}, where
96\envvar{prefix} and \envvar{exec_prefix} are defined by the
97corresponding parameters to Python's \program{configure} script and
98\var{version} is \code{sys.version[:3]}. On Windows, the headers are
99installed in \file{\envvar{prefix}/include}, where \envvar{prefix} is
100the installation directory specified to the installer.
101
102To include the headers, place both directories (if different) on your
103compiler's search path for includes. Do \emph{not} place the parent
104directories on the search path and then use
Fred Draked5d04352000-09-14 20:24:17 +0000105\samp{\#include <python\shortversion/Python.h>}; this will break on
Fred Drake659ebfa2000-04-03 15:42:13 +0000106multi-platform builds since the platform independent headers under
107\envvar{prefix} include the platform specific headers from
108\envvar{exec_prefix}.
109
Fred Drakeefd146c1999-02-15 15:30:45 +0000110
111\section{Objects, Types and Reference Counts \label{objects}}
Guido van Rossum59a61351997-08-14 20:34:33 +0000112
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000113Most Python/C API functions have one or more arguments as well as a
Fred Drake659ebfa2000-04-03 15:42:13 +0000114return value of type \ctype{PyObject*}. This type is a pointer
Fred Drakee058b4f1998-02-16 06:15:35 +0000115to an opaque data type representing an arbitrary Python
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000116object. Since all Python object types are treated the same way by the
117Python language in most situations (e.g., assignments, scope rules,
118and argument passing), it is only fitting that they should be
Fred Drake659ebfa2000-04-03 15:42:13 +0000119represented by a single C type. Almost all Python objects live on the
120heap: you never declare an automatic or static variable of type
121\ctype{PyObject}, only pointer variables of type \ctype{PyObject*} can
122be declared. The sole exception are the type objects\obindex{type};
123since these must never be deallocated, they are typically static
124\ctype{PyTypeObject} objects.
Guido van Rossum59a61351997-08-14 20:34:33 +0000125
Fred Drakee058b4f1998-02-16 06:15:35 +0000126All Python objects (even Python integers) have a \dfn{type} and a
127\dfn{reference count}. An object's type determines what kind of object
Guido van Rossum4a944d71997-08-14 20:35:38 +0000128it is (e.g., an integer, a list, or a user-defined function; there are
Fred Drakebe486461999-11-09 17:03:03 +0000129many more as explained in the \citetitle[../ref/ref.html]{Python
130Reference Manual}). For each of the well-known types there is a macro
131to check whether an object is of that type; for instance,
Fred Drake659ebfa2000-04-03 15:42:13 +0000132\samp{PyList_Check(\var{a})} is true if (and only if) the object
133pointed to by \var{a} is a Python list.
Guido van Rossum59a61351997-08-14 20:34:33 +0000134
Fred Drakeefd146c1999-02-15 15:30:45 +0000135
136\subsection{Reference Counts \label{refcounts}}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000137
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000138The reference count is important because today's computers have a
Fred Drake003d8da1998-04-13 00:53:42 +0000139finite (and often severely limited) memory size; it counts how many
Guido van Rossum4a944d71997-08-14 20:35:38 +0000140different places there are that have a reference to an object. Such a
Fred Drake659ebfa2000-04-03 15:42:13 +0000141place could be another object, or a global (or static) C variable, or
142a local variable in some C function. When an object's reference count
Guido van Rossum4a944d71997-08-14 20:35:38 +0000143becomes zero, the object is deallocated. If it contains references to
144other objects, their reference count is decremented. Those other
145objects may be deallocated in turn, if this decrement makes their
146reference count become zero, and so on. (There's an obvious problem
147with objects that reference each other here; for now, the solution is
Fred Drake659ebfa2000-04-03 15:42:13 +0000148``don't do that.'')
Guido van Rossum59a61351997-08-14 20:34:33 +0000149
Guido van Rossum4a944d71997-08-14 20:35:38 +0000150Reference counts are always manipulated explicitly. The normal way is
Fred Drake659ebfa2000-04-03 15:42:13 +0000151to use the macro \cfunction{Py_INCREF()}\ttindex{Py_INCREF()} to
152increment an object's reference count by one, and
153\cfunction{Py_DECREF()}\ttindex{Py_DECREF()} to decrement it by
154one. The \cfunction{Py_DECREF()} macro is considerably more complex
155than the incref one, since it must check whether the reference count
156becomes zero and then cause the object's deallocator to be called.
157The deallocator is a function pointer contained in the object's type
158structure. The type-specific deallocator takes care of decrementing
159the reference counts for other objects contained in the object if this
160is a compound object type, such as a list, as well as performing any
161additional finalization that's needed. There's no chance that the
162reference count can overflow; at least as many bits are used to hold
163the reference count as there are distinct memory locations in virtual
164memory (assuming \code{sizeof(long) >= sizeof(char*)}). Thus, the
165reference count increment is a simple operation.
Guido van Rossum59a61351997-08-14 20:34:33 +0000166
Guido van Rossum4a944d71997-08-14 20:35:38 +0000167It is not necessary to increment an object's reference count for every
168local variable that contains a pointer to an object. In theory, the
Fred Drakee058b4f1998-02-16 06:15:35 +0000169object's reference count goes up by one when the variable is made to
Guido van Rossum4a944d71997-08-14 20:35:38 +0000170point to it and it goes down by one when the variable goes out of
171scope. However, these two cancel each other out, so at the end the
172reference count hasn't changed. The only real reason to use the
173reference count is to prevent the object from being deallocated as
174long as our variable is pointing to it. If we know that there is at
175least one other reference to the object that lives at least as long as
176our variable, there is no need to increment the reference count
177temporarily. An important situation where this arises is in objects
Fred Drake659ebfa2000-04-03 15:42:13 +0000178that are passed as arguments to C functions in an extension module
Guido van Rossum4a944d71997-08-14 20:35:38 +0000179that are called from Python; the call mechanism guarantees to hold a
Guido van Rossum59a61351997-08-14 20:34:33 +0000180reference to every argument for the duration of the call.
181
Fred Drakee058b4f1998-02-16 06:15:35 +0000182However, a common pitfall is to extract an object from a list and
183hold on to it for a while without incrementing its reference count.
184Some other operation might conceivably remove the object from the
185list, decrementing its reference count and possible deallocating it.
186The real danger is that innocent-looking operations may invoke
187arbitrary Python code which could do this; there is a code path which
188allows control to flow back to the user from a \cfunction{Py_DECREF()},
189so almost any operation is potentially dangerous.
Guido van Rossum59a61351997-08-14 20:34:33 +0000190
Guido van Rossum4a944d71997-08-14 20:35:38 +0000191A safe approach is to always use the generic operations (functions
Fred Drake659ebfa2000-04-03 15:42:13 +0000192whose name begins with \samp{PyObject_}, \samp{PyNumber_},
193\samp{PySequence_} or \samp{PyMapping_}). These operations always
194increment the reference count of the object they return. This leaves
195the caller with the responsibility to call
196\cfunction{Py_DECREF()} when they are done with the result; this soon
197becomes second nature.
Guido van Rossum59a61351997-08-14 20:34:33 +0000198
Fred Drakeefd146c1999-02-15 15:30:45 +0000199
200\subsubsection{Reference Count Details \label{refcountDetails}}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000201
202The reference count behavior of functions in the Python/C API is best
Fred Drake659ebfa2000-04-03 15:42:13 +0000203explained in terms of \emph{ownership of references}. Note that we
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000204talk of owning references, never of owning objects; objects are always
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000205shared! When a function owns a reference, it has to dispose of it
Fred Drakee058b4f1998-02-16 06:15:35 +0000206properly --- either by passing ownership on (usually to its caller) or
207by calling \cfunction{Py_DECREF()} or \cfunction{Py_XDECREF()}. When
208a function passes ownership of a reference on to its caller, the
209caller is said to receive a \emph{new} reference. When no ownership
210is transferred, the caller is said to \emph{borrow} the reference.
211Nothing needs to be done for a borrowed reference.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000212
Fred Drakea8455ab2000-06-16 19:58:42 +0000213Conversely, when a calling function passes it a reference to an
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000214object, there are two possibilities: the function \emph{steals} a
215reference to the object, or it does not. Few functions steal
Fred Drakee058b4f1998-02-16 06:15:35 +0000216references; the two notable exceptions are
Fred Drake659ebfa2000-04-03 15:42:13 +0000217\cfunction{PyList_SetItem()}\ttindex{PyList_SetItem()} and
218\cfunction{PyTuple_SetItem()}\ttindex{PyTuple_SetItem()}, which
Fred Drakee058b4f1998-02-16 06:15:35 +0000219steal a reference to the item (but not to the tuple or list into which
Fred Drake003d8da1998-04-13 00:53:42 +0000220the item is put!). These functions were designed to steal a reference
Fred Drakee058b4f1998-02-16 06:15:35 +0000221because of a common idiom for populating a tuple or list with newly
222created objects; for example, the code to create the tuple \code{(1,
2232, "three")} could look like this (forgetting about error handling for
Fred Drake659ebfa2000-04-03 15:42:13 +0000224the moment; a better way to code this is shown below):
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000225
226\begin{verbatim}
227PyObject *t;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000228
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000229t = PyTuple_New(3);
230PyTuple_SetItem(t, 0, PyInt_FromLong(1L));
231PyTuple_SetItem(t, 1, PyInt_FromLong(2L));
232PyTuple_SetItem(t, 2, PyString_FromString("three"));
233\end{verbatim}
234
Fred Drakee058b4f1998-02-16 06:15:35 +0000235Incidentally, \cfunction{PyTuple_SetItem()} is the \emph{only} way to
236set tuple items; \cfunction{PySequence_SetItem()} and
237\cfunction{PyObject_SetItem()} refuse to do this since tuples are an
238immutable data type. You should only use
239\cfunction{PyTuple_SetItem()} for tuples that you are creating
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000240yourself.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000241
242Equivalent code for populating a list can be written using
Fred Drakee058b4f1998-02-16 06:15:35 +0000243\cfunction{PyList_New()} and \cfunction{PyList_SetItem()}. Such code
244can also use \cfunction{PySequence_SetItem()}; this illustrates the
245difference between the two (the extra \cfunction{Py_DECREF()} calls):
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000246
247\begin{verbatim}
248PyObject *l, *x;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000249
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000250l = PyList_New(3);
251x = PyInt_FromLong(1L);
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000252PySequence_SetItem(l, 0, x); Py_DECREF(x);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000253x = PyInt_FromLong(2L);
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000254PySequence_SetItem(l, 1, x); Py_DECREF(x);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000255x = PyString_FromString("three");
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000256PySequence_SetItem(l, 2, x); Py_DECREF(x);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000257\end{verbatim}
258
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000259You might find it strange that the ``recommended'' approach takes more
260code. However, in practice, you will rarely use these ways of
261creating and populating a tuple or list. There's a generic function,
Fred Drakee058b4f1998-02-16 06:15:35 +0000262\cfunction{Py_BuildValue()}, that can create most common objects from
Fred Drake659ebfa2000-04-03 15:42:13 +0000263C values, directed by a \dfn{format string}. For example, the
Fred Drakee058b4f1998-02-16 06:15:35 +0000264above two blocks of code could be replaced by the following (which
265also takes care of the error checking):
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000266
267\begin{verbatim}
268PyObject *t, *l;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000269
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000270t = Py_BuildValue("(iis)", 1, 2, "three");
271l = Py_BuildValue("[iis]", 1, 2, "three");
272\end{verbatim}
273
Fred Drakee058b4f1998-02-16 06:15:35 +0000274It is much more common to use \cfunction{PyObject_SetItem()} and
275friends with items whose references you are only borrowing, like
276arguments that were passed in to the function you are writing. In
277that case, their behaviour regarding reference counts is much saner,
278since you don't have to increment a reference count so you can give a
279reference away (``have it be stolen''). For example, this function
280sets all items of a list (actually, any mutable sequence) to a given
281item:
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000282
283\begin{verbatim}
284int set_all(PyObject *target, PyObject *item)
285{
286 int i, n;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000287
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000288 n = PyObject_Length(target);
289 if (n < 0)
290 return -1;
291 for (i = 0; i < n; i++) {
292 if (PyObject_SetItem(target, i, item) < 0)
293 return -1;
294 }
295 return 0;
296}
297\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000298\ttindex{set_all()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000299
300The situation is slightly different for function return values.
301While passing a reference to most functions does not change your
302ownership responsibilities for that reference, many functions that
303return a referece to an object give you ownership of the reference.
304The reason is simple: in many cases, the returned object is created
305on the fly, and the reference you get is the only reference to the
Fred Drakee058b4f1998-02-16 06:15:35 +0000306object. Therefore, the generic functions that return object
307references, like \cfunction{PyObject_GetItem()} and
308\cfunction{PySequence_GetItem()}, always return a new reference (i.e.,
309the caller becomes the owner of the reference).
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000310
311It is important to realize that whether you own a reference returned
Fred Drakee058b4f1998-02-16 06:15:35 +0000312by a function depends on which function you call only --- \emph{the
313plumage} (i.e., the type of the type of the object passed as an
314argument to the function) \emph{doesn't enter into it!} Thus, if you
315extract an item from a list using \cfunction{PyList_GetItem()}, you
316don't own the reference --- but if you obtain the same item from the
317same list using \cfunction{PySequence_GetItem()} (which happens to
318take exactly the same arguments), you do own a reference to the
319returned object.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000320
Fred Drakee058b4f1998-02-16 06:15:35 +0000321Here is an example of how you could write a function that computes the
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000322sum of the items in a list of integers; once using
Fred Drake659ebfa2000-04-03 15:42:13 +0000323\cfunction{PyList_GetItem()}\ttindex{PyList_GetItem()}, and once using
324\cfunction{PySequence_GetItem()}\ttindex{PySequence_GetItem()}.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000325
326\begin{verbatim}
327long sum_list(PyObject *list)
328{
329 int i, n;
330 long total = 0;
331 PyObject *item;
Fred Drakec6fa34e1998-04-02 06:47:24 +0000332
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000333 n = PyList_Size(list);
334 if (n < 0)
335 return -1; /* Not a list */
336 for (i = 0; i < n; i++) {
337 item = PyList_GetItem(list, i); /* Can't fail */
338 if (!PyInt_Check(item)) continue; /* Skip non-integers */
339 total += PyInt_AsLong(item);
340 }
341 return total;
342}
343\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000344\ttindex{sum_list()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000345
346\begin{verbatim}
347long sum_sequence(PyObject *sequence)
348{
349 int i, n;
350 long total = 0;
351 PyObject *item;
Fred Drake659ebfa2000-04-03 15:42:13 +0000352 n = PySequence_Length(sequence);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000353 if (n < 0)
354 return -1; /* Has no length */
355 for (i = 0; i < n; i++) {
Fred Drake659ebfa2000-04-03 15:42:13 +0000356 item = PySequence_GetItem(sequence, i);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000357 if (item == NULL)
358 return -1; /* Not a sequence, or other failure */
359 if (PyInt_Check(item))
360 total += PyInt_AsLong(item);
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000361 Py_DECREF(item); /* Discard reference ownership */
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000362 }
363 return total;
364}
365\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000366\ttindex{sum_sequence()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000367
Fred Drakeefd146c1999-02-15 15:30:45 +0000368
369\subsection{Types \label{types}}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000370
371There are few other data types that play a significant role in
Fred Drake659ebfa2000-04-03 15:42:13 +0000372the Python/C API; most are simple C types such as \ctype{int},
373\ctype{long}, \ctype{double} and \ctype{char*}. A few structure types
Guido van Rossum4a944d71997-08-14 20:35:38 +0000374are used to describe static tables used to list the functions exported
Fred Drake659ebfa2000-04-03 15:42:13 +0000375by a module or the data attributes of a new object type, and another
376is used to describe the value of a complex number. These will
Guido van Rossum59a61351997-08-14 20:34:33 +0000377be discussed together with the functions that use them.
378
Fred Drakeefd146c1999-02-15 15:30:45 +0000379
380\section{Exceptions \label{exceptions}}
Guido van Rossum59a61351997-08-14 20:34:33 +0000381
Guido van Rossum4a944d71997-08-14 20:35:38 +0000382The Python programmer only needs to deal with exceptions if specific
383error handling is required; unhandled exceptions are automatically
Fred Drake659ebfa2000-04-03 15:42:13 +0000384propagated to the caller, then to the caller's caller, and so on, until
Guido van Rossum4a944d71997-08-14 20:35:38 +0000385they reach the top-level interpreter, where they are reported to the
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000386user accompanied by a stack traceback.
Guido van Rossum59a61351997-08-14 20:34:33 +0000387
Fred Drake659ebfa2000-04-03 15:42:13 +0000388For C programmers, however, error checking always has to be explicit.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000389All functions in the Python/C API can raise exceptions, unless an
390explicit claim is made otherwise in a function's documentation. In
391general, when a function encounters an error, it sets an exception,
392discards any object references that it owns, and returns an
Fred Drakee058b4f1998-02-16 06:15:35 +0000393error indicator --- usually \NULL{} or \code{-1}. A few functions
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000394return a Boolean true/false result, with false indicating an error.
395Very few functions return no explicit error indicator or have an
396ambiguous return value, and require explicit testing for errors with
Fred Drake659ebfa2000-04-03 15:42:13 +0000397\cfunction{PyErr_Occurred()}\ttindex{PyErr_Occurred()}.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000398
399Exception state is maintained in per-thread storage (this is
400equivalent to using global storage in an unthreaded application). A
Fred Drakec6fa34e1998-04-02 06:47:24 +0000401thread can be in one of two states: an exception has occurred, or not.
Fred Drakee058b4f1998-02-16 06:15:35 +0000402The function \cfunction{PyErr_Occurred()} can be used to check for
403this: it returns a borrowed reference to the exception type object
404when an exception has occurred, and \NULL{} otherwise. There are a
405number of functions to set the exception state:
Fred Drake659ebfa2000-04-03 15:42:13 +0000406\cfunction{PyErr_SetString()}\ttindex{PyErr_SetString()} is the most
407common (though not the most general) function to set the exception
408state, and \cfunction{PyErr_Clear()}\ttindex{PyErr_Clear()} clears the
409exception state.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000410
411The full exception state consists of three objects (all of which can
Fred Drakee058b4f1998-02-16 06:15:35 +0000412be \NULL{}): the exception type, the corresponding exception
Fred Drake659ebfa2000-04-03 15:42:13 +0000413value, and the traceback. These have the same meanings as the Python
414\withsubitem{(in module sys)}{
415 \ttindex{exc_type}\ttindex{exc_value}\ttindex{exc_traceback}}
416objects \code{sys.exc_type}, \code{sys.exc_value}, and
417\code{sys.exc_traceback}; however, they are not the same: the Python
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000418objects represent the last exception being handled by a Python
Fred Drake659ebfa2000-04-03 15:42:13 +0000419\keyword{try} \ldots\ \keyword{except} statement, while the C level
Fred Drakee058b4f1998-02-16 06:15:35 +0000420exception state only exists while an exception is being passed on
Fred Drake659ebfa2000-04-03 15:42:13 +0000421between C functions until it reaches the Python bytecode interpreter's
422main loop, which takes care of transferring it to \code{sys.exc_type}
423and friends.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000424
Fred Drakec6fa34e1998-04-02 06:47:24 +0000425Note that starting with Python 1.5, the preferred, thread-safe way to
Fred Drake659ebfa2000-04-03 15:42:13 +0000426access the exception state from Python code is to call the function
427\withsubitem{(in module sys)}{\ttindex{exc_info()}}
Fred Drakee058b4f1998-02-16 06:15:35 +0000428\function{sys.exc_info()}, which returns the per-thread exception state
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000429for Python code. Also, the semantics of both ways to access the
430exception state have changed so that a function which catches an
431exception will save and restore its thread's exception state so as to
432preserve the exception state of its caller. This prevents common bugs
433in exception handling code caused by an innocent-looking function
434overwriting the exception being handled; it also reduces the often
435unwanted lifetime extension for objects that are referenced by the
Fred Drakec6fa34e1998-04-02 06:47:24 +0000436stack frames in the traceback.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000437
438As a general principle, a function that calls another function to
439perform some task should check whether the called function raised an
440exception, and if so, pass the exception state on to its caller. It
Fred Drake659ebfa2000-04-03 15:42:13 +0000441should discard any object references that it owns, and return an
Fred Drakee058b4f1998-02-16 06:15:35 +0000442error indicator, but it should \emph{not} set another exception ---
443that would overwrite the exception that was just raised, and lose
444important information about the exact cause of the error.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000445
Fred Drake659ebfa2000-04-03 15:42:13 +0000446A simple example of detecting exceptions and passing them on is shown
447in the \cfunction{sum_sequence()}\ttindex{sum_sequence()} example
448above. It so happens that that example doesn't need to clean up any
449owned references when it detects an error. The following example
450function shows some error cleanup. First, to remind you why you like
451Python, we show the equivalent Python code:
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000452
453\begin{verbatim}
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000454def incr_item(dict, key):
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000455 try:
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000456 item = dict[key]
457 except KeyError:
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000458 item = 0
Fred Drake6b3f3f22000-11-29 15:48:22 +0000459 dict[key] = item + 1
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000460\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000461\ttindex{incr_item()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000462
Fred Drake659ebfa2000-04-03 15:42:13 +0000463Here is the corresponding C code, in all its glory:
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000464
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000465\begin{verbatim}
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000466int incr_item(PyObject *dict, PyObject *key)
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000467{
468 /* Objects all initialized to NULL for Py_XDECREF */
469 PyObject *item = NULL, *const_one = NULL, *incremented_item = NULL;
Guido van Rossum5b8a5231997-12-30 04:38:44 +0000470 int rv = -1; /* Return value initialized to -1 (failure) */
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000471
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000472 item = PyObject_GetItem(dict, key);
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000473 if (item == NULL) {
Fred Drakec6fa34e1998-04-02 06:47:24 +0000474 /* Handle KeyError only: */
Fred Drake6b3f3f22000-11-29 15:48:22 +0000475 if (!PyErr_ExceptionMatches(PyExc_KeyError))
476 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000477
478 /* Clear the error and use zero: */
479 PyErr_Clear();
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000480 item = PyInt_FromLong(0L);
Fred Drake6b3f3f22000-11-29 15:48:22 +0000481 if (item == NULL)
482 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000483 }
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000484 const_one = PyInt_FromLong(1L);
Fred Drake6b3f3f22000-11-29 15:48:22 +0000485 if (const_one == NULL)
486 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000487
488 incremented_item = PyNumber_Add(item, const_one);
Fred Drake6b3f3f22000-11-29 15:48:22 +0000489 if (incremented_item == NULL)
490 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000491
Fred Drake6b3f3f22000-11-29 15:48:22 +0000492 if (PyObject_SetItem(dict, key, incremented_item) < 0)
493 goto error;
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000494 rv = 0; /* Success */
495 /* Continue with cleanup code */
496
497 error:
498 /* Cleanup code, shared by success and failure path */
499
500 /* Use Py_XDECREF() to ignore NULL references */
501 Py_XDECREF(item);
502 Py_XDECREF(const_one);
503 Py_XDECREF(incremented_item);
504
505 return rv; /* -1 for error, 0 for success */
506}
507\end{verbatim}
Fred Drake659ebfa2000-04-03 15:42:13 +0000508\ttindex{incr_item()}
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000509
Fred Drakef8830d11998-04-23 14:06:01 +0000510This example represents an endorsed use of the \keyword{goto} statement
Fred Drake659ebfa2000-04-03 15:42:13 +0000511in C! It illustrates the use of
512\cfunction{PyErr_ExceptionMatches()}\ttindex{PyErr_ExceptionMatches()} and
513\cfunction{PyErr_Clear()}\ttindex{PyErr_Clear()} to
514handle specific exceptions, and the use of
515\cfunction{Py_XDECREF()}\ttindex{Py_XDECREF()} to
516dispose of owned references that may be \NULL{} (note the
517\character{X} in the name; \cfunction{Py_DECREF()} would crash when
518confronted with a \NULL{} reference). It is important that the
519variables used to hold owned references are initialized to \NULL{} for
520this to work; likewise, the proposed return value is initialized to
521\code{-1} (failure) and only set to success after the final call made
522is successful.
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000523
Guido van Rossum59a61351997-08-14 20:34:33 +0000524
Fred Drakeefd146c1999-02-15 15:30:45 +0000525\section{Embedding Python \label{embedding}}
Guido van Rossum59a61351997-08-14 20:34:33 +0000526
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000527The one important task that only embedders (as opposed to extension
528writers) of the Python interpreter have to worry about is the
529initialization, and possibly the finalization, of the Python
530interpreter. Most functionality of the interpreter can only be used
531after the interpreter has been initialized.
Guido van Rossum59a61351997-08-14 20:34:33 +0000532
Fred Drake659ebfa2000-04-03 15:42:13 +0000533The basic initialization function is
534\cfunction{Py_Initialize()}\ttindex{Py_Initialize()}.
Fred Drakee058b4f1998-02-16 06:15:35 +0000535This initializes the table of loaded modules, and creates the
Fred Drake4de05a91998-02-16 14:25:26 +0000536fundamental modules \module{__builtin__}\refbimodindex{__builtin__},
537\module{__main__}\refbimodindex{__main__} and
538\module{sys}\refbimodindex{sys}. It also initializes the module
Fred Drakec6fa34e1998-04-02 06:47:24 +0000539search path (\code{sys.path}).%
540\indexiii{module}{search}{path}
Fred Drake659ebfa2000-04-03 15:42:13 +0000541\withsubitem{(in module sys)}{\ttindex{path}}
Guido van Rossum59a61351997-08-14 20:34:33 +0000542
Fred Drakee058b4f1998-02-16 06:15:35 +0000543\cfunction{Py_Initialize()} does not set the ``script argument list''
Guido van Rossum4a944d71997-08-14 20:35:38 +0000544(\code{sys.argv}). If this variable is needed by Python code that
545will be executed later, it must be set explicitly with a call to
Fred Drake659ebfa2000-04-03 15:42:13 +0000546\code{PySys_SetArgv(\var{argc},
547\var{argv})}\ttindex{PySys_SetArgv()} subsequent to the call to
548\cfunction{Py_Initialize()}.
Guido van Rossum59a61351997-08-14 20:34:33 +0000549
Fred Drakeb0a78731998-01-13 18:51:10 +0000550On most systems (in particular, on \UNIX{} and Windows, although the
Fred Drake659ebfa2000-04-03 15:42:13 +0000551details are slightly different),
552\cfunction{Py_Initialize()} calculates the module search path based
553upon its best guess for the location of the standard Python
554interpreter executable, assuming that the Python library is found in a
555fixed location relative to the Python interpreter executable. In
556particular, it looks for a directory named
Fred Draked5d04352000-09-14 20:24:17 +0000557\file{lib/python\shortversion} relative to the parent directory where
558the executable named \file{python} is found on the shell command
559search path (the environment variable \envvar{PATH}).
Guido van Rossum42cefd01997-10-05 15:27:29 +0000560
561For instance, if the Python executable is found in
Fred Drakee058b4f1998-02-16 06:15:35 +0000562\file{/usr/local/bin/python}, it will assume that the libraries are in
Fred Draked5d04352000-09-14 20:24:17 +0000563\file{/usr/local/lib/python\shortversion}. (In fact, this particular path
Fred Drakee058b4f1998-02-16 06:15:35 +0000564is also the ``fallback'' location, used when no executable file named
Fred Drakec6fa34e1998-04-02 06:47:24 +0000565\file{python} is found along \envvar{PATH}.) The user can override
566this behavior by setting the environment variable \envvar{PYTHONHOME},
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000567or insert additional directories in front of the standard path by
Fred Drakec6fa34e1998-04-02 06:47:24 +0000568setting \envvar{PYTHONPATH}.
Guido van Rossum59a61351997-08-14 20:34:33 +0000569
Guido van Rossum4a944d71997-08-14 20:35:38 +0000570The embedding application can steer the search by calling
Fred Drake659ebfa2000-04-03 15:42:13 +0000571\code{Py_SetProgramName(\var{file})}\ttindex{Py_SetProgramName()} \emph{before} calling
Fred Drakec6fa34e1998-04-02 06:47:24 +0000572\cfunction{Py_Initialize()}. Note that \envvar{PYTHONHOME} still
573overrides this and \envvar{PYTHONPATH} is still inserted in front of
Fred Drakee058b4f1998-02-16 06:15:35 +0000574the standard path. An application that requires total control has to
Fred Drake659ebfa2000-04-03 15:42:13 +0000575provide its own implementation of
576\cfunction{Py_GetPath()}\ttindex{Py_GetPath()},
577\cfunction{Py_GetPrefix()}\ttindex{Py_GetPrefix()},
578\cfunction{Py_GetExecPrefix()}\ttindex{Py_GetExecPrefix()}, and
579\cfunction{Py_GetProgramFullPath()}\ttindex{Py_GetProgramFullPath()} (all
580defined in \file{Modules/getpath.c}).
Guido van Rossum59a61351997-08-14 20:34:33 +0000581
Guido van Rossum4a944d71997-08-14 20:35:38 +0000582Sometimes, it is desirable to ``uninitialize'' Python. For instance,
583the application may want to start over (make another call to
Fred Drakee058b4f1998-02-16 06:15:35 +0000584\cfunction{Py_Initialize()}) or the application is simply done with its
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000585use of Python and wants to free all memory allocated by Python. This
Fred Drakee058b4f1998-02-16 06:15:35 +0000586can be accomplished by calling \cfunction{Py_Finalize()}. The function
Fred Drake659ebfa2000-04-03 15:42:13 +0000587\cfunction{Py_IsInitialized()}\ttindex{Py_IsInitialized()} returns
588true if Python is currently in the initialized state. More
589information about these functions is given in a later chapter.
Guido van Rossum59a61351997-08-14 20:34:33 +0000590
Guido van Rossum4a944d71997-08-14 20:35:38 +0000591
Fred Drakeefd146c1999-02-15 15:30:45 +0000592\chapter{The Very High Level Layer \label{veryhigh}}
Guido van Rossum4a944d71997-08-14 20:35:38 +0000593
Fred Drakee5bf8b21998-02-12 21:22:28 +0000594The functions in this chapter will let you execute Python source code
595given in a file or a buffer, but they will not let you interact in a
596more detailed way with the interpreter.
Guido van Rossum4a944d71997-08-14 20:35:38 +0000597
Fred Drake659ebfa2000-04-03 15:42:13 +0000598Several of these functions accept a start symbol from the grammar as a
599parameter. The available start symbols are \constant{Py_eval_input},
600\constant{Py_file_input}, and \constant{Py_single_input}. These are
601described following the functions which accept them as parameters.
602
Fred Drake510d08b2000-08-14 02:50:21 +0000603Note also that several of these functions take \ctype{FILE*}
604parameters. On particular issue which needs to be handled carefully
605is that the \ctype{FILE} structure for different C libraries can be
606different and incompatible. Under Windows (at least), it is possible
607for dynamically linked extensions to actually use different libraries,
608so care should be taken that \ctype{FILE*} parameters are only passed
609to these functions if it is certain that they were created by the same
610library that the Python runtime is using.
611
Fred Drake24e62192001-05-21 15:56:55 +0000612\begin{cfuncdesc}{int}{Py_Main}{int argc, char **argv}
613 The main program for the standard interpreter. This is made
614 available for programs which embed Python. The \var{argc} and
615 \var{argv} parameters should be prepared exactly as those which are
616 passed to a C program's \cfunction{main()} function. It is
617 important to note that the argument list may be modified (but the
618 contents of the strings pointed to by the argument list are not).
619 The return value will be the integer passed to the
620 \function{sys.exit()} function, \code{1} if the interpreter exits
621 due to an exception, or \code{2} if the parameter list does not
622 represent a valid Python command line.
623\end{cfuncdesc}
624
Fred Drakec6fa34e1998-04-02 06:47:24 +0000625\begin{cfuncdesc}{int}{PyRun_AnyFile}{FILE *fp, char *filename}
Fred Drake0041a941999-04-29 04:20:46 +0000626 If \var{fp} refers to a file associated with an interactive device
627 (console or terminal input or \UNIX{} pseudo-terminal), return the
628 value of \cfunction{PyRun_InteractiveLoop()}, otherwise return the
629 result of \cfunction{PyRun_SimpleFile()}. If \var{filename} is
Fred Drakea8d73412000-08-11 20:39:29 +0000630 \NULL{}, this function uses \code{"???"} as the filename.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000631\end{cfuncdesc}
632
Fred Drakec6fa34e1998-04-02 06:47:24 +0000633\begin{cfuncdesc}{int}{PyRun_SimpleString}{char *command}
Fred Drake0041a941999-04-29 04:20:46 +0000634 Executes the Python source code from \var{command} in the
635 \module{__main__} module. If \module{__main__} does not already
636 exist, it is created. Returns \code{0} on success or \code{-1} if
637 an exception was raised. If there was an error, there is no way to
638 get the exception information.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000639\end{cfuncdesc}
640
Fred Drakec6fa34e1998-04-02 06:47:24 +0000641\begin{cfuncdesc}{int}{PyRun_SimpleFile}{FILE *fp, char *filename}
Fred Drake0041a941999-04-29 04:20:46 +0000642 Similar to \cfunction{PyRun_SimpleString()}, but the Python source
643 code is read from \var{fp} instead of an in-memory string.
644 \var{filename} should be the name of the file.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000645\end{cfuncdesc}
646
Fred Drakec6fa34e1998-04-02 06:47:24 +0000647\begin{cfuncdesc}{int}{PyRun_InteractiveOne}{FILE *fp, char *filename}
Fred Drakea8d73412000-08-11 20:39:29 +0000648 Read and execute a single statement from a file associated with an
649 interactive device. If \var{filename} is \NULL, \code{"???"} is
650 used instead. The user will be prompted using \code{sys.ps1} and
651 \code{sys.ps2}. Returns \code{0} when the input was executed
652 successfully, \code{-1} if there was an exception, or an error code
653 from the \file{errcode.h} include file distributed as part of Python
654 in case of a parse error. (Note that \file{errcode.h} is not
655 included by \file{Python.h}, so must be included specifically if
656 needed.)
Fred Drakee5bf8b21998-02-12 21:22:28 +0000657\end{cfuncdesc}
658
Fred Drakec6fa34e1998-04-02 06:47:24 +0000659\begin{cfuncdesc}{int}{PyRun_InteractiveLoop}{FILE *fp, char *filename}
Fred Drakea8d73412000-08-11 20:39:29 +0000660 Read and execute statements from a file associated with an
661 interactive device until \EOF{} is reached. If \var{filename} is
662 \NULL, \code{"???"} is used instead. The user will be prompted
663 using \code{sys.ps1} and \code{sys.ps2}. Returns \code{0} at \EOF.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000664\end{cfuncdesc}
665
Fred Drakec6fa34e1998-04-02 06:47:24 +0000666\begin{cfuncdesc}{struct _node*}{PyParser_SimpleParseString}{char *str,
667 int start}
Fred Drake0041a941999-04-29 04:20:46 +0000668 Parse Python source code from \var{str} using the start token
669 \var{start}. The result can be used to create a code object which
670 can be evaluated efficiently. This is useful if a code fragment
671 must be evaluated many times.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000672\end{cfuncdesc}
673
Fred Drakec6fa34e1998-04-02 06:47:24 +0000674\begin{cfuncdesc}{struct _node*}{PyParser_SimpleParseFile}{FILE *fp,
675 char *filename, int start}
Fred Drake0041a941999-04-29 04:20:46 +0000676 Similar to \cfunction{PyParser_SimpleParseString()}, but the Python
677 source code is read from \var{fp} instead of an in-memory string.
678 \var{filename} should be the name of the file.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000679\end{cfuncdesc}
680
Fred Drakec6fa34e1998-04-02 06:47:24 +0000681\begin{cfuncdesc}{PyObject*}{PyRun_String}{char *str, int start,
682 PyObject *globals,
683 PyObject *locals}
Fred Drake0041a941999-04-29 04:20:46 +0000684 Execute Python source code from \var{str} in the context specified
685 by the dictionaries \var{globals} and \var{locals}. The parameter
686 \var{start} specifies the start token that should be used to parse
687 the source code.
688
689 Returns the result of executing the code as a Python object, or
690 \NULL{} if an exception was raised.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000691\end{cfuncdesc}
692
Fred Drakec6fa34e1998-04-02 06:47:24 +0000693\begin{cfuncdesc}{PyObject*}{PyRun_File}{FILE *fp, char *filename,
694 int start, PyObject *globals,
695 PyObject *locals}
Fred Drake0041a941999-04-29 04:20:46 +0000696 Similar to \cfunction{PyRun_String()}, but the Python source code is
Fred Drake659ebfa2000-04-03 15:42:13 +0000697 read from \var{fp} instead of an in-memory string.
698 \var{filename} should be the name of the file.
Fred Drakee5bf8b21998-02-12 21:22:28 +0000699\end{cfuncdesc}
700
Fred Drakec6fa34e1998-04-02 06:47:24 +0000701\begin{cfuncdesc}{PyObject*}{Py_CompileString}{char *str, char *filename,
702 int start}
Fred Drake0041a941999-04-29 04:20:46 +0000703 Parse and compile the Python source code in \var{str}, returning the
704 resulting code object. The start token is given by \var{start};
Fred Drakec924b8d1999-08-23 18:57:25 +0000705 this can be used to constrain the code which can be compiled and should
706 be \constant{Py_eval_input}, \constant{Py_file_input}, or
707 \constant{Py_single_input}. The filename specified by
708 \var{filename} is used to construct the code object and may appear
709 in tracebacks or \exception{SyntaxError} exception messages. This
710 returns \NULL{} if the code cannot be parsed or compiled.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000711\end{cfuncdesc}
712
Fred Drakec924b8d1999-08-23 18:57:25 +0000713\begin{cvardesc}{int}{Py_eval_input}
714 The start symbol from the Python grammar for isolated expressions;
Fred Drake659ebfa2000-04-03 15:42:13 +0000715 for use with \cfunction{Py_CompileString()}\ttindex{Py_CompileString()}.
Fred Drakec924b8d1999-08-23 18:57:25 +0000716\end{cvardesc}
717
718\begin{cvardesc}{int}{Py_file_input}
719 The start symbol from the Python grammar for sequences of statements
720 as read from a file or other source; for use with
Fred Drake659ebfa2000-04-03 15:42:13 +0000721 \cfunction{Py_CompileString()}\ttindex{Py_CompileString()}. This is
722 the symbol to use when compiling arbitrarily long Python source code.
Fred Drakec924b8d1999-08-23 18:57:25 +0000723\end{cvardesc}
724
725\begin{cvardesc}{int}{Py_single_input}
726 The start symbol from the Python grammar for a single statement; for
Fred Drake659ebfa2000-04-03 15:42:13 +0000727 use with \cfunction{Py_CompileString()}\ttindex{Py_CompileString()}.
728 This is the symbol used for the interactive interpreter loop.
Fred Drakec924b8d1999-08-23 18:57:25 +0000729\end{cvardesc}
730
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000731
Fred Drakeefd146c1999-02-15 15:30:45 +0000732\chapter{Reference Counting \label{countingRefs}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000733
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000734The macros in this section are used for managing reference counts
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000735of Python objects.
736
737\begin{cfuncdesc}{void}{Py_INCREF}{PyObject *o}
Fred Drakec6fa34e1998-04-02 06:47:24 +0000738Increment the reference count for object \var{o}. The object must
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000739not be \NULL{}; if you aren't sure that it isn't \NULL{}, use
Fred Drakee058b4f1998-02-16 06:15:35 +0000740\cfunction{Py_XINCREF()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000741\end{cfuncdesc}
742
743\begin{cfuncdesc}{void}{Py_XINCREF}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +0000744Increment the reference count for object \var{o}. The object may be
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000745\NULL{}, in which case the macro has no effect.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000746\end{cfuncdesc}
747
748\begin{cfuncdesc}{void}{Py_DECREF}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +0000749Decrement the reference count for object \var{o}. The object must
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000750not be \NULL{}; if you aren't sure that it isn't \NULL{}, use
Fred Drakee058b4f1998-02-16 06:15:35 +0000751\cfunction{Py_XDECREF()}. If the reference count reaches zero, the
752object's type's deallocation function (which must not be \NULL{}) is
753invoked.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000754
755\strong{Warning:} The deallocation function can cause arbitrary Python
Fred Drake659ebfa2000-04-03 15:42:13 +0000756code to be invoked (e.g. when a class instance with a
757\method{__del__()} method is deallocated). While exceptions in such
758code are not propagated, the executed code has free access to all
759Python global variables. This means that any object that is reachable
760from a global variable should be in a consistent state before
761\cfunction{Py_DECREF()} is invoked. For example, code to delete an
762object from a list should copy a reference to the deleted object in a
763temporary variable, update the list data structure, and then call
764\cfunction{Py_DECREF()} for the temporary variable.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000765\end{cfuncdesc}
766
767\begin{cfuncdesc}{void}{Py_XDECREF}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +0000768Decrement the reference count for object \var{o}. The object may be
769\NULL{}, in which case the macro has no effect; otherwise the effect
770is the same as for \cfunction{Py_DECREF()}, and the same warning
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000771applies.
772\end{cfuncdesc}
773
Fred Drake659ebfa2000-04-03 15:42:13 +0000774The following functions or macros are only for use within the
775interpreter core: \cfunction{_Py_Dealloc()},
776\cfunction{_Py_ForgetReference()}, \cfunction{_Py_NewReference()}, as
777well as the global variable \cdata{_Py_RefTotal}.
Guido van Rossum580aa8d1997-11-25 15:34:51 +0000778
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000779
Fred Drakeefd146c1999-02-15 15:30:45 +0000780\chapter{Exception Handling \label{exceptionHandling}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000781
Fred Drake659ebfa2000-04-03 15:42:13 +0000782The functions described in this chapter will let you handle and raise Python
Guido van Rossumae110af1997-05-22 20:11:52 +0000783exceptions. It is important to understand some of the basics of
Fred Drake659ebfa2000-04-03 15:42:13 +0000784Python exception handling. It works somewhat like the
785\UNIX{} \cdata{errno} variable: there is a global indicator (per
786thread) of the last error that occurred. Most functions don't clear
787this on success, but will set it to indicate the cause of the error on
788failure. Most functions also return an error indicator, usually
789\NULL{} if they are supposed to return a pointer, or \code{-1} if they
790return an integer (exception: the \cfunction{PyArg_Parse*()} functions
791return \code{1} for success and \code{0} for failure). When a
792function must fail because some function it called failed, it
793generally doesn't set the error indicator; the function it called
794already set it.
Guido van Rossumae110af1997-05-22 20:11:52 +0000795
796The error indicator consists of three Python objects corresponding to
Fred Drake659ebfa2000-04-03 15:42:13 +0000797\withsubitem{(in module sys)}{
798 \ttindex{exc_type}\ttindex{exc_value}\ttindex{exc_traceback}}
Guido van Rossumae110af1997-05-22 20:11:52 +0000799the Python variables \code{sys.exc_type}, \code{sys.exc_value} and
800\code{sys.exc_traceback}. API functions exist to interact with the
801error indicator in various ways. There is a separate error indicator
802for each thread.
803
804% XXX Order of these should be more thoughtful.
805% Either alphabetical or some kind of structure.
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000806
807\begin{cfuncdesc}{void}{PyErr_Print}{}
Guido van Rossumae110af1997-05-22 20:11:52 +0000808Print a standard traceback to \code{sys.stderr} and clear the error
809indicator. Call this function only when the error indicator is set.
810(Otherwise it will cause a fatal error!)
Guido van Rossum9231c8f1997-05-15 21:43:21 +0000811\end{cfuncdesc}
812
Fred Drakec6fa34e1998-04-02 06:47:24 +0000813\begin{cfuncdesc}{PyObject*}{PyErr_Occurred}{}
Guido van Rossumae110af1997-05-22 20:11:52 +0000814Test whether the error indicator is set. If set, return the exception
Fred Drakee058b4f1998-02-16 06:15:35 +0000815\emph{type} (the first argument to the last call to one of the
Fred Drakef8830d11998-04-23 14:06:01 +0000816\cfunction{PyErr_Set*()} functions or to \cfunction{PyErr_Restore()}). If
Fred Drakee058b4f1998-02-16 06:15:35 +0000817not set, return \NULL{}. You do not own a reference to the return
818value, so you do not need to \cfunction{Py_DECREF()} it.
Fred Drake659ebfa2000-04-03 15:42:13 +0000819\strong{Note:} Do not compare the return value to a specific
Fred Drakee058b4f1998-02-16 06:15:35 +0000820exception; use \cfunction{PyErr_ExceptionMatches()} instead, shown
Fred Drake659ebfa2000-04-03 15:42:13 +0000821below. (The comparison could easily fail since the exception may be
822an instance instead of a class, in the case of a class exception, or
823it may the a subclass of the expected exception.)
Guido van Rossum42cefd01997-10-05 15:27:29 +0000824\end{cfuncdesc}
825
826\begin{cfuncdesc}{int}{PyErr_ExceptionMatches}{PyObject *exc}
Guido van Rossum42cefd01997-10-05 15:27:29 +0000827Equivalent to
Fred Drakee058b4f1998-02-16 06:15:35 +0000828\samp{PyErr_GivenExceptionMatches(PyErr_Occurred(), \var{exc})}.
Fred Drake659ebfa2000-04-03 15:42:13 +0000829This should only be called when an exception is actually set; a memory
830access violation will occur if no exception has been raised.
Guido van Rossum42cefd01997-10-05 15:27:29 +0000831\end{cfuncdesc}
832
833\begin{cfuncdesc}{int}{PyErr_GivenExceptionMatches}{PyObject *given, PyObject *exc}
Guido van Rossum42cefd01997-10-05 15:27:29 +0000834Return true if the \var{given} exception matches the exception in
835\var{exc}. If \var{exc} is a class object, this also returns true
Fred Drake659ebfa2000-04-03 15:42:13 +0000836when \var{given} is an instance of a subclass. If \var{exc} is a tuple, all
Guido van Rossum42cefd01997-10-05 15:27:29 +0000837exceptions in the tuple (and recursively in subtuples) are searched
Fred Drake659ebfa2000-04-03 15:42:13 +0000838for a match. If \var{given} is \NULL, a memory access violation will
839occur.
Guido van Rossum42cefd01997-10-05 15:27:29 +0000840\end{cfuncdesc}
841
842\begin{cfuncdesc}{void}{PyErr_NormalizeException}{PyObject**exc, PyObject**val, PyObject**tb}
Guido van Rossum42cefd01997-10-05 15:27:29 +0000843Under certain circumstances, the values returned by
Fred Drakee058b4f1998-02-16 06:15:35 +0000844\cfunction{PyErr_Fetch()} below can be ``unnormalized'', meaning that
845\code{*\var{exc}} is a class object but \code{*\var{val}} is not an
846instance of the same class. This function can be used to instantiate
847the class in that case. If the values are already normalized, nothing
Fred Drake659ebfa2000-04-03 15:42:13 +0000848happens. The delayed normalization is implemented to improve
849performance.
Guido van Rossumae110af1997-05-22 20:11:52 +0000850\end{cfuncdesc}
851
852\begin{cfuncdesc}{void}{PyErr_Clear}{}
853Clear the error indicator. If the error indicator is not set, there
854is no effect.
855\end{cfuncdesc}
856
Fred Drake659ebfa2000-04-03 15:42:13 +0000857\begin{cfuncdesc}{void}{PyErr_Fetch}{PyObject **ptype, PyObject **pvalue,
858 PyObject **ptraceback}
Guido van Rossumae110af1997-05-22 20:11:52 +0000859Retrieve the error indicator into three variables whose addresses are
860passed. If the error indicator is not set, set all three variables to
861\NULL{}. If it is set, it will be cleared and you own a reference to
Fred Drake659ebfa2000-04-03 15:42:13 +0000862each object retrieved. The value and traceback object may be
863\NULL{} even when the type object is not. \strong{Note:} This
864function is normally only used by code that needs to handle exceptions
865or by code that needs to save and restore the error indicator
866temporarily.
Guido van Rossumae110af1997-05-22 20:11:52 +0000867\end{cfuncdesc}
868
Fred Drake17e63432000-08-31 05:50:40 +0000869\begin{cfuncdesc}{void}{PyErr_Restore}{PyObject *type, PyObject *value,
870 PyObject *traceback}
Guido van Rossumae110af1997-05-22 20:11:52 +0000871Set the error indicator from the three objects. If the error
872indicator is already set, it is cleared first. If the objects are
873\NULL{}, the error indicator is cleared. Do not pass a \NULL{} type
874and non-\NULL{} value or traceback. The exception type should be a
875string or class; if it is a class, the value should be an instance of
876that class. Do not pass an invalid exception type or value.
877(Violating these rules will cause subtle problems later.) This call
Fred Drake17e63432000-08-31 05:50:40 +0000878takes away a reference to each object, i.e.\ you must own a reference
Guido van Rossumae110af1997-05-22 20:11:52 +0000879to each object before the call and after the call you no longer own
880these references. (If you don't understand this, don't use this
Fred Drake659ebfa2000-04-03 15:42:13 +0000881function. I warned you.) \strong{Note:} This function is normally
Guido van Rossumae110af1997-05-22 20:11:52 +0000882only used by code that needs to save and restore the error indicator
883temporarily.
884\end{cfuncdesc}
885
886\begin{cfuncdesc}{void}{PyErr_SetString}{PyObject *type, char *message}
887This is the most common way to set the error indicator. The first
888argument specifies the exception type; it is normally one of the
Fred Drakef8830d11998-04-23 14:06:01 +0000889standard exceptions, e.g. \cdata{PyExc_RuntimeError}. You need not
Guido van Rossumae110af1997-05-22 20:11:52 +0000890increment its reference count. The second argument is an error
891message; it is converted to a string object.
892\end{cfuncdesc}
893
894\begin{cfuncdesc}{void}{PyErr_SetObject}{PyObject *type, PyObject *value}
Fred Drakee058b4f1998-02-16 06:15:35 +0000895This function is similar to \cfunction{PyErr_SetString()} but lets you
Guido van Rossumae110af1997-05-22 20:11:52 +0000896specify an arbitrary Python object for the ``value'' of the exception.
897You need not increment its reference count.
898\end{cfuncdesc}
899
Fred Drake73577702000-04-10 18:50:14 +0000900\begin{cfuncdesc}{PyObject*}{PyErr_Format}{PyObject *exception,
Moshe Zadka57a59322000-09-01 09:47:20 +0000901 const char *format, \moreargs}
Fred Drake89fb0352000-10-14 05:49:30 +0000902This function sets the error indicator. \var{exception} should be a
903Python exception (string or class, not an instance).
Fred Drake5566c1c2001-01-19 22:48:33 +0000904\var{format} should be a string, containing format codes, similar to
Moshe Zadka57a59322000-09-01 09:47:20 +0000905\cfunction{printf}. The \code{width.precision} before a format code
906is parsed, but the width part is ignored.
907
908\begin{tableii}{c|l}{character}{Character}{Meaning}
909 \lineii{c}{Character, as an \ctype{int} parameter}
910 \lineii{d}{Number in decimal, as an \ctype{int} parameter}
911 \lineii{x}{Number in hexadecimal, as an \ctype{int} parameter}
912 \lineii{x}{A string, as a \ctype{char *} parameter}
913\end{tableii}
914
915An unrecognized format character causes all the rest of
916the format string to be copied as-is to the result string,
917and any extra arguments discarded.
918
919A new reference is returned, which is owned by the caller.
Jeremy Hylton98605b52000-04-10 18:40:57 +0000920\end{cfuncdesc}
921
Guido van Rossumae110af1997-05-22 20:11:52 +0000922\begin{cfuncdesc}{void}{PyErr_SetNone}{PyObject *type}
Fred Drakee058b4f1998-02-16 06:15:35 +0000923This is a shorthand for \samp{PyErr_SetObject(\var{type}, Py_None)}.
Guido van Rossumae110af1997-05-22 20:11:52 +0000924\end{cfuncdesc}
925
926\begin{cfuncdesc}{int}{PyErr_BadArgument}{}
Fred Drakee058b4f1998-02-16 06:15:35 +0000927This is a shorthand for \samp{PyErr_SetString(PyExc_TypeError,
Guido van Rossumae110af1997-05-22 20:11:52 +0000928\var{message})}, where \var{message} indicates that a built-in operation
929was invoked with an illegal argument. It is mostly for internal use.
930\end{cfuncdesc}
931
Fred Drakec6fa34e1998-04-02 06:47:24 +0000932\begin{cfuncdesc}{PyObject*}{PyErr_NoMemory}{}
Fred Drakee058b4f1998-02-16 06:15:35 +0000933This is a shorthand for \samp{PyErr_SetNone(PyExc_MemoryError)}; it
Guido van Rossumae110af1997-05-22 20:11:52 +0000934returns \NULL{} so an object allocation function can write
Fred Drakee058b4f1998-02-16 06:15:35 +0000935\samp{return PyErr_NoMemory();} when it runs out of memory.
Guido van Rossumae110af1997-05-22 20:11:52 +0000936\end{cfuncdesc}
937
Fred Drakec6fa34e1998-04-02 06:47:24 +0000938\begin{cfuncdesc}{PyObject*}{PyErr_SetFromErrno}{PyObject *type}
Fred Drake659ebfa2000-04-03 15:42:13 +0000939This is a convenience function to raise an exception when a C library
940function has returned an error and set the C variable \cdata{errno}.
Guido van Rossumae110af1997-05-22 20:11:52 +0000941It constructs a tuple object whose first item is the integer
Fred Drakef8830d11998-04-23 14:06:01 +0000942\cdata{errno} value and whose second item is the corresponding error
Fred Drake659ebfa2000-04-03 15:42:13 +0000943message (gotten from \cfunction{strerror()}\ttindex{strerror()}), and
944then calls
Fred Drakee058b4f1998-02-16 06:15:35 +0000945\samp{PyErr_SetObject(\var{type}, \var{object})}. On \UNIX{}, when
Fred Drakef8830d11998-04-23 14:06:01 +0000946the \cdata{errno} value is \constant{EINTR}, indicating an interrupted
Fred Drakee058b4f1998-02-16 06:15:35 +0000947system call, this calls \cfunction{PyErr_CheckSignals()}, and if that set
Guido van Rossumae110af1997-05-22 20:11:52 +0000948the error indicator, leaves it set to that. The function always
949returns \NULL{}, so a wrapper function around a system call can write
Fred Drakee058b4f1998-02-16 06:15:35 +0000950\samp{return PyErr_SetFromErrno();} when the system call returns an
951error.
Guido van Rossumae110af1997-05-22 20:11:52 +0000952\end{cfuncdesc}
953
Fred Drake490d34d2001-06-20 21:39:12 +0000954\begin{cfuncdesc}{PyObject*}{PyErr_SetFromErrnoWithFilename}{PyObject *type,
955 char *filename}
956Similar to \cfunction{PyErr_SetFromErrno()}, with the additional
957behavior that if \var{filename} is not \NULL, it is passed to the
958constructor of \var{type} as a third parameter. In the case of
959exceptions such as \exception{IOError} and \exception{OSError}, this
960is used to define the \member{filename} attribute of the exception
961instance.
962\end{cfuncdesc}
963
Guido van Rossumae110af1997-05-22 20:11:52 +0000964\begin{cfuncdesc}{void}{PyErr_BadInternalCall}{}
Fred Drakee058b4f1998-02-16 06:15:35 +0000965This is a shorthand for \samp{PyErr_SetString(PyExc_TypeError,
Guido van Rossumae110af1997-05-22 20:11:52 +0000966\var{message})}, where \var{message} indicates that an internal
Guido van Rossum5060b3b1997-08-17 18:02:23 +0000967operation (e.g. a Python/C API function) was invoked with an illegal
Guido van Rossumae110af1997-05-22 20:11:52 +0000968argument. It is mostly for internal use.
969\end{cfuncdesc}
970
Guido van Rossum3dbb4062000-12-19 03:53:01 +0000971\begin{cfuncdesc}{int}{PyErr_Warn}{PyObject *category, char *message}
972Issue a warning message. The \var{category} argument is a warning
Fred Drake5566c1c2001-01-19 22:48:33 +0000973category (see below) or \NULL; the \var{message} argument is a message
Guido van Rossum3dbb4062000-12-19 03:53:01 +0000974string.
975
976This function normally prints a warning message to \var{sys.stderr};
977however, it is also possible that the user has specified that warnings
978are to be turned into errors, and in that case this will raise an
979exception. It is also possible that the function raises an exception
980because of a problem with the warning machinery (the implementation
981imports the \module{warnings} module to do the heavy lifting). The
982return value is \code{0} if no exception is raised, or \code{-1} if
983an exception is raised. (It is not possible to determine whether a
984warning message is actually printed, nor what the reason is for the
985exception; this is intentional.) If an exception is raised, the
Fred Drake5566c1c2001-01-19 22:48:33 +0000986caller should do its normal exception handling
987(e.g. \cfunction{Py_DECREF()} owned references and return an error
988value).
Guido van Rossum3dbb4062000-12-19 03:53:01 +0000989
990Warning categories must be subclasses of \cdata{Warning}; the default
991warning category is \cdata{RuntimeWarning}. The standard Python
992warning categories are available as global variables whose names are
993\samp{PyExc_} followed by the Python exception name. These have the
994type \ctype{PyObject*}; they are all class objects. Their names are
995\cdata{PyExc_Warning}, \cdata{PyExc_UserWarning},
996\cdata{PyExc_DeprecationWarning}, \cdata{PyExc_SyntaxWarning}, and
997\cdata{PyExc_RuntimeWarning}. \cdata{PyExc_Warning} is a subclass of
998\cdata{PyExc_Exception}; the other warning categories are subclasses
999of \cdata{PyExc_Warning}.
1000
1001For information about warning control, see the documentation for the
Fred Drake316ef7c2001-01-04 05:56:34 +00001002\module{warnings} module and the \programopt{-W} option in the command
1003line documentation. There is no C API for warning control.
Guido van Rossum3dbb4062000-12-19 03:53:01 +00001004\end{cfuncdesc}
1005
Guido van Rossum1874c8f2001-02-28 23:46:44 +00001006\begin{cfuncdesc}{int}{PyErr_WarnExplicit}{PyObject *category, char *message,
1007char *filename, int lineno, char *module, PyObject *registry}
1008Issue a warning message with explicit control over all warning
1009attributes. This is a straightforward wrapper around the Python
1010function \function{warnings.warn_explicit()}, see there for more
1011information. The \var{module} and \var{registry} arguments may be
1012set to \code{NULL} to get the default effect described there.
1013\end{cfuncdesc}
1014
Guido van Rossumae110af1997-05-22 20:11:52 +00001015\begin{cfuncdesc}{int}{PyErr_CheckSignals}{}
1016This function interacts with Python's signal handling. It checks
1017whether a signal has been sent to the processes and if so, invokes the
Fred Drake4de05a91998-02-16 14:25:26 +00001018corresponding signal handler. If the
1019\module{signal}\refbimodindex{signal} module is supported, this can
1020invoke a signal handler written in Python. In all cases, the default
Fred Drake659ebfa2000-04-03 15:42:13 +00001021effect for \constant{SIGINT}\ttindex{SIGINT} is to raise the
1022\withsubitem{(built-in exception)}{\ttindex{KeyboardInterrupt}}
1023\exception{KeyboardInterrupt} exception. If an exception is raised the
Fred Drakee058b4f1998-02-16 06:15:35 +00001024error indicator is set and the function returns \code{1}; otherwise
1025the function returns \code{0}. The error indicator may or may not be
1026cleared if it was previously set.
Guido van Rossumae110af1997-05-22 20:11:52 +00001027\end{cfuncdesc}
1028
1029\begin{cfuncdesc}{void}{PyErr_SetInterrupt}{}
Fred Drake659ebfa2000-04-03 15:42:13 +00001030This function is obsolete. It simulates the effect of a
1031\constant{SIGINT}\ttindex{SIGINT} signal arriving --- the next time
Fred Drakee058b4f1998-02-16 06:15:35 +00001032\cfunction{PyErr_CheckSignals()} is called,
Fred Drake659ebfa2000-04-03 15:42:13 +00001033\withsubitem{(built-in exception)}{\ttindex{KeyboardInterrupt}}
1034\exception{KeyboardInterrupt} will be raised.
1035It may be called without holding the interpreter lock.
Guido van Rossumae110af1997-05-22 20:11:52 +00001036\end{cfuncdesc}
1037
Fred Drakec6fa34e1998-04-02 06:47:24 +00001038\begin{cfuncdesc}{PyObject*}{PyErr_NewException}{char *name,
1039 PyObject *base,
1040 PyObject *dict}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001041This utility function creates and returns a new exception object. The
Fred Drake659ebfa2000-04-03 15:42:13 +00001042\var{name} argument must be the name of the new exception, a C string
1043of the form \code{module.class}. The \var{base} and
Fred Draked04038d2000-06-29 20:15:14 +00001044\var{dict} arguments are normally \NULL{}. This creates a
Fred Drake659ebfa2000-04-03 15:42:13 +00001045class object derived from the root for all exceptions, the built-in
1046name \exception{Exception} (accessible in C as
Fred Draked04038d2000-06-29 20:15:14 +00001047\cdata{PyExc_Exception}). The \member{__module__} attribute of the
1048new class is set to the first part (up to the last dot) of the
1049\var{name} argument, and the class name is set to the last part (after
1050the last dot). The \var{base} argument can be used to specify an
1051alternate base class. The \var{dict} argument can be used to specify
1052a dictionary of class variables and methods.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001053\end{cfuncdesc}
1054
Jeremy Hyltonb709df32000-09-01 02:47:25 +00001055\begin{cfuncdesc}{void}{PyErr_WriteUnraisable}{PyObject *obj}
1056This utility function prints a warning message to \var{sys.stderr}
1057when an exception has been set but it is impossible for the
1058interpreter to actually raise the exception. It is used, for example,
1059when an exception occurs in an \member{__del__} method.
1060
1061The function is called with a single argument \var{obj} that
1062identifies where the context in which the unraisable exception
1063occurred. The repr of \var{obj} will be printed in the warning
1064message.
1065\end{cfuncdesc}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001066
Fred Drakeefd146c1999-02-15 15:30:45 +00001067\section{Standard Exceptions \label{standardExceptions}}
Guido van Rossumae110af1997-05-22 20:11:52 +00001068
1069All standard Python exceptions are available as global variables whose
Fred Drake659ebfa2000-04-03 15:42:13 +00001070names are \samp{PyExc_} followed by the Python exception name. These
1071have the type \ctype{PyObject*}; they are all class objects. For
1072completeness, here are all the variables:
1073
1074\begin{tableiii}{l|l|c}{cdata}{C Name}{Python Name}{Notes}
1075 \lineiii{PyExc_Exception}{\exception{Exception}}{(1)}
1076 \lineiii{PyExc_StandardError}{\exception{StandardError}}{(1)}
1077 \lineiii{PyExc_ArithmeticError}{\exception{ArithmeticError}}{(1)}
1078 \lineiii{PyExc_LookupError}{\exception{LookupError}}{(1)}
1079 \lineiii{PyExc_AssertionError}{\exception{AssertionError}}{}
1080 \lineiii{PyExc_AttributeError}{\exception{AttributeError}}{}
1081 \lineiii{PyExc_EOFError}{\exception{EOFError}}{}
1082 \lineiii{PyExc_EnvironmentError}{\exception{EnvironmentError}}{(1)}
1083 \lineiii{PyExc_FloatingPointError}{\exception{FloatingPointError}}{}
1084 \lineiii{PyExc_IOError}{\exception{IOError}}{}
1085 \lineiii{PyExc_ImportError}{\exception{ImportError}}{}
1086 \lineiii{PyExc_IndexError}{\exception{IndexError}}{}
1087 \lineiii{PyExc_KeyError}{\exception{KeyError}}{}
1088 \lineiii{PyExc_KeyboardInterrupt}{\exception{KeyboardInterrupt}}{}
1089 \lineiii{PyExc_MemoryError}{\exception{MemoryError}}{}
1090 \lineiii{PyExc_NameError}{\exception{NameError}}{}
1091 \lineiii{PyExc_NotImplementedError}{\exception{NotImplementedError}}{}
1092 \lineiii{PyExc_OSError}{\exception{OSError}}{}
1093 \lineiii{PyExc_OverflowError}{\exception{OverflowError}}{}
1094 \lineiii{PyExc_RuntimeError}{\exception{RuntimeError}}{}
1095 \lineiii{PyExc_SyntaxError}{\exception{SyntaxError}}{}
1096 \lineiii{PyExc_SystemError}{\exception{SystemError}}{}
1097 \lineiii{PyExc_SystemExit}{\exception{SystemExit}}{}
1098 \lineiii{PyExc_TypeError}{\exception{TypeError}}{}
1099 \lineiii{PyExc_ValueError}{\exception{ValueError}}{}
Fred Drakea8d73412000-08-11 20:39:29 +00001100 \lineiii{PyExc_WindowsError}{\exception{WindowsError}}{(2)}
Fred Drake659ebfa2000-04-03 15:42:13 +00001101 \lineiii{PyExc_ZeroDivisionError}{\exception{ZeroDivisionError}}{}
1102\end{tableiii}
1103
1104\noindent
Fred Drakea8d73412000-08-11 20:39:29 +00001105Notes:
Fred Drake659ebfa2000-04-03 15:42:13 +00001106\begin{description}
1107\item[(1)]
Fred Draked04038d2000-06-29 20:15:14 +00001108 This is a base class for other standard exceptions.
Fred Drakea8d73412000-08-11 20:39:29 +00001109
1110\item[(2)]
1111 Only defined on Windows; protect code that uses this by testing that
1112 the preprocessor macro \code{MS_WINDOWS} is defined.
Fred Drake659ebfa2000-04-03 15:42:13 +00001113\end{description}
1114
1115
1116\section{Deprecation of String Exceptions}
1117
Fred Draked04038d2000-06-29 20:15:14 +00001118All exceptions built into Python or provided in the standard library
1119are derived from \exception{Exception}.
Fred Drake659ebfa2000-04-03 15:42:13 +00001120\withsubitem{(built-in exception)}{\ttindex{Exception}}
Fred Drake659ebfa2000-04-03 15:42:13 +00001121
Fred Draked04038d2000-06-29 20:15:14 +00001122String exceptions are still supported in the interpreter to allow
Fred Drake659ebfa2000-04-03 15:42:13 +00001123existing code to run unmodified, but this will also change in a future
1124release.
Guido van Rossumae110af1997-05-22 20:11:52 +00001125
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001126
Fred Drakeefd146c1999-02-15 15:30:45 +00001127\chapter{Utilities \label{utilities}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001128
1129The functions in this chapter perform various utility tasks, such as
Fred Drake659ebfa2000-04-03 15:42:13 +00001130parsing function arguments and constructing Python values from C
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001131values.
1132
Fred Drakeefd146c1999-02-15 15:30:45 +00001133\section{OS Utilities \label{os}}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001134
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001135\begin{cfuncdesc}{int}{Py_FdIsInteractive}{FILE *fp, char *filename}
Fred Drakee058b4f1998-02-16 06:15:35 +00001136Return true (nonzero) if the standard I/O file \var{fp} with name
1137\var{filename} is deemed interactive. This is the case for files for
1138which \samp{isatty(fileno(\var{fp}))} is true. If the global flag
Fred Drakef8830d11998-04-23 14:06:01 +00001139\cdata{Py_InteractiveFlag} is true, this function also returns true if
Fred Drake5566c1c2001-01-19 22:48:33 +00001140the \var{filename} pointer is \NULL{} or if the name is equal to one of
Fred Drakea8455ab2000-06-16 19:58:42 +00001141the strings \code{'<stdin>'} or \code{'???'}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001142\end{cfuncdesc}
1143
1144\begin{cfuncdesc}{long}{PyOS_GetLastModificationTime}{char *filename}
Fred Drakee058b4f1998-02-16 06:15:35 +00001145Return the time of last modification of the file \var{filename}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001146The result is encoded in the same way as the timestamp returned by
Fred Drake659ebfa2000-04-03 15:42:13 +00001147the standard C library function \cfunction{time()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001148\end{cfuncdesc}
1149
Fred Drakecabbc3b2000-06-28 15:53:13 +00001150\begin{cfuncdesc}{void}{PyOS_AfterFork}{}
1151Function to update some internal state after a process fork; this
1152should be called in the new process if the Python interpreter will
1153continue to be used. If a new executable is loaded into the new
1154process, this function does not need to be called.
1155\end{cfuncdesc}
1156
Fred Drake17e63432000-08-31 05:50:40 +00001157\begin{cfuncdesc}{int}{PyOS_CheckStack}{}
1158Return true when the interpreter runs out of stack space. This is a
1159reliable check, but is only available when \code{USE_STACKCHECK} is
1160defined (currently on Windows using the Microsoft Visual C++ compiler
1161and on the Macintosh). \code{USE_CHECKSTACK} will be defined
1162automatically; you should never change the definition in your own
1163code.
1164\end{cfuncdesc}
1165
Guido van Rossumc96ec6e2000-09-16 16:30:48 +00001166\begin{cfuncdesc}{PyOS_sighandler_t}{PyOS_getsig}{int i}
1167Return the current signal handler for signal \var{i}.
1168This is a thin wrapper around either \cfunction{sigaction} or
1169\cfunction{signal}. Do not call those functions directly!
1170\ctype{PyOS_sighandler_t} is a typedef alias for \ctype{void (*)(int)}.
1171\end{cfuncdesc}
1172
1173\begin{cfuncdesc}{PyOS_sighandler_t}{PyOS_setsig}{int i, PyOS_sighandler_t h}
1174Set the signal handler for signal \var{i} to be \var{h};
1175return the old signal handler.
1176This is a thin wrapper around either \cfunction{sigaction} or
1177\cfunction{signal}. Do not call those functions directly!
1178\ctype{PyOS_sighandler_t} is a typedef alias for \ctype{void (*)(int)}.
1179\end{cfuncdesc}
1180
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001181
Fred Drakeefd146c1999-02-15 15:30:45 +00001182\section{Process Control \label{processControl}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00001183
1184\begin{cfuncdesc}{void}{Py_FatalError}{char *message}
1185Print a fatal error message and kill the process. No cleanup is
1186performed. This function should only be invoked when a condition is
1187detected that would make it dangerous to continue using the Python
1188interpreter; e.g., when the object administration appears to be
Fred Drake659ebfa2000-04-03 15:42:13 +00001189corrupted. On \UNIX{}, the standard C library function
1190\cfunction{abort()}\ttindex{abort()} is called which will attempt to
1191produce a \file{core} file.
Fred Drakee5bf8b21998-02-12 21:22:28 +00001192\end{cfuncdesc}
1193
1194\begin{cfuncdesc}{void}{Py_Exit}{int status}
Fred Drake659ebfa2000-04-03 15:42:13 +00001195Exit the current process. This calls
1196\cfunction{Py_Finalize()}\ttindex{Py_Finalize()} and
1197then calls the standard C library function
1198\code{exit(\var{status})}\ttindex{exit()}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00001199\end{cfuncdesc}
1200
1201\begin{cfuncdesc}{int}{Py_AtExit}{void (*func) ()}
Fred Drake659ebfa2000-04-03 15:42:13 +00001202Register a cleanup function to be called by
1203\cfunction{Py_Finalize()}\ttindex{Py_Finalize()}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00001204The cleanup function will be called with no arguments and should
Fred Drake659ebfa2000-04-03 15:42:13 +00001205return no value. At most 32 \index{cleanup functions}cleanup
1206functions can be registered.
Fred Drakee5bf8b21998-02-12 21:22:28 +00001207When the registration is successful, \cfunction{Py_AtExit()} returns
1208\code{0}; on failure, it returns \code{-1}. The cleanup function
1209registered last is called first. Each cleanup function will be called
1210at most once. Since Python's internal finallization will have
1211completed before the cleanup function, no Python APIs should be called
1212by \var{func}.
1213\end{cfuncdesc}
1214
1215
Fred Drakeefd146c1999-02-15 15:30:45 +00001216\section{Importing Modules \label{importing}}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001217
Fred Drakec6fa34e1998-04-02 06:47:24 +00001218\begin{cfuncdesc}{PyObject*}{PyImport_ImportModule}{char *name}
Fred Drake659ebfa2000-04-03 15:42:13 +00001219This is a simplified interface to
1220\cfunction{PyImport_ImportModuleEx()} below, leaving the
1221\var{globals} and \var{locals} arguments set to \NULL{}. When the
1222\var{name} argument contains a dot (i.e., when it specifies a
1223submodule of a package), the \var{fromlist} argument is set to the
1224list \code{['*']} so that the return value is the named module rather
1225than the top-level package containing it as would otherwise be the
1226case. (Unfortunately, this has an additional side effect when
1227\var{name} in fact specifies a subpackage instead of a submodule: the
1228submodules specified in the package's \code{__all__} variable are
1229\index{package variable!\code{__all__}}
1230\withsubitem{(package variable)}{\ttindex{__all__}}loaded.) Return a
1231new reference to the imported module, or
1232\NULL{} with an exception set on failure (the module may still be
1233created in this case --- examine \code{sys.modules} to find out).
1234\withsubitem{(in module sys)}{\ttindex{modules}}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001235\end{cfuncdesc}
1236
Fred Drakec6fa34e1998-04-02 06:47:24 +00001237\begin{cfuncdesc}{PyObject*}{PyImport_ImportModuleEx}{char *name, PyObject *globals, PyObject *locals, PyObject *fromlist}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001238Import a module. This is best described by referring to the built-in
Fred Drake53fb7721998-02-16 06:23:20 +00001239Python function \function{__import__()}\bifuncindex{__import__}, as
1240the standard \function{__import__()} function calls this function
1241directly.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001242
Guido van Rossum42cefd01997-10-05 15:27:29 +00001243The return value is a new reference to the imported module or
Guido van Rossum580aa8d1997-11-25 15:34:51 +00001244top-level package, or \NULL{} with an exception set on failure
Guido van Rossumc44d3d61997-10-06 05:10:47 +00001245(the module may still be created in this case). Like for
Fred Drakee058b4f1998-02-16 06:15:35 +00001246\function{__import__()}, the return value when a submodule of a
1247package was requested is normally the top-level package, unless a
1248non-empty \var{fromlist} was given.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001249\end{cfuncdesc}
1250
Fred Drakec6fa34e1998-04-02 06:47:24 +00001251\begin{cfuncdesc}{PyObject*}{PyImport_Import}{PyObject *name}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001252This is a higher-level interface that calls the current ``import hook
Fred Drakee058b4f1998-02-16 06:15:35 +00001253function''. It invokes the \function{__import__()} function from the
Guido van Rossum42cefd01997-10-05 15:27:29 +00001254\code{__builtins__} of the current globals. This means that the
1255import is done using whatever import hooks are installed in the
Fred Drake4de05a91998-02-16 14:25:26 +00001256current environment, e.g. by \module{rexec}\refstmodindex{rexec} or
1257\module{ihooks}\refstmodindex{ihooks}.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001258\end{cfuncdesc}
1259
Fred Drakec6fa34e1998-04-02 06:47:24 +00001260\begin{cfuncdesc}{PyObject*}{PyImport_ReloadModule}{PyObject *m}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001261Reload a module. This is best described by referring to the built-in
Fred Drake53fb7721998-02-16 06:23:20 +00001262Python function \function{reload()}\bifuncindex{reload}, as the standard
Fred Drakee058b4f1998-02-16 06:15:35 +00001263\function{reload()} function calls this function directly. Return a
1264new reference to the reloaded module, or \NULL{} with an exception set
1265on failure (the module still exists in this case).
Guido van Rossum42cefd01997-10-05 15:27:29 +00001266\end{cfuncdesc}
1267
Fred Drakec6fa34e1998-04-02 06:47:24 +00001268\begin{cfuncdesc}{PyObject*}{PyImport_AddModule}{char *name}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001269Return the module object corresponding to a module name. The
1270\var{name} argument may be of the form \code{package.module}). First
1271check the modules dictionary if there's one there, and if not, create
Fred Drake659ebfa2000-04-03 15:42:13 +00001272a new one and insert in in the modules dictionary.
Guido van Rossuma096a2e1998-11-02 17:02:42 +00001273Warning: this function does not load or import the module; if the
1274module wasn't already loaded, you will get an empty module object.
1275Use \cfunction{PyImport_ImportModule()} or one of its variants to
1276import a module.
Fred Drake659ebfa2000-04-03 15:42:13 +00001277Return \NULL{} with an exception set on failure.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001278\end{cfuncdesc}
1279
Fred Drakec6fa34e1998-04-02 06:47:24 +00001280\begin{cfuncdesc}{PyObject*}{PyImport_ExecCodeModule}{char *name, PyObject *co}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001281Given a module name (possibly of the form \code{package.module}) and a
1282code object read from a Python bytecode file or obtained from the
Fred Drake53fb7721998-02-16 06:23:20 +00001283built-in function \function{compile()}\bifuncindex{compile}, load the
1284module. Return a new reference to the module object, or \NULL{} with
1285an exception set if an error occurred (the module may still be created
1286in this case). (This function would reload the module if it was
1287already imported.)
Guido van Rossum42cefd01997-10-05 15:27:29 +00001288\end{cfuncdesc}
1289
1290\begin{cfuncdesc}{long}{PyImport_GetMagicNumber}{}
Fred Drake659ebfa2000-04-03 15:42:13 +00001291Return the magic number for Python bytecode files (a.k.a.
1292\file{.pyc} and \file{.pyo} files). The magic number should be
1293present in the first four bytes of the bytecode file, in little-endian
1294byte order.
Guido van Rossum42cefd01997-10-05 15:27:29 +00001295\end{cfuncdesc}
1296
Fred Drakec6fa34e1998-04-02 06:47:24 +00001297\begin{cfuncdesc}{PyObject*}{PyImport_GetModuleDict}{}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001298Return the dictionary used for the module administration
1299(a.k.a. \code{sys.modules}). Note that this is a per-interpreter
1300variable.
1301\end{cfuncdesc}
1302
1303\begin{cfuncdesc}{void}{_PyImport_Init}{}
1304Initialize the import mechanism. For internal use only.
1305\end{cfuncdesc}
1306
1307\begin{cfuncdesc}{void}{PyImport_Cleanup}{}
1308Empty the module table. For internal use only.
1309\end{cfuncdesc}
1310
1311\begin{cfuncdesc}{void}{_PyImport_Fini}{}
1312Finalize the import mechanism. For internal use only.
1313\end{cfuncdesc}
1314
Fred Drakec6fa34e1998-04-02 06:47:24 +00001315\begin{cfuncdesc}{PyObject*}{_PyImport_FindExtension}{char *, char *}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001316For internal use only.
Guido van Rossum5b8a5231997-12-30 04:38:44 +00001317\end{cfuncdesc}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001318
Fred Drakec6fa34e1998-04-02 06:47:24 +00001319\begin{cfuncdesc}{PyObject*}{_PyImport_FixupExtension}{char *, char *}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001320For internal use only.
Guido van Rossum5b8a5231997-12-30 04:38:44 +00001321\end{cfuncdesc}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001322
Fred Drake1d158692000-06-18 05:21:21 +00001323\begin{cfuncdesc}{int}{PyImport_ImportFrozenModule}{char *name}
1324Load a frozen module named \var{name}. Return \code{1} for success,
1325\code{0} if the module is not found, and \code{-1} with an exception
1326set if the initialization failed. To access the imported module on a
1327successful load, use \cfunction{PyImport_ImportModule()}.
Fred Drakee058b4f1998-02-16 06:15:35 +00001328(Note the misnomer --- this function would reload the module if it was
Guido van Rossum42cefd01997-10-05 15:27:29 +00001329already imported.)
1330\end{cfuncdesc}
1331
Fred Drake659ebfa2000-04-03 15:42:13 +00001332\begin{ctypedesc}[_frozen]{struct _frozen}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001333This is the structure type definition for frozen module descriptors,
Fred Drakec6fa34e1998-04-02 06:47:24 +00001334as generated by the \program{freeze}\index{freeze utility} utility
1335(see \file{Tools/freeze/} in the Python source distribution). Its
Fred Drakee0d9a832000-09-01 05:30:00 +00001336definition, found in \file{Include/import.h}, is:
Fred Drakec6fa34e1998-04-02 06:47:24 +00001337
Guido van Rossum9faf4c51997-10-07 14:38:54 +00001338\begin{verbatim}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001339struct _frozen {
Fred Drake36fbe761997-10-13 18:18:33 +00001340 char *name;
1341 unsigned char *code;
1342 int size;
Guido van Rossum42cefd01997-10-05 15:27:29 +00001343};
Guido van Rossum9faf4c51997-10-07 14:38:54 +00001344\end{verbatim}
Guido van Rossum42cefd01997-10-05 15:27:29 +00001345\end{ctypedesc}
1346
Fred Drakec6fa34e1998-04-02 06:47:24 +00001347\begin{cvardesc}{struct _frozen*}{PyImport_FrozenModules}
Fred Drakef8830d11998-04-23 14:06:01 +00001348This pointer is initialized to point to an array of \ctype{struct
Fred Drake659ebfa2000-04-03 15:42:13 +00001349_frozen} records, terminated by one whose members are all
1350\NULL{} or zero. When a frozen module is imported, it is searched in
1351this table. Third-party code could play tricks with this to provide a
Guido van Rossum42cefd01997-10-05 15:27:29 +00001352dynamically created collection of frozen modules.
1353\end{cvardesc}
1354
Fred Drakee0d9a832000-09-01 05:30:00 +00001355\begin{cfuncdesc}{int}{PyImport_AppendInittab}{char *name,
1356 void (*initfunc)(void)}
1357Add a single module to the existing table of built-in modules. This
1358is a convenience wrapper around \cfunction{PyImport_ExtendInittab()},
1359returning \code{-1} if the table could not be extended. The new
1360module can be imported by the name \var{name}, and uses the function
1361\var{initfunc} as the initialization function called on the first
1362attempted import. This should be called before
1363\cfunction{Py_Initialize()}.
1364\end{cfuncdesc}
1365
1366\begin{ctypedesc}[_inittab]{struct _inittab}
1367Structure describing a single entry in the list of built-in modules.
1368Each of these structures gives the name and initialization function
1369for a module built into the interpreter. Programs which embed Python
1370may use an array of these structures in conjunction with
1371\cfunction{PyImport_ExtendInittab()} to provide additional built-in
1372modules. The structure is defined in \file{Include/import.h} as:
1373
1374\begin{verbatim}
1375struct _inittab {
1376 char *name;
1377 void (*initfunc)(void);
1378};
1379\end{verbatim}
1380\end{ctypedesc}
1381
1382\begin{cfuncdesc}{int}{PyImport_ExtendInittab}{struct _inittab *newtab}
1383Add a collection of modules to the table of built-in modules. The
1384\var{newtab} array must end with a sentinel entry which contains
1385\NULL{} for the \member{name} field; failure to provide the sentinel
1386value can result in a memory fault. Returns \code{0} on success or
1387\code{-1} if insufficient memory could be allocated to extend the
1388internal table. In the event of failure, no modules are added to the
1389internal table. This should be called before
1390\cfunction{Py_Initialize()}.
1391\end{cfuncdesc}
1392
Guido van Rossum42cefd01997-10-05 15:27:29 +00001393
Fred Drakeefd146c1999-02-15 15:30:45 +00001394\chapter{Abstract Objects Layer \label{abstract}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001395
1396The functions in this chapter interact with Python objects regardless
1397of their type, or with wide classes of object types (e.g. all
1398numerical types, or all sequence types). When used on object types
Fred Drake659ebfa2000-04-03 15:42:13 +00001399for which they do not apply, they will raise a Python exception.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001400
Fred Drakeefd146c1999-02-15 15:30:45 +00001401\section{Object Protocol \label{object}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001402
1403\begin{cfuncdesc}{int}{PyObject_Print}{PyObject *o, FILE *fp, int flags}
Fred Drake659ebfa2000-04-03 15:42:13 +00001404Print an object \var{o}, on file \var{fp}. Returns \code{-1} on error.
1405The flags argument is used to enable certain printing options. The
1406only option currently supported is \constant{Py_PRINT_RAW}; if given,
1407the \function{str()} of the object is written instead of the
1408\function{repr()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001409\end{cfuncdesc}
1410
1411\begin{cfuncdesc}{int}{PyObject_HasAttrString}{PyObject *o, char *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001412Returns \code{1} if \var{o} has the attribute \var{attr_name}, and
1413\code{0} otherwise. This is equivalent to the Python expression
1414\samp{hasattr(\var{o}, \var{attr_name})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001415This function always succeeds.
1416\end{cfuncdesc}
1417
Fred Drake659ebfa2000-04-03 15:42:13 +00001418\begin{cfuncdesc}{PyObject*}{PyObject_GetAttrString}{PyObject *o,
1419 char *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001420Retrieve an attribute named \var{attr_name} from object \var{o}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001421Returns the attribute value on success, or \NULL{} on failure.
Fred Drakee058b4f1998-02-16 06:15:35 +00001422This is the equivalent of the Python expression
1423\samp{\var{o}.\var{attr_name}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001424\end{cfuncdesc}
1425
1426
1427\begin{cfuncdesc}{int}{PyObject_HasAttr}{PyObject *o, PyObject *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001428Returns \code{1} if \var{o} has the attribute \var{attr_name}, and
1429\code{0} otherwise. This is equivalent to the Python expression
1430\samp{hasattr(\var{o}, \var{attr_name})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001431This function always succeeds.
1432\end{cfuncdesc}
1433
1434
Fred Drake659ebfa2000-04-03 15:42:13 +00001435\begin{cfuncdesc}{PyObject*}{PyObject_GetAttr}{PyObject *o,
1436 PyObject *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001437Retrieve an attribute named \var{attr_name} from object \var{o}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001438Returns the attribute value on success, or \NULL{} on failure.
Fred Drakee058b4f1998-02-16 06:15:35 +00001439This is the equivalent of the Python expression
1440\samp{\var{o}.\var{attr_name}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001441\end{cfuncdesc}
1442
1443
1444\begin{cfuncdesc}{int}{PyObject_SetAttrString}{PyObject *o, char *attr_name, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00001445Set the value of the attribute named \var{attr_name}, for object
1446\var{o}, to the value \var{v}. Returns \code{-1} on failure. This is
1447the equivalent of the Python statement \samp{\var{o}.\var{attr_name} =
1448\var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001449\end{cfuncdesc}
1450
1451
1452\begin{cfuncdesc}{int}{PyObject_SetAttr}{PyObject *o, PyObject *attr_name, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00001453Set the value of the attribute named \var{attr_name}, for
1454object \var{o},
1455to the value \var{v}. Returns \code{-1} on failure. This is
1456the equivalent of the Python statement \samp{\var{o}.\var{attr_name} =
1457\var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001458\end{cfuncdesc}
1459
1460
1461\begin{cfuncdesc}{int}{PyObject_DelAttrString}{PyObject *o, char *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001462Delete attribute named \var{attr_name}, for object \var{o}. Returns
1463\code{-1} on failure. This is the equivalent of the Python
1464statement: \samp{del \var{o}.\var{attr_name}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001465\end{cfuncdesc}
1466
1467
1468\begin{cfuncdesc}{int}{PyObject_DelAttr}{PyObject *o, PyObject *attr_name}
Fred Drakee058b4f1998-02-16 06:15:35 +00001469Delete attribute named \var{attr_name}, for object \var{o}. Returns
1470\code{-1} on failure. This is the equivalent of the Python
1471statement \samp{del \var{o}.\var{attr_name}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001472\end{cfuncdesc}
1473
1474
1475\begin{cfuncdesc}{int}{PyObject_Cmp}{PyObject *o1, PyObject *o2, int *result}
Fred Drakee058b4f1998-02-16 06:15:35 +00001476Compare the values of \var{o1} and \var{o2} using a routine provided
1477by \var{o1}, if one exists, otherwise with a routine provided by
1478\var{o2}. The result of the comparison is returned in \var{result}.
1479Returns \code{-1} on failure. This is the equivalent of the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00001480statement\bifuncindex{cmp} \samp{\var{result} = cmp(\var{o1}, \var{o2})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001481\end{cfuncdesc}
1482
1483
1484\begin{cfuncdesc}{int}{PyObject_Compare}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001485Compare the values of \var{o1} and \var{o2} using a routine provided
1486by \var{o1}, if one exists, otherwise with a routine provided by
1487\var{o2}. Returns the result of the comparison on success. On error,
1488the value returned is undefined; use \cfunction{PyErr_Occurred()} to
Fred Drake659ebfa2000-04-03 15:42:13 +00001489detect an error. This is equivalent to the Python
1490expression\bifuncindex{cmp} \samp{cmp(\var{o1}, \var{o2})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001491\end{cfuncdesc}
1492
1493
1494\begin{cfuncdesc}{PyObject*}{PyObject_Repr}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00001495Compute a string representation of object \var{o}. Returns the
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001496string representation on success, \NULL{} on failure. This is
Fred Drakee058b4f1998-02-16 06:15:35 +00001497the equivalent of the Python expression \samp{repr(\var{o})}.
1498Called by the \function{repr()}\bifuncindex{repr} built-in function
1499and by reverse quotes.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001500\end{cfuncdesc}
1501
1502
1503\begin{cfuncdesc}{PyObject*}{PyObject_Str}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00001504Compute a string representation of object \var{o}. Returns the
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001505string representation on success, \NULL{} on failure. This is
Fred Drakee058b4f1998-02-16 06:15:35 +00001506the equivalent of the Python expression \samp{str(\var{o})}.
1507Called by the \function{str()}\bifuncindex{str} built-in function and
1508by the \keyword{print} statement.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001509\end{cfuncdesc}
1510
1511
Marc-André Lemburgad7c98e2001-01-17 17:09:53 +00001512\begin{cfuncdesc}{PyObject*}{PyObject_Unicode}{PyObject *o}
1513Compute a Unicode string representation of object \var{o}. Returns the
1514Unicode string representation on success, \NULL{} on failure. This is
1515the equivalent of the Python expression \samp{unistr(\var{o})}.
1516Called by the \function{unistr()}\bifuncindex{unistr} built-in function.
1517\end{cfuncdesc}
1518
Fred Drake58c8f9f2001-03-28 21:14:32 +00001519\begin{cfuncdesc}{int}{PyObject_IsInstance}{PyObject *inst, PyObject *cls}
1520Return \code{1} if \var{inst} is an instance of the class \var{cls} or
1521a subclass of \var{cls}. If \var{cls} is a type object rather than a
1522class object, \cfunction{PyObject_IsInstance()} returns \code{1} if
1523\var{inst} is of type \var{cls}. If \var{inst} is not a class
1524instance and \var{cls} is neither a type object or class object,
1525\var{inst} must have a \member{__class__} attribute --- the class
1526relationship of the value of that attribute with \var{cls} will be
1527used to determine the result of this function.
1528\versionadded{2.1}
1529\end{cfuncdesc}
1530
1531Subclass determination is done in a fairly straightforward way, but
1532includes a wrinkle that implementors of extensions to the class system
1533may want to be aware of. If \class{A} and \class{B} are class
1534objects, \class{B} is a subclass of \class{A} if it inherits from
1535\class{A} either directly or indirectly. If either is not a class
1536object, a more general mechanism is used to determine the class
1537relationship of the two objects. When testing if \var{B} is a
1538subclass of \var{A}, if \var{A} is \var{B},
1539\cfunction{PyObject_IsSubclass()} returns true. If \var{A} and
1540\var{B} are different objects, \var{B}'s \member{__bases__} attribute
1541is searched in a depth-first fashion for \var{A} --- the presence of
1542the \member{__bases__} attribute is considered sufficient for this
1543determination.
1544
1545\begin{cfuncdesc}{int}{PyObject_IsSubclass}{PyObject *derived,
1546 PyObject *cls}
1547Returns \code{1} if the class \var{derived} is identical to or derived
1548from the class \var{cls}, otherwise returns \code{0}. In case of an
1549error, returns \code{-1}. If either \var{derived} or \var{cls} is not
1550an actual class object, this function uses the generic algorithm
1551described above.
1552\versionadded{2.1}
1553\end{cfuncdesc}
1554
Marc-André Lemburgad7c98e2001-01-17 17:09:53 +00001555
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001556\begin{cfuncdesc}{int}{PyCallable_Check}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00001557Determine if the object \var{o} is callable. Return \code{1} if the
Fred Drakee058b4f1998-02-16 06:15:35 +00001558object is callable and \code{0} otherwise.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001559This function always succeeds.
1560\end{cfuncdesc}
1561
1562
Fred Drake659ebfa2000-04-03 15:42:13 +00001563\begin{cfuncdesc}{PyObject*}{PyObject_CallObject}{PyObject *callable_object,
1564 PyObject *args}
Fred Drakee058b4f1998-02-16 06:15:35 +00001565Call a callable Python object \var{callable_object}, with
1566arguments given by the tuple \var{args}. If no arguments are
Fred Drake659ebfa2000-04-03 15:42:13 +00001567needed, then \var{args} may be \NULL{}. Returns the result of the
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001568call on success, or \NULL{} on failure. This is the equivalent
Fred Drake5566c1c2001-01-19 22:48:33 +00001569of the Python expression \samp{apply(\var{callable_object}, \var{args})}.
Fred Drake659ebfa2000-04-03 15:42:13 +00001570\bifuncindex{apply}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001571\end{cfuncdesc}
1572
Fred Drake5566c1c2001-01-19 22:48:33 +00001573\begin{cfuncdesc}{PyObject*}{PyObject_CallFunction}{PyObject *callable_object,
1574 char *format, ...}
Fred Drakee058b4f1998-02-16 06:15:35 +00001575Call a callable Python object \var{callable_object}, with a
Fred Drake659ebfa2000-04-03 15:42:13 +00001576variable number of C arguments. The C arguments are described
Fred Drakee058b4f1998-02-16 06:15:35 +00001577using a \cfunction{Py_BuildValue()} style format string. The format may
1578be \NULL{}, indicating that no arguments are provided. Returns the
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001579result of the call on success, or \NULL{} on failure. This is
Fred Drake5566c1c2001-01-19 22:48:33 +00001580the equivalent of the Python expression \samp{apply(\var{callable_object},
Fred Drake659ebfa2000-04-03 15:42:13 +00001581\var{args})}.\bifuncindex{apply}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001582\end{cfuncdesc}
1583
1584
Fred Drake5566c1c2001-01-19 22:48:33 +00001585\begin{cfuncdesc}{PyObject*}{PyObject_CallMethod}{PyObject *o,
1586 char *method, char *format, ...}
Fred Drakee058b4f1998-02-16 06:15:35 +00001587Call the method named \var{m} of object \var{o} with a variable number
Fred Drake659ebfa2000-04-03 15:42:13 +00001588of C arguments. The C arguments are described by a
Fred Drakee058b4f1998-02-16 06:15:35 +00001589\cfunction{Py_BuildValue()} format string. The format may be \NULL{},
1590indicating that no arguments are provided. Returns the result of the
1591call on success, or \NULL{} on failure. This is the equivalent of the
1592Python expression \samp{\var{o}.\var{method}(\var{args})}.
Fred Drake659ebfa2000-04-03 15:42:13 +00001593Note that special method names, such as \method{__add__()},
1594\method{__getitem__()}, and so on are not supported. The specific
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001595abstract-object routines for these must be used.
1596\end{cfuncdesc}
1597
1598
1599\begin{cfuncdesc}{int}{PyObject_Hash}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001600Compute and return the hash value of an object \var{o}. On
1601failure, return \code{-1}. This is the equivalent of the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00001602expression \samp{hash(\var{o})}.\bifuncindex{hash}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001603\end{cfuncdesc}
1604
1605
1606\begin{cfuncdesc}{int}{PyObject_IsTrue}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001607Returns \code{1} if the object \var{o} is considered to be true, and
1608\code{0} otherwise. This is equivalent to the Python expression
1609\samp{not not \var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001610This function always succeeds.
1611\end{cfuncdesc}
1612
1613
1614\begin{cfuncdesc}{PyObject*}{PyObject_Type}{PyObject *o}
1615On success, returns a type object corresponding to the object
Fred Drakee058b4f1998-02-16 06:15:35 +00001616type of object \var{o}. On failure, returns \NULL{}. This is
1617equivalent to the Python expression \samp{type(\var{o})}.
Fred Drake53fb7721998-02-16 06:23:20 +00001618\bifuncindex{type}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001619\end{cfuncdesc}
1620
1621\begin{cfuncdesc}{int}{PyObject_Length}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001622Return the length of object \var{o}. If the object \var{o} provides
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001623both sequence and mapping protocols, the sequence length is
Fred Drake659ebfa2000-04-03 15:42:13 +00001624returned. On error, \code{-1} is returned. This is the equivalent
1625to the Python expression \samp{len(\var{o})}.\bifuncindex{len}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001626\end{cfuncdesc}
1627
1628
1629\begin{cfuncdesc}{PyObject*}{PyObject_GetItem}{PyObject *o, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00001630Return element of \var{o} corresponding to the object \var{key} or
1631\NULL{} on failure. This is the equivalent of the Python expression
1632\samp{\var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001633\end{cfuncdesc}
1634
1635
1636\begin{cfuncdesc}{int}{PyObject_SetItem}{PyObject *o, PyObject *key, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00001637Map the object \var{key} to the value \var{v}.
1638Returns \code{-1} on failure. This is the equivalent
1639of the Python statement \samp{\var{o}[\var{key}] = \var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001640\end{cfuncdesc}
1641
1642
Guido van Rossumd1dbf631999-01-22 20:10:49 +00001643\begin{cfuncdesc}{int}{PyObject_DelItem}{PyObject *o, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00001644Delete the mapping for \var{key} from \var{o}. Returns \code{-1} on
1645failure. This is the equivalent of the Python statement \samp{del
1646\var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001647\end{cfuncdesc}
1648
Andrew M. Kuchling8c46b302000-07-13 23:58:16 +00001649\begin{cfuncdesc}{int}{PyObject_AsFileDescriptor}{PyObject *o}
1650Derives a file-descriptor from a Python object. If the object
1651is an integer or long integer, its value is returned. If not, the
1652object's \method{fileno()} method is called if it exists; the method
1653must return an integer or long integer, which is returned as the file
1654descriptor value. Returns \code{-1} on failure.
1655\end{cfuncdesc}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001656
Fred Drakeefd146c1999-02-15 15:30:45 +00001657\section{Number Protocol \label{number}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001658
1659\begin{cfuncdesc}{int}{PyNumber_Check}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001660Returns \code{1} if the object \var{o} provides numeric protocols, and
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001661false otherwise.
1662This function always succeeds.
1663\end{cfuncdesc}
1664
1665
1666\begin{cfuncdesc}{PyObject*}{PyNumber_Add}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001667Returns the result of adding \var{o1} and \var{o2}, or \NULL{} on
1668failure. This is the equivalent of the Python expression
1669\samp{\var{o1} + \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001670\end{cfuncdesc}
1671
1672
1673\begin{cfuncdesc}{PyObject*}{PyNumber_Subtract}{PyObject *o1, PyObject *o2}
Fred Drake659ebfa2000-04-03 15:42:13 +00001674Returns the result of subtracting \var{o2} from \var{o1}, or
1675\NULL{} on failure. This is the equivalent of the Python expression
Fred Drakee058b4f1998-02-16 06:15:35 +00001676\samp{\var{o1} - \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001677\end{cfuncdesc}
1678
1679
1680\begin{cfuncdesc}{PyObject*}{PyNumber_Multiply}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001681Returns the result of multiplying \var{o1} and \var{o2}, or \NULL{} on
1682failure. This is the equivalent of the Python expression
1683\samp{\var{o1} * \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001684\end{cfuncdesc}
1685
1686
1687\begin{cfuncdesc}{PyObject*}{PyNumber_Divide}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001688Returns the result of dividing \var{o1} by \var{o2}, or \NULL{} on
1689failure.
1690This is the equivalent of the Python expression \samp{\var{o1} /
1691\var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001692\end{cfuncdesc}
1693
1694
1695\begin{cfuncdesc}{PyObject*}{PyNumber_Remainder}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001696Returns the remainder of dividing \var{o1} by \var{o2}, or \NULL{} on
1697failure. This is the equivalent of the Python expression
Fred Drake659ebfa2000-04-03 15:42:13 +00001698\samp{\var{o1} \%\ \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001699\end{cfuncdesc}
1700
1701
1702\begin{cfuncdesc}{PyObject*}{PyNumber_Divmod}{PyObject *o1, PyObject *o2}
Fred Drake53fb7721998-02-16 06:23:20 +00001703See the built-in function \function{divmod()}\bifuncindex{divmod}.
1704Returns \NULL{} on failure. This is the equivalent of the Python
1705expression \samp{divmod(\var{o1}, \var{o2})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001706\end{cfuncdesc}
1707
1708
1709\begin{cfuncdesc}{PyObject*}{PyNumber_Power}{PyObject *o1, PyObject *o2, PyObject *o3}
Fred Drake53fb7721998-02-16 06:23:20 +00001710See the built-in function \function{pow()}\bifuncindex{pow}. Returns
1711\NULL{} on failure. This is the equivalent of the Python expression
Fred Drakee058b4f1998-02-16 06:15:35 +00001712\samp{pow(\var{o1}, \var{o2}, \var{o3})}, where \var{o3} is optional.
Fred Drake659ebfa2000-04-03 15:42:13 +00001713If \var{o3} is to be ignored, pass \cdata{Py_None} in its place
1714(passing \NULL{} for \var{o3} would cause an illegal memory access).
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001715\end{cfuncdesc}
1716
1717
1718\begin{cfuncdesc}{PyObject*}{PyNumber_Negative}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001719Returns the negation of \var{o} on success, or \NULL{} on failure.
1720This is the equivalent of the Python expression \samp{-\var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001721\end{cfuncdesc}
1722
1723
1724\begin{cfuncdesc}{PyObject*}{PyNumber_Positive}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001725Returns \var{o} on success, or \NULL{} on failure.
1726This is the equivalent of the Python expression \samp{+\var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001727\end{cfuncdesc}
1728
1729
1730\begin{cfuncdesc}{PyObject*}{PyNumber_Absolute}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001731Returns the absolute value of \var{o}, or \NULL{} on failure. This is
1732the equivalent of the Python expression \samp{abs(\var{o})}.
Fred Drake659ebfa2000-04-03 15:42:13 +00001733\bifuncindex{abs}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001734\end{cfuncdesc}
1735
1736
1737\begin{cfuncdesc}{PyObject*}{PyNumber_Invert}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001738Returns the bitwise negation of \var{o} on success, or \NULL{} on
1739failure. This is the equivalent of the Python expression
1740\samp{\~\var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001741\end{cfuncdesc}
1742
1743
1744\begin{cfuncdesc}{PyObject*}{PyNumber_Lshift}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001745Returns the result of left shifting \var{o1} by \var{o2} on success,
1746or \NULL{} on failure. This is the equivalent of the Python
Fred Draked20d8b32001-04-13 14:52:39 +00001747expression \samp{\var{o1} <\code{<} \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001748\end{cfuncdesc}
1749
1750
1751\begin{cfuncdesc}{PyObject*}{PyNumber_Rshift}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001752Returns the result of right shifting \var{o1} by \var{o2} on success,
1753or \NULL{} on failure. This is the equivalent of the Python
Fred Draked20d8b32001-04-13 14:52:39 +00001754expression \samp{\var{o1} >\code{>} \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001755\end{cfuncdesc}
1756
1757
1758\begin{cfuncdesc}{PyObject*}{PyNumber_And}{PyObject *o1, PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00001759Returns the ``bitwise and'' of \var{o2} and \var{o2} on success and
1760\NULL{} on failure. This is the equivalent of the Python expression
Fred Drake5566c1c2001-01-19 22:48:33 +00001761\samp{\var{o1} \&\ \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001762\end{cfuncdesc}
1763
1764
1765\begin{cfuncdesc}{PyObject*}{PyNumber_Xor}{PyObject *o1, PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00001766Returns the ``bitwise exclusive or'' of \var{o1} by \var{o2} on success,
Fred Drakee058b4f1998-02-16 06:15:35 +00001767or \NULL{} on failure. This is the equivalent of the Python
1768expression \samp{\var{o1} \^{ }\var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001769\end{cfuncdesc}
1770
1771\begin{cfuncdesc}{PyObject*}{PyNumber_Or}{PyObject *o1, PyObject *o2}
Fred Drake7740a012000-09-12 20:27:05 +00001772Returns the ``bitwise or'' of \var{o1} and \var{o2} on success, or
1773\NULL{} on failure. This is the equivalent of the Python expression
1774\samp{\var{o1} | \var{o2}}.
1775\end{cfuncdesc}
1776
1777
1778\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceAdd}{PyObject *o1, PyObject *o2}
1779Returns the result of adding \var{o1} and \var{o2}, or \NULL{} on failure.
1780The operation is done \emph{in-place} when \var{o1} supports it. This is the
1781equivalent of the Python expression \samp{\var{o1} += \var{o2}}.
1782\end{cfuncdesc}
1783
1784
1785\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceSubtract}{PyObject *o1, PyObject *o2}
1786Returns the result of subtracting \var{o2} from \var{o1}, or
1787\NULL{} on failure. The operation is done \emph{in-place} when \var{o1}
1788supports it. This is the equivalent of the Python expression \samp{\var{o1}
1789-= \var{o2}}.
1790\end{cfuncdesc}
1791
1792
1793\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceMultiply}{PyObject *o1, PyObject *o2}
1794Returns the result of multiplying \var{o1} and \var{o2}, or \NULL{} on
1795failure. The operation is done \emph{in-place} when \var{o1} supports it.
1796This is the equivalent of the Python expression \samp{\var{o1} *= \var{o2}}.
1797\end{cfuncdesc}
1798
1799
1800\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceDivide}{PyObject *o1, PyObject *o2}
1801Returns the result of dividing \var{o1} by \var{o2}, or \NULL{} on failure.
1802The operation is done \emph{in-place} when \var{o1} supports it. This is the
1803equivalent of the Python expression \samp{\var{o1} /= \var{o2}}.
1804\end{cfuncdesc}
1805
1806
1807\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceRemainder}{PyObject *o1, PyObject *o2}
1808Returns the remainder of dividing \var{o1} by \var{o2}, or \NULL{} on
1809failure. The operation is done \emph{in-place} when \var{o1} supports it.
1810This is the equivalent of the Python expression \samp{\var{o1} \%= \var{o2}}.
1811\end{cfuncdesc}
1812
1813
1814\begin{cfuncdesc}{PyObject*}{PyNumber_InPlacePower}{PyObject *o1, PyObject *o2, PyObject *o3}
1815See the built-in function \function{pow()}\bifuncindex{pow}. Returns
1816\NULL{} on failure. The operation is done \emph{in-place} when \var{o1}
1817supports it. This is the equivalent of the Python expression \samp{\var{o1}
1818**= \var{o2}} when o3 is \cdata{Py_None}, or an in-place variant of
Fred Drake5566c1c2001-01-19 22:48:33 +00001819\samp{pow(\var{o1}, \var{o2}, \var{o3})} otherwise. If \var{o3} is to be
Fred Drake7740a012000-09-12 20:27:05 +00001820ignored, pass \cdata{Py_None} in its place (passing \NULL{} for \var{o3}
1821would cause an illegal memory access).
1822\end{cfuncdesc}
1823
1824\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceLshift}{PyObject *o1, PyObject *o2}
1825Returns the result of left shifting \var{o1} by \var{o2} on success, or
1826\NULL{} on failure. The operation is done \emph{in-place} when \var{o1}
1827supports it. This is the equivalent of the Python expression \samp{\var{o1}
Fred Draked20d8b32001-04-13 14:52:39 +00001828<\code{<=} \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001829\end{cfuncdesc}
1830
1831
1832\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceRshift}{PyObject *o1, PyObject *o2}
1833Returns the result of right shifting \var{o1} by \var{o2} on success, or
1834\NULL{} on failure. The operation is done \emph{in-place} when \var{o1}
1835supports it. This is the equivalent of the Python expression \samp{\var{o1}
Fred Draked20d8b32001-04-13 14:52:39 +00001836>\code{>=} \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001837\end{cfuncdesc}
1838
1839
1840\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceAnd}{PyObject *o1, PyObject *o2}
Fred Drake5566c1c2001-01-19 22:48:33 +00001841Returns the ``bitwise and'' of \var{o1} and \var{o2} on success
1842and \NULL{} on failure. The operation is done \emph{in-place} when
1843\var{o1} supports it. This is the equivalent of the Python expression
1844\samp{\var{o1} \&= \var{o2}}.
Fred Drake7740a012000-09-12 20:27:05 +00001845\end{cfuncdesc}
1846
1847
1848\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceXor}{PyObject *o1, PyObject *o2}
1849Returns the ``bitwise exclusive or'' of \var{o1} by \var{o2} on success, or
1850\NULL{} on failure. The operation is done \emph{in-place} when \var{o1}
1851supports it. This is the equivalent of the Python expression \samp{\var{o1}
1852\^= \var{o2}}.
1853\end{cfuncdesc}
1854
1855\begin{cfuncdesc}{PyObject*}{PyNumber_InPlaceOr}{PyObject *o1, PyObject *o2}
1856Returns the ``bitwise or'' of \var{o1} and \var{o2} on success, or \NULL{}
1857on failure. The operation is done \emph{in-place} when \var{o1} supports
1858it. This is the equivalent of the Python expression \samp{\var{o1} |=
1859\var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001860\end{cfuncdesc}
1861
Fred Drakec0e6c5b2000-09-22 18:17:49 +00001862\begin{cfuncdesc}{int}{PyNumber_Coerce}{PyObject **p1, PyObject **p2}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001863This function takes the addresses of two variables of type
Fred Drake659ebfa2000-04-03 15:42:13 +00001864\ctype{PyObject*}. If the objects pointed to by \code{*\var{p1}} and
1865\code{*\var{p2}} have the same type, increment their reference count
1866and return \code{0} (success). If the objects can be converted to a
1867common numeric type, replace \code{*p1} and \code{*p2} by their
1868converted value (with 'new' reference counts), and return \code{0}.
1869If no conversion is possible, or if some other error occurs, return
1870\code{-1} (failure) and don't increment the reference counts. The
1871call \code{PyNumber_Coerce(\&o1, \&o2)} is equivalent to the Python
1872statement \samp{\var{o1}, \var{o2} = coerce(\var{o1}, \var{o2})}.
1873\bifuncindex{coerce}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001874\end{cfuncdesc}
1875
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001876\begin{cfuncdesc}{PyObject*}{PyNumber_Int}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001877Returns the \var{o} converted to an integer object on success, or
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001878\NULL{} on failure. This is the equivalent of the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00001879expression \samp{int(\var{o})}.\bifuncindex{int}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001880\end{cfuncdesc}
1881
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001882\begin{cfuncdesc}{PyObject*}{PyNumber_Long}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001883Returns the \var{o} converted to a long integer object on success,
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001884or \NULL{} on failure. This is the equivalent of the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00001885expression \samp{long(\var{o})}.\bifuncindex{long}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001886\end{cfuncdesc}
1887
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001888\begin{cfuncdesc}{PyObject*}{PyNumber_Float}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00001889Returns the \var{o} converted to a float object on success, or
1890\NULL{} on failure. This is the equivalent of the Python expression
1891\samp{float(\var{o})}.\bifuncindex{float}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001892\end{cfuncdesc}
1893
1894
Fred Drakeefd146c1999-02-15 15:30:45 +00001895\section{Sequence Protocol \label{sequence}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001896
1897\begin{cfuncdesc}{int}{PySequence_Check}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00001898Return \code{1} if the object provides sequence protocol, and
1899\code{0} otherwise. This function always succeeds.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001900\end{cfuncdesc}
1901
Fred Drakec6a3cb42001-04-04 01:25:17 +00001902\begin{cfuncdesc}{int}{PySequence_Size}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00001903Returns the number of objects in sequence \var{o} on success, and
1904\code{-1} on failure. For objects that do not provide sequence
1905protocol, this is equivalent to the Python expression
1906\samp{len(\var{o})}.\bifuncindex{len}
1907\end{cfuncdesc}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001908
Fred Drakec6a3cb42001-04-04 01:25:17 +00001909\begin{cfuncdesc}{int}{PySequence_Length}{PyObject *o}
1910Alternate name for \cfunction{PySequence_Size()}.
1911\end{cfuncdesc}
1912
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001913\begin{cfuncdesc}{PyObject*}{PySequence_Concat}{PyObject *o1, PyObject *o2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001914Return the concatenation of \var{o1} and \var{o2} on success, and \NULL{} on
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001915failure. This is the equivalent of the Python
Fred Drakee058b4f1998-02-16 06:15:35 +00001916expression \samp{\var{o1} + \var{o2}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001917\end{cfuncdesc}
1918
1919
1920\begin{cfuncdesc}{PyObject*}{PySequence_Repeat}{PyObject *o, int count}
Fred Drake659ebfa2000-04-03 15:42:13 +00001921Return the result of repeating sequence object
1922\var{o} \var{count} times, or \NULL{} on failure. This is the
1923equivalent of the Python expression \samp{\var{o} * \var{count}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001924\end{cfuncdesc}
1925
Fred Drake7740a012000-09-12 20:27:05 +00001926\begin{cfuncdesc}{PyObject*}{PySequence_InPlaceConcat}{PyObject *o1, PyObject *o2}
1927Return the concatenation of \var{o1} and \var{o2} on success, and \NULL{} on
1928failure. The operation is done \emph{in-place} when \var{o1} supports it.
1929This is the equivalent of the Python expression \samp{\var{o1} += \var{o2}}.
1930\end{cfuncdesc}
1931
1932
1933\begin{cfuncdesc}{PyObject*}{PySequence_InPlaceRepeat}{PyObject *o, int count}
1934Return the result of repeating sequence object \var{o} \var{count} times, or
1935\NULL{} on failure. The operation is done \emph{in-place} when \var{o}
1936supports it. This is the equivalent of the Python expression \samp{\var{o}
1937*= \var{count}}.
1938\end{cfuncdesc}
1939
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001940
1941\begin{cfuncdesc}{PyObject*}{PySequence_GetItem}{PyObject *o, int i}
Fred Drakee058b4f1998-02-16 06:15:35 +00001942Return the \var{i}th element of \var{o}, or \NULL{} on failure. This
1943is the equivalent of the Python expression \samp{\var{o}[\var{i}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001944\end{cfuncdesc}
1945
1946
1947\begin{cfuncdesc}{PyObject*}{PySequence_GetSlice}{PyObject *o, int i1, int i2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001948Return the slice of sequence object \var{o} between \var{i1} and
1949\var{i2}, or \NULL{} on failure. This is the equivalent of the Python
1950expression \samp{\var{o}[\var{i1}:\var{i2}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001951\end{cfuncdesc}
1952
1953
1954\begin{cfuncdesc}{int}{PySequence_SetItem}{PyObject *o, int i, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00001955Assign object \var{v} to the \var{i}th element of \var{o}.
1956Returns \code{-1} on failure. This is the equivalent of the Python
1957statement \samp{\var{o}[\var{i}] = \var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001958\end{cfuncdesc}
1959
1960\begin{cfuncdesc}{int}{PySequence_DelItem}{PyObject *o, int i}
Fred Drake5566c1c2001-01-19 22:48:33 +00001961Delete the \var{i}th element of object \var{o}. Returns
Fred Drakee058b4f1998-02-16 06:15:35 +00001962\code{-1} on failure. This is the equivalent of the Python
1963statement \samp{del \var{o}[\var{i}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001964\end{cfuncdesc}
1965
Fred Drake659ebfa2000-04-03 15:42:13 +00001966\begin{cfuncdesc}{int}{PySequence_SetSlice}{PyObject *o, int i1,
1967 int i2, PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00001968Assign the sequence object \var{v} to the slice in sequence
1969object \var{o} from \var{i1} to \var{i2}. This is the equivalent of
1970the Python statement \samp{\var{o}[\var{i1}:\var{i2}] = \var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001971\end{cfuncdesc}
1972
1973\begin{cfuncdesc}{int}{PySequence_DelSlice}{PyObject *o, int i1, int i2}
Fred Drakee058b4f1998-02-16 06:15:35 +00001974Delete the slice in sequence object \var{o} from \var{i1} to \var{i2}.
1975Returns \code{-1} on failure. This is the equivalent of the Python
1976statement \samp{del \var{o}[\var{i1}:\var{i2}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001977\end{cfuncdesc}
1978
1979\begin{cfuncdesc}{PyObject*}{PySequence_Tuple}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00001980Returns the \var{o} as a tuple on success, and \NULL{} on failure.
Fred Drake659ebfa2000-04-03 15:42:13 +00001981This is equivalent to the Python expression \samp{tuple(\var{o})}.
1982\bifuncindex{tuple}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001983\end{cfuncdesc}
1984
1985\begin{cfuncdesc}{int}{PySequence_Count}{PyObject *o, PyObject *value}
Fred Drakee058b4f1998-02-16 06:15:35 +00001986Return the number of occurrences of \var{value} in \var{o}, that is,
1987return the number of keys for which \code{\var{o}[\var{key}] ==
1988\var{value}}. On failure, return \code{-1}. This is equivalent to
1989the Python expression \samp{\var{o}.count(\var{value})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001990\end{cfuncdesc}
1991
Fred Drake659ebfa2000-04-03 15:42:13 +00001992\begin{cfuncdesc}{int}{PySequence_Contains}{PyObject *o, PyObject *value}
Fred Drakee058b4f1998-02-16 06:15:35 +00001993Determine if \var{o} contains \var{value}. If an item in \var{o} is
1994equal to \var{value}, return \code{1}, otherwise return \code{0}. On
1995error, return \code{-1}. This is equivalent to the Python expression
1996\samp{\var{value} in \var{o}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00001997\end{cfuncdesc}
1998
1999\begin{cfuncdesc}{int}{PySequence_Index}{PyObject *o, PyObject *value}
Fred Drakee058b4f1998-02-16 06:15:35 +00002000Return the first index \var{i} for which \code{\var{o}[\var{i}] ==
2001\var{value}}. On error, return \code{-1}. This is equivalent to
2002the Python expression \samp{\var{o}.index(\var{value})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002003\end{cfuncdesc}
2004
Fred Drakea8455ab2000-06-16 19:58:42 +00002005\begin{cfuncdesc}{PyObject*}{PySequence_List}{PyObject *o}
2006Return a list object with the same contents as the arbitrary sequence
2007\var{o}. The returned list is guaranteed to be new.
2008\end{cfuncdesc}
2009
2010\begin{cfuncdesc}{PyObject*}{PySequence_Tuple}{PyObject *o}
2011Return a tuple object with the same contents as the arbitrary sequence
2012\var{o}. If \var{o} is a tuple, a new reference will be returned,
2013otherwise a tuple will be constructed with the appropriate contents.
2014\end{cfuncdesc}
2015
Fred Drakef39ed671998-02-26 22:01:23 +00002016
Fred Drake81cccb72000-09-12 15:22:05 +00002017\begin{cfuncdesc}{PyObject*}{PySequence_Fast}{PyObject *o, const char *m}
2018Returns the sequence \var{o} as a tuple, unless it is already a
2019tuple or list, in which case \var{o} is returned. Use
2020\cfunction{PySequence_Fast_GET_ITEM()} to access the members of the
2021result. Returns \NULL{} on failure. If the object is not a sequence,
2022raises \exception{TypeError} with \var{m} as the message text.
2023\end{cfuncdesc}
2024
2025\begin{cfuncdesc}{PyObject*}{PySequence_Fast_GET_ITEM}{PyObject *o, int i}
2026Return the \var{i}th element of \var{o}, assuming that \var{o} was
2027returned by \cfunction{PySequence_Fast()}, and that \var{i} is within
2028bounds. The caller is expected to get the length of the sequence by
Fred Drake96a2a802001-05-29 18:51:41 +00002029calling \cfunction{PySequence_Size()} on \var{o}, since lists and tuples
Fred Drake81cccb72000-09-12 15:22:05 +00002030are guaranteed to always return their true length.
2031\end{cfuncdesc}
2032
2033
Fred Drakeefd146c1999-02-15 15:30:45 +00002034\section{Mapping Protocol \label{mapping}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002035
2036\begin{cfuncdesc}{int}{PyMapping_Check}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00002037Return \code{1} if the object provides mapping protocol, and
2038\code{0} otherwise. This function always succeeds.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002039\end{cfuncdesc}
2040
2041
2042\begin{cfuncdesc}{int}{PyMapping_Length}{PyObject *o}
Fred Drake659ebfa2000-04-03 15:42:13 +00002043Returns the number of keys in object \var{o} on success, and
2044\code{-1} on failure. For objects that do not provide mapping
2045protocol, this is equivalent to the Python expression
2046\samp{len(\var{o})}.\bifuncindex{len}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002047\end{cfuncdesc}
2048
2049
2050\begin{cfuncdesc}{int}{PyMapping_DelItemString}{PyObject *o, char *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00002051Remove the mapping for object \var{key} from the object \var{o}.
2052Return \code{-1} on failure. This is equivalent to
2053the Python statement \samp{del \var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002054\end{cfuncdesc}
2055
2056
2057\begin{cfuncdesc}{int}{PyMapping_DelItem}{PyObject *o, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00002058Remove the mapping for object \var{key} from the object \var{o}.
2059Return \code{-1} on failure. This is equivalent to
2060the Python statement \samp{del \var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002061\end{cfuncdesc}
2062
2063
2064\begin{cfuncdesc}{int}{PyMapping_HasKeyString}{PyObject *o, char *key}
Fred Drake659ebfa2000-04-03 15:42:13 +00002065On success, return \code{1} if the mapping object has the key
2066\var{key} and \code{0} otherwise. This is equivalent to the Python
2067expression \samp{\var{o}.has_key(\var{key})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002068This function always succeeds.
2069\end{cfuncdesc}
2070
2071
2072\begin{cfuncdesc}{int}{PyMapping_HasKey}{PyObject *o, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00002073Return \code{1} if the mapping object has the key \var{key} and
2074\code{0} otherwise. This is equivalent to the Python expression
2075\samp{\var{o}.has_key(\var{key})}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002076This function always succeeds.
2077\end{cfuncdesc}
2078
2079
2080\begin{cfuncdesc}{PyObject*}{PyMapping_Keys}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00002081On success, return a list of the keys in object \var{o}. On
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002082failure, return \NULL{}. This is equivalent to the Python
Fred Drakee058b4f1998-02-16 06:15:35 +00002083expression \samp{\var{o}.keys()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002084\end{cfuncdesc}
2085
2086
2087\begin{cfuncdesc}{PyObject*}{PyMapping_Values}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00002088On success, return a list of the values in object \var{o}. On
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002089failure, return \NULL{}. This is equivalent to the Python
Fred Drakee058b4f1998-02-16 06:15:35 +00002090expression \samp{\var{o}.values()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002091\end{cfuncdesc}
2092
2093
2094\begin{cfuncdesc}{PyObject*}{PyMapping_Items}{PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00002095On success, return a list of the items in object \var{o}, where
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002096each item is a tuple containing a key-value pair. On
2097failure, return \NULL{}. This is equivalent to the Python
Fred Drakee058b4f1998-02-16 06:15:35 +00002098expression \samp{\var{o}.items()}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002099\end{cfuncdesc}
2100
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002101
2102\begin{cfuncdesc}{PyObject*}{PyMapping_GetItemString}{PyObject *o, char *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00002103Return element of \var{o} corresponding to the object \var{key} or
2104\NULL{} on failure. This is the equivalent of the Python expression
2105\samp{\var{o}[\var{key}]}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002106\end{cfuncdesc}
2107
Fred Drakedbcaeda2001-05-07 17:42:18 +00002108\begin{cfuncdesc}{int}{PyMapping_SetItemString}{PyObject *o, char *key,
2109 PyObject *v}
Fred Drakee058b4f1998-02-16 06:15:35 +00002110Map the object \var{key} to the value \var{v} in object \var{o}.
2111Returns \code{-1} on failure. This is the equivalent of the Python
2112statement \samp{\var{o}[\var{key}] = \var{v}}.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002113\end{cfuncdesc}
2114
2115
Fred Drakedbcaeda2001-05-07 17:42:18 +00002116\section{Iterator Protocol \label{iterator}}
2117
Fred Drakea8e08272001-05-07 17:47:07 +00002118\versionadded{2.2}
2119
Fred Drakedbcaeda2001-05-07 17:42:18 +00002120There are only a couple of functions specifically for working with
2121iterators.
2122
2123\begin{cfuncdesc}{int}{PyIter_Check}{PyObject *o}
2124 Return true if the object \var{o} supports the iterator protocol.
2125\end{cfuncdesc}
2126
2127\begin{cfuncdesc}{PyObject*}{PyIter_Next}{PyObject *o}
2128 Return the next value from the iteration \var{o}. If the object is
2129 an iterator, this retrieves the next value from the iteration, and
2130 returns \NULL{} with no exception set if there are no remaining
2131 items. If the object is not an iterator, \exception{TypeError} is
2132 raised, or if there is an error in retrieving the item, returns
2133 \NULL{} and passes along the exception.
2134\end{cfuncdesc}
2135
2136To write a loop which iterates over an iterator, the C code should
2137look something like this:
2138
2139\begin{verbatim}
2140PyObject *iterator = ...;
2141PyObject *item;
2142
2143while (item = PyIter_Next(iter)) {
2144 /* do something with item */
2145}
2146if (PyErr_Occurred()) {
2147 /* propogate error */
2148}
2149else {
2150 /* continue doing useful work */
2151}
2152\end{verbatim}
2153
2154
Fred Drakeefd146c1999-02-15 15:30:45 +00002155\chapter{Concrete Objects Layer \label{concrete}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002156
2157The functions in this chapter are specific to certain Python object
2158types. Passing them an object of the wrong type is not a good idea;
2159if you receive an object from a Python program and you are not sure
2160that it has the right type, you must perform a type check first;
Fred Drake5566c1c2001-01-19 22:48:33 +00002161for example, to check that an object is a dictionary, use
Fred Drakee5bf8b21998-02-12 21:22:28 +00002162\cfunction{PyDict_Check()}. The chapter is structured like the
2163``family tree'' of Python object types.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002164
Fred Drake89024422000-10-23 16:00:54 +00002165\strong{Warning:}
2166While the functions described in this chapter carefully check the type
2167of the objects which are passed in, many of them do not check for
2168\NULL{} being passed instead of a valid object. Allowing \NULL{} to
2169be passed in can cause memory access violations and immediate
2170termination of the interpreter.
2171
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002172
Fred Drakeefd146c1999-02-15 15:30:45 +00002173\section{Fundamental Objects \label{fundamental}}
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002174
Fred Drakee5bf8b21998-02-12 21:22:28 +00002175This section describes Python type objects and the singleton object
2176\code{None}.
2177
2178
Fred Drakeefd146c1999-02-15 15:30:45 +00002179\subsection{Type Objects \label{typeObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002180
Fred Drake659ebfa2000-04-03 15:42:13 +00002181\obindex{type}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002182\begin{ctypedesc}{PyTypeObject}
Fred Drake659ebfa2000-04-03 15:42:13 +00002183The C structure of the objects used to describe built-in types.
Fred Drakee5bf8b21998-02-12 21:22:28 +00002184\end{ctypedesc}
2185
Fred Drake659ebfa2000-04-03 15:42:13 +00002186\begin{cvardesc}{PyObject*}{PyType_Type}
Fred Drakeefd146c1999-02-15 15:30:45 +00002187This is the type object for type objects; it is the same object as
2188\code{types.TypeType} in the Python layer.
Fred Drake659ebfa2000-04-03 15:42:13 +00002189\withsubitem{(in module types)}{\ttindex{TypeType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002190\end{cvardesc}
2191
Fred Drake659ebfa2000-04-03 15:42:13 +00002192\begin{cfuncdesc}{int}{PyType_Check}{PyObject *o}
2193Returns true is the object \var{o} is a type object.
2194\end{cfuncdesc}
2195
2196\begin{cfuncdesc}{int}{PyType_HasFeature}{PyObject *o, int feature}
2197Returns true if the type object \var{o} sets the feature
Fred Drakef0e08ef2001-02-03 01:11:26 +00002198\var{feature}. Type features are denoted by single bit flags.
Fred Drake659ebfa2000-04-03 15:42:13 +00002199\end{cfuncdesc}
2200
Fred Drakee5bf8b21998-02-12 21:22:28 +00002201
Fred Drakeefd146c1999-02-15 15:30:45 +00002202\subsection{The None Object \label{noneObject}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002203
Fred Drake659ebfa2000-04-03 15:42:13 +00002204\obindex{None@\texttt{None}}
2205Note that the \ctype{PyTypeObject} for \code{None} is not directly
2206exposed in the Python/C API. Since \code{None} is a singleton,
2207testing for object identity (using \samp{==} in C) is sufficient.
2208There is no \cfunction{PyNone_Check()} function for the same reason.
2209
2210\begin{cvardesc}{PyObject*}{Py_None}
Guido van Rossum44475131998-04-21 15:30:01 +00002211The Python \code{None} object, denoting lack of value. This object has
2212no methods.
Fred Drakee5bf8b21998-02-12 21:22:28 +00002213\end{cvardesc}
2214
2215
Fred Drakeefd146c1999-02-15 15:30:45 +00002216\section{Sequence Objects \label{sequenceObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002217
Fred Drake659ebfa2000-04-03 15:42:13 +00002218\obindex{sequence}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002219Generic operations on sequence objects were discussed in the previous
2220chapter; this section deals with the specific kinds of sequence
2221objects that are intrinsic to the Python language.
2222
2223
Fred Drakeefd146c1999-02-15 15:30:45 +00002224\subsection{String Objects \label{stringObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002225
Fred Drake89024422000-10-23 16:00:54 +00002226These functions raise \exception{TypeError} when expecting a string
2227parameter and are called with a non-string parameter.
2228
Fred Drake659ebfa2000-04-03 15:42:13 +00002229\obindex{string}
Fred Drakee5bf8b21998-02-12 21:22:28 +00002230\begin{ctypedesc}{PyStringObject}
Fred Drakef8830d11998-04-23 14:06:01 +00002231This subtype of \ctype{PyObject} represents a Python string object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00002232\end{ctypedesc}
2233
2234\begin{cvardesc}{PyTypeObject}{PyString_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00002235This instance of \ctype{PyTypeObject} represents the Python string
2236type; it is the same object as \code{types.TypeType} in the Python
2237layer.\withsubitem{(in module types)}{\ttindex{StringType}}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00002238\end{cvardesc}
2239
2240\begin{cfuncdesc}{int}{PyString_Check}{PyObject *o}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00002241Returns true if the object \var{o} is a string object.
Guido van Rossum9231c8f1997-05-15 21:43:21 +00002242\end{cfuncdesc}
2243
Fred Drakec6fa34e1998-04-02 06:47:24 +00002244\begin{cfuncdesc}{PyObject*}{PyString_FromString}{const char *v}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00002245Returns a new string object with the value \var{v} on success, and
2246\NULL{} on failure.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002247\end{cfuncdesc}
2248
Fred Drake659ebfa2000-04-03 15:42:13 +00002249\begin{cfuncdesc}{PyObject*}{PyString_FromStringAndSize}{const char *v,
2250 int len}
2251Returns a new string object with the value \var{v} and length
2252\var{len} on success, and \NULL{} on failure. If \var{v} is \NULL{},
2253the contents of the string are uninitialized.
2254\end{cfuncdesc}
2255
Fred Drakec6fa34e1998-04-02 06:47:24 +00002256\begin{cfuncdesc}{int}{PyString_Size}{PyObject *string}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00002257Returns the length of the string in string object \var{string}.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002258\end{cfuncdesc}
2259
Fred Drake659ebfa2000-04-03 15:42:13 +00002260\begin{cfuncdesc}{int}{PyString_GET_SIZE}{PyObject *string}
Fred Drake5d644212000-10-07 12:31:50 +00002261Macro form of \cfunction{PyString_Size()} but without error
Fred Drake659ebfa2000-04-03 15:42:13 +00002262checking.
2263\end{cfuncdesc}
2264
Fred Drakec6fa34e1998-04-02 06:47:24 +00002265\begin{cfuncdesc}{char*}{PyString_AsString}{PyObject *string}
Fred Drake659ebfa2000-04-03 15:42:13 +00002266Returns a null-terminated representation of the contents of
2267\var{string}. The pointer refers to the internal buffer of
Fred Drake89024422000-10-23 16:00:54 +00002268\var{string}, not a copy. The data must not be modified in any way,
2269unless the string was just created using
2270\code{PyString_FromStringAndSize(NULL, \var{size})}.
2271It must not be deallocated.
Fred Drake659ebfa2000-04-03 15:42:13 +00002272\end{cfuncdesc}
2273
2274\begin{cfuncdesc}{char*}{PyString_AS_STRING}{PyObject *string}
2275Macro form of \cfunction{PyString_AsString()} but without error
2276checking.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002277\end{cfuncdesc}
2278
Marc-André Lemburgd1ba4432000-09-19 21:04:18 +00002279\begin{cfuncdesc}{int}{PyString_AsStringAndSize}{PyObject *obj,
2280 char **buffer,
2281 int *length}
2282Returns a null-terminated representation of the contents of the object
2283\var{obj} through the output variables \var{buffer} and \var{length}.
2284
2285The function accepts both string and Unicode objects as input. For
2286Unicode objects it returns the default encoded version of the object.
2287If \var{length} is set to \NULL{}, the resulting buffer may not contain
2288null characters; if it does, the function returns -1 and a
2289TypeError is raised.
2290
2291The buffer refers to an internal string buffer of \var{obj}, not a
Fred Drake89024422000-10-23 16:00:54 +00002292copy. The data must not be modified in any way, unless the string was
2293just created using \code{PyString_FromStringAndSize(NULL,
2294\var{size})}. It must not be deallocated.
Marc-André Lemburgd1ba4432000-09-19 21:04:18 +00002295\end{cfuncdesc}
2296
Fred Drakec6fa34e1998-04-02 06:47:24 +00002297\begin{cfuncdesc}{void}{PyString_Concat}{PyObject **string,
2298 PyObject *newpart}
Fred Drake66b989c1999-02-15 20:15:39 +00002299Creates a new string object in \var{*string} containing the
Fred Drakeddc6c272000-03-31 18:22:38 +00002300contents of \var{newpart} appended to \var{string}; the caller will
2301own the new reference. The reference to the old value of \var{string}
2302will be stolen. If the new string
Fred Drake66b989c1999-02-15 20:15:39 +00002303cannot be created, the old reference to \var{string} will still be
2304discarded and the value of \var{*string} will be set to
2305\NULL{}; the appropriate exception will be set.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002306\end{cfuncdesc}
2307
2308\begin{cfuncdesc}{void}{PyString_ConcatAndDel}{PyObject **string,
2309 PyObject *newpart}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00002310Creates a new string object in \var{*string} containing the contents
Guido van Rossum44475131998-04-21 15:30:01 +00002311of \var{newpart} appended to \var{string}. This version decrements
2312the reference count of \var{newpart}.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002313\end{cfuncdesc}
2314
2315\begin{cfuncdesc}{int}{_PyString_Resize}{PyObject **string, int newsize}
Guido van Rossum44475131998-04-21 15:30:01 +00002316A way to resize a string object even though it is ``immutable''.
2317Only use this to build up a brand new string object; don't use this if
2318the string may already be known in other parts of the code.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002319\end{cfuncdesc}
2320
2321\begin{cfuncdesc}{PyObject*}{PyString_Format}{PyObject *format,
2322 PyObject *args}
Guido van Rossum44475131998-04-21 15:30:01 +00002323Returns a new string object from \var{format} and \var{args}. Analogous
Fred Drake659ebfa2000-04-03 15:42:13 +00002324to \code{\var{format} \%\ \var{args}}. The \var{args} argument must be
Guido van Rossum44475131998-04-21 15:30:01 +00002325a tuple.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002326\end{cfuncdesc}
2327
2328\begin{cfuncdesc}{void}{PyString_InternInPlace}{PyObject **string}
Guido van Rossum44475131998-04-21 15:30:01 +00002329Intern the argument \var{*string} in place. The argument must be the
2330address of a pointer variable pointing to a Python string object.
2331If there is an existing interned string that is the same as
2332\var{*string}, it sets \var{*string} to it (decrementing the reference
2333count of the old string object and incrementing the reference count of
2334the interned string object), otherwise it leaves \var{*string} alone
2335and interns it (incrementing its reference count). (Clarification:
2336even though there is a lot of talk about reference counts, think of
Fred Drakef8830d11998-04-23 14:06:01 +00002337this function as reference-count-neutral; you own the object after
2338the call if and only if you owned it before the call.)
Fred Drakec6fa34e1998-04-02 06:47:24 +00002339\end{cfuncdesc}
2340
2341\begin{cfuncdesc}{PyObject*}{PyString_InternFromString}{const char *v}
Fred Drakef8830d11998-04-23 14:06:01 +00002342A combination of \cfunction{PyString_FromString()} and
2343\cfunction{PyString_InternInPlace()}, returning either a new string object
Guido van Rossum44475131998-04-21 15:30:01 +00002344that has been interned, or a new (``owned'') reference to an earlier
2345interned string object with the same value.
Fred Drakec6fa34e1998-04-02 06:47:24 +00002346\end{cfuncdesc}
2347
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002348\begin{cfuncdesc}{PyObject*}{PyString_Decode}{const char *s,
2349 int size,
2350 const char *encoding,
2351 const char *errors}
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002352Creates an object by decoding \var{size} bytes of the encoded
2353buffer \var{s} using the codec registered
2354for \var{encoding}. \var{encoding} and \var{errors} have the same meaning
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002355as the parameters of the same name in the unicode() builtin
2356function. The codec to be used is looked up using the Python codec
2357registry. Returns \NULL{} in case an exception was raised by the
2358codec.
2359\end{cfuncdesc}
2360
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002361\begin{cfuncdesc}{PyObject*}{PyString_AsDecodedObject}{PyObject *str,
2362 const char *encoding,
2363 const char *errors}
2364Decodes a string object by passing it to the codec registered
2365for \var{encoding} and returns the result as Python
2366object. \var{encoding} and \var{errors} have the same meaning as the
2367parameters of the same name in the string .encode() method. The codec
2368to be used is looked up using the Python codec registry. Returns
2369\NULL{} in case an exception was raised by the codec.
2370\end{cfuncdesc}
2371
2372\begin{cfuncdesc}{PyObject*}{PyString_Encode}{const char *s,
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002373 int size,
2374 const char *encoding,
2375 const char *errors}
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002376Encodes the \ctype{char} buffer of the given size by passing it to
2377the codec registered for \var{encoding} and returns a Python object.
2378\var{encoding} and \var{errors} have the same
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002379meaning as the parameters of the same name in the string .encode()
2380method. The codec to be used is looked up using the Python codec
2381registry. Returns \NULL{} in case an exception was raised by the
2382codec.
2383\end{cfuncdesc}
2384
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002385\begin{cfuncdesc}{PyObject*}{PyString_AsEncodedObject}{PyObject *str,
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002386 const char *encoding,
2387 const char *errors}
Marc-André Lemburg2d920412001-05-15 12:00:02 +00002388Encodes a string object using the codec registered
2389for \var{encoding} and returns the result as Python
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002390object. \var{encoding} and \var{errors} have the same meaning as the
2391parameters of the same name in the string .encode() method. The codec
2392to be used is looked up using the Python codec registry. Returns
2393\NULL{} in case an exception was raised by the codec.
2394\end{cfuncdesc}
2395
Fred Drakee5bf8b21998-02-12 21:22:28 +00002396
Fred Drakea4cd2612000-04-06 14:10:29 +00002397\subsection{Unicode Objects \label{unicodeObjects}}
2398\sectionauthor{Marc-Andre Lemburg}{mal@lemburg.com}
2399
2400%--- Unicode Type -------------------------------------------------------
2401
2402These are the basic Unicode object types used for the Unicode
2403implementation in Python:
2404
2405\begin{ctypedesc}{Py_UNICODE}
2406This type represents a 16-bit unsigned storage type which is used by
2407Python internally as basis for holding Unicode ordinals. On platforms
2408where \ctype{wchar_t} is available and also has 16-bits,
2409\ctype{Py_UNICODE} is a typedef alias for \ctype{wchar_t} to enhance
2410native platform compatibility. On all other platforms,
2411\ctype{Py_UNICODE} is a typedef alias for \ctype{unsigned short}.
2412\end{ctypedesc}
2413
2414\begin{ctypedesc}{PyUnicodeObject}
2415This subtype of \ctype{PyObject} represents a Python Unicode object.
2416\end{ctypedesc}
2417
2418\begin{cvardesc}{PyTypeObject}{PyUnicode_Type}
2419This instance of \ctype{PyTypeObject} represents the Python Unicode type.
2420\end{cvardesc}
2421
2422%--- These are really C macros... is there a macrodesc TeX macro ?
2423
2424The following APIs are really C macros and can be used to do fast
2425checks and to access internal read-only data of Unicode objects:
2426
2427\begin{cfuncdesc}{int}{PyUnicode_Check}{PyObject *o}
2428Returns true if the object \var{o} is a Unicode object.
2429\end{cfuncdesc}
2430
2431\begin{cfuncdesc}{int}{PyUnicode_GET_SIZE}{PyObject *o}
2432Returns the size of the object. o has to be a
2433PyUnicodeObject (not checked).
2434\end{cfuncdesc}
2435
2436\begin{cfuncdesc}{int}{PyUnicode_GET_DATA_SIZE}{PyObject *o}
2437Returns the size of the object's internal buffer in bytes. o has to be
2438a PyUnicodeObject (not checked).
2439\end{cfuncdesc}
2440
Fred Drake992fe5a2000-06-16 21:04:15 +00002441\begin{cfuncdesc}{Py_UNICODE*}{PyUnicode_AS_UNICODE}{PyObject *o}
Fred Drakea4cd2612000-04-06 14:10:29 +00002442Returns a pointer to the internal Py_UNICODE buffer of the object. o
2443has to be a PyUnicodeObject (not checked).
2444\end{cfuncdesc}
2445
Fred Drake992fe5a2000-06-16 21:04:15 +00002446\begin{cfuncdesc}{const char*}{PyUnicode_AS_DATA}{PyObject *o}
Fred Drakea4cd2612000-04-06 14:10:29 +00002447Returns a (const char *) pointer to the internal buffer of the object.
2448o has to be a PyUnicodeObject (not checked).
2449\end{cfuncdesc}
2450
2451% --- Unicode character properties ---------------------------------------
2452
2453Unicode provides many different character properties. The most often
2454needed ones are available through these macros which are mapped to C
2455functions depending on the Python configuration.
2456
2457\begin{cfuncdesc}{int}{Py_UNICODE_ISSPACE}{Py_UNICODE ch}
2458Returns 1/0 depending on whether \var{ch} is a whitespace character.
2459\end{cfuncdesc}
2460
2461\begin{cfuncdesc}{int}{Py_UNICODE_ISLOWER}{Py_UNICODE ch}
2462Returns 1/0 depending on whether \var{ch} is a lowercase character.
2463\end{cfuncdesc}
2464
2465\begin{cfuncdesc}{int}{Py_UNICODE_ISUPPER}{Py_UNICODE ch}
Fred Drakeae96aab2000-07-03 13:38:10 +00002466Returns 1/0 depending on whether \var{ch} is an uppercase character.
Fred Drakea4cd2612000-04-06 14:10:29 +00002467\end{cfuncdesc}
2468
2469\begin{cfuncdesc}{int}{Py_UNICODE_ISTITLE}{Py_UNICODE ch}
2470Returns 1/0 depending on whether \var{ch} is a titlecase character.
2471\end{cfuncdesc}
2472
2473\begin{cfuncdesc}{int}{Py_UNICODE_ISLINEBREAK}{Py_UNICODE ch}
2474Returns 1/0 depending on whether \var{ch} is a linebreak character.
2475\end{cfuncdesc}
2476
2477\begin{cfuncdesc}{int}{Py_UNICODE_ISDECIMAL}{Py_UNICODE ch}
2478Returns 1/0 depending on whether \var{ch} is a decimal character.
2479\end{cfuncdesc}
2480
2481\begin{cfuncdesc}{int}{Py_UNICODE_ISDIGIT}{Py_UNICODE ch}
2482Returns 1/0 depending on whether \var{ch} is a digit character.
2483\end{cfuncdesc}
2484
2485\begin{cfuncdesc}{int}{Py_UNICODE_ISNUMERIC}{Py_UNICODE ch}
2486Returns 1/0 depending on whether \var{ch} is a numeric character.
2487\end{cfuncdesc}
2488
Fred Drakeae96aab2000-07-03 13:38:10 +00002489\begin{cfuncdesc}{int}{Py_UNICODE_ISALPHA}{Py_UNICODE ch}
2490Returns 1/0 depending on whether \var{ch} is an alphabetic character.
2491\end{cfuncdesc}
2492
2493\begin{cfuncdesc}{int}{Py_UNICODE_ISALNUM}{Py_UNICODE ch}
2494Returns 1/0 depending on whether \var{ch} is an alphanumeric character.
2495\end{cfuncdesc}
2496
Fred Drakea4cd2612000-04-06 14:10:29 +00002497These APIs can be used for fast direct character conversions:
2498
2499\begin{cfuncdesc}{Py_UNICODE}{Py_UNICODE_TOLOWER}{Py_UNICODE ch}
2500Returns the character \var{ch} converted to lower case.
2501\end{cfuncdesc}
2502
2503\begin{cfuncdesc}{Py_UNICODE}{Py_UNICODE_TOUPPER}{Py_UNICODE ch}
2504Returns the character \var{ch} converted to upper case.
2505\end{cfuncdesc}
2506
2507\begin{cfuncdesc}{Py_UNICODE}{Py_UNICODE_TOTITLE}{Py_UNICODE ch}
2508Returns the character \var{ch} converted to title case.
2509\end{cfuncdesc}
2510
2511\begin{cfuncdesc}{int}{Py_UNICODE_TODECIMAL}{Py_UNICODE ch}
2512Returns the character \var{ch} converted to a decimal positive integer.
2513Returns -1 in case this is not possible. Does not raise exceptions.
2514\end{cfuncdesc}
2515
2516\begin{cfuncdesc}{int}{Py_UNICODE_TODIGIT}{Py_UNICODE ch}
2517Returns the character \var{ch} converted to a single digit integer.
2518Returns -1 in case this is not possible. Does not raise exceptions.
2519\end{cfuncdesc}
2520
2521\begin{cfuncdesc}{double}{Py_UNICODE_TONUMERIC}{Py_UNICODE ch}
2522Returns the character \var{ch} converted to a (positive) double.
2523Returns -1.0 in case this is not possible. Does not raise exceptions.
2524\end{cfuncdesc}
2525
2526% --- Plain Py_UNICODE ---------------------------------------------------
2527
2528To create Unicode objects and access their basic sequence properties,
2529use these APIs:
2530
2531\begin{cfuncdesc}{PyObject*}{PyUnicode_FromUnicode}{const Py_UNICODE *u,
2532 int size}
2533
2534Create a Unicode Object from the Py_UNICODE buffer \var{u} of the
2535given size. \var{u} may be \NULL{} which causes the contents to be
2536undefined. It is the user's responsibility to fill in the needed data.
Marc-André Lemburg8155e0e2001-04-23 14:44:21 +00002537The buffer is copied into the new object. If the buffer is not \NULL{},
2538the return value might be a shared object. Therefore, modification of
2539the resulting Unicode Object is only allowed when \var{u} is \NULL{}.
Fred Drakea4cd2612000-04-06 14:10:29 +00002540\end{cfuncdesc}
2541
Fred Drake1d158692000-06-18 05:21:21 +00002542\begin{cfuncdesc}{Py_UNICODE*}{PyUnicode_AsUnicode}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00002543Return a read-only pointer to the Unicode object's internal
2544\ctype{Py_UNICODE} buffer.
2545\end{cfuncdesc}
2546
2547\begin{cfuncdesc}{int}{PyUnicode_GetSize}{PyObject *unicode}
2548Return the length of the Unicode object.
2549\end{cfuncdesc}
2550
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002551\begin{cfuncdesc}{PyObject*}{PyUnicode_FromEncodedObject}{PyObject *obj,
2552 const char *encoding,
2553 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002554
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002555Coerce an encoded object obj to an Unicode object and return a
2556reference with incremented refcount.
Fred Drakea4cd2612000-04-06 14:10:29 +00002557
2558Coercion is done in the following way:
2559\begin{enumerate}
2560\item Unicode objects are passed back as-is with incremented
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002561 refcount. Note: these cannot be decoded; passing a non-NULL
2562 value for encoding will result in a TypeError.
Fred Drakea4cd2612000-04-06 14:10:29 +00002563
2564\item String and other char buffer compatible objects are decoded
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002565 according to the given encoding and using the error handling
2566 defined by errors. Both can be NULL to have the interface use
2567 the default values (see the next section for details).
Fred Drakea4cd2612000-04-06 14:10:29 +00002568
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002569\item All other objects cause an exception.
Fred Drakea4cd2612000-04-06 14:10:29 +00002570\end{enumerate}
2571The API returns NULL in case of an error. The caller is responsible
2572for decref'ing the returned objects.
2573\end{cfuncdesc}
2574
Marc-André Lemburg5a20b212000-07-07 15:47:06 +00002575\begin{cfuncdesc}{PyObject*}{PyUnicode_FromObject}{PyObject *obj}
2576
2577Shortcut for PyUnicode_FromEncodedObject(obj, NULL, ``strict'')
2578which is used throughout the interpreter whenever coercion to
2579Unicode is needed.
2580\end{cfuncdesc}
2581
Fred Drakea4cd2612000-04-06 14:10:29 +00002582% --- wchar_t support for platforms which support it ---------------------
2583
2584If the platform supports \ctype{wchar_t} and provides a header file
2585wchar.h, Python can interface directly to this type using the
2586following functions. Support is optimized if Python's own
2587\ctype{Py_UNICODE} type is identical to the system's \ctype{wchar_t}.
2588
2589\begin{cfuncdesc}{PyObject*}{PyUnicode_FromWideChar}{const wchar_t *w,
2590 int size}
2591Create a Unicode Object from the \ctype{whcar_t} buffer \var{w} of the
2592given size. Returns \NULL{} on failure.
2593\end{cfuncdesc}
2594
2595\begin{cfuncdesc}{int}{PyUnicode_AsWideChar}{PyUnicodeObject *unicode,
2596 wchar_t *w,
2597 int size}
Fred Drakea4cd2612000-04-06 14:10:29 +00002598Copies the Unicode Object contents into the \ctype{whcar_t} buffer
2599\var{w}. At most \var{size} \ctype{whcar_t} characters are copied.
2600Returns the number of \ctype{whcar_t} characters copied or -1 in case
2601of an error.
2602\end{cfuncdesc}
2603
2604
2605\subsubsection{Builtin Codecs \label{builtinCodecs}}
2606
2607Python provides a set of builtin codecs which are written in C
2608for speed. All of these codecs are directly usable via the
2609following functions.
2610
2611Many of the following APIs take two arguments encoding and
2612errors. These parameters encoding and errors have the same semantics
2613as the ones of the builtin unicode() Unicode object constructor.
2614
2615Setting encoding to NULL causes the default encoding to be used which
2616is UTF-8.
2617
2618Error handling is set by errors which may also be set to NULL meaning
2619to use the default handling defined for the codec. Default error
2620handling for all builtin codecs is ``strict'' (ValueErrors are raised).
2621
2622The codecs all use a similar interface. Only deviation from the
2623following generic ones are documented for simplicity.
2624
2625% --- Generic Codecs -----------------------------------------------------
2626
2627These are the generic codec APIs:
2628
2629\begin{cfuncdesc}{PyObject*}{PyUnicode_Decode}{const char *s,
2630 int size,
2631 const char *encoding,
2632 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002633Create a Unicode object by decoding \var{size} bytes of the encoded
2634string \var{s}. \var{encoding} and \var{errors} have the same meaning
2635as the parameters of the same name in the unicode() builtin
2636function. The codec to be used is looked up using the Python codec
2637registry. Returns \NULL{} in case an exception was raised by the
2638codec.
2639\end{cfuncdesc}
2640
2641\begin{cfuncdesc}{PyObject*}{PyUnicode_Encode}{const Py_UNICODE *s,
2642 int size,
2643 const char *encoding,
2644 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002645Encodes the \ctype{Py_UNICODE} buffer of the given size and returns a
2646Python string object. \var{encoding} and \var{errors} have the same
2647meaning as the parameters of the same name in the Unicode .encode()
2648method. The codec to be used is looked up using the Python codec
2649registry. Returns \NULL{} in case an exception was raised by the
2650codec.
2651\end{cfuncdesc}
2652
2653\begin{cfuncdesc}{PyObject*}{PyUnicode_AsEncodedString}{PyObject *unicode,
2654 const char *encoding,
2655 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002656Encodes a Unicode object and returns the result as Python string
2657object. \var{encoding} and \var{errors} have the same meaning as the
2658parameters of the same name in the Unicode .encode() method. The codec
2659to be used is looked up using the Python codec registry. Returns
2660\NULL{} in case an exception was raised by the codec.
2661\end{cfuncdesc}
2662
2663% --- UTF-8 Codecs -------------------------------------------------------
2664
2665These are the UTF-8 codec APIs:
2666
2667\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeUTF8}{const char *s,
2668 int size,
2669 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002670Creates a Unicode object by decoding \var{size} bytes of the UTF-8
2671encoded string \var{s}. Returns \NULL{} in case an exception was
2672raised by the codec.
2673\end{cfuncdesc}
2674
2675\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeUTF8}{const Py_UNICODE *s,
2676 int size,
2677 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002678Encodes the \ctype{Py_UNICODE} buffer of the given size using UTF-8
2679and returns a Python string object. Returns \NULL{} in case an
2680exception was raised by the codec.
2681\end{cfuncdesc}
2682
2683\begin{cfuncdesc}{PyObject*}{PyUnicode_AsUTF8String}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00002684Encodes a Unicode objects using UTF-8 and returns the result as Python
2685string object. Error handling is ``strict''. Returns
2686\NULL{} in case an exception was raised by the codec.
2687\end{cfuncdesc}
2688
2689% --- UTF-16 Codecs ------------------------------------------------------ */
2690
2691These are the UTF-16 codec APIs:
2692
2693\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeUTF16}{const char *s,
2694 int size,
2695 const char *errors,
2696 int *byteorder}
Fred Drakea4cd2612000-04-06 14:10:29 +00002697Decodes \var{length} bytes from a UTF-16 encoded buffer string and
2698returns the corresponding Unicode object.
2699
2700\var{errors} (if non-NULL) defines the error handling. It defaults
2701to ``strict''.
2702
2703If \var{byteorder} is non-\NULL{}, the decoder starts decoding using
2704the given byte order:
2705
2706\begin{verbatim}
2707 *byteorder == -1: little endian
2708 *byteorder == 0: native order
2709 *byteorder == 1: big endian
2710\end{verbatim}
2711
2712and then switches according to all byte order marks (BOM) it finds in
2713the input data. BOM marks are not copied into the resulting Unicode
2714string. After completion, \var{*byteorder} is set to the current byte
2715order at the end of input data.
2716
2717If \var{byteorder} is \NULL{}, the codec starts in native order mode.
2718
2719Returns \NULL{} in case an exception was raised by the codec.
2720\end{cfuncdesc}
2721
2722\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeUTF16}{const Py_UNICODE *s,
2723 int size,
2724 const char *errors,
2725 int byteorder}
Fred Drakea4cd2612000-04-06 14:10:29 +00002726Returns a Python string object holding the UTF-16 encoded value of the
2727Unicode data in \var{s}.
2728
Fred Drakea8455ab2000-06-16 19:58:42 +00002729If \var{byteorder} is not \code{0}, output is written according to the
Fred Drakea4cd2612000-04-06 14:10:29 +00002730following byte order:
2731
2732\begin{verbatim}
2733 byteorder == -1: little endian
2734 byteorder == 0: native byte order (writes a BOM mark)
2735 byteorder == 1: big endian
2736\end{verbatim}
2737
Fred Drakea8455ab2000-06-16 19:58:42 +00002738If byteorder is \code{0}, the output string will always start with the
Fred Drakea4cd2612000-04-06 14:10:29 +00002739Unicode BOM mark (U+FEFF). In the other two modes, no BOM mark is
2740prepended.
2741
2742Note that \ctype{Py_UNICODE} data is being interpreted as UTF-16
2743reduced to UCS-2. This trick makes it possible to add full UTF-16
2744capabilities at a later point without comprimising the APIs.
2745
2746Returns \NULL{} in case an exception was raised by the codec.
2747\end{cfuncdesc}
2748
2749\begin{cfuncdesc}{PyObject*}{PyUnicode_AsUTF16String}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00002750Returns a Python string using the UTF-16 encoding in native byte
2751order. The string always starts with a BOM mark. Error handling is
2752``strict''. Returns \NULL{} in case an exception was raised by the
2753codec.
2754\end{cfuncdesc}
2755
2756% --- Unicode-Escape Codecs ----------------------------------------------
2757
2758These are the ``Unicode Esacpe'' codec APIs:
2759
2760\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeUnicodeEscape}{const char *s,
2761 int size,
2762 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002763Creates a Unicode object by decoding \var{size} bytes of the Unicode-Esacpe
2764encoded string \var{s}. Returns \NULL{} in case an exception was
2765raised by the codec.
2766\end{cfuncdesc}
2767
2768\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeUnicodeEscape}{const Py_UNICODE *s,
2769 int size,
2770 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002771Encodes the \ctype{Py_UNICODE} buffer of the given size using Unicode-Escape
2772and returns a Python string object. Returns \NULL{} in case an
2773exception was raised by the codec.
2774\end{cfuncdesc}
2775
2776\begin{cfuncdesc}{PyObject*}{PyUnicode_AsUnicodeEscapeString}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00002777Encodes a Unicode objects using Unicode-Escape and returns the result
2778as Python string object. Error handling is ``strict''. Returns
2779\NULL{} in case an exception was raised by the codec.
2780\end{cfuncdesc}
2781
2782% --- Raw-Unicode-Escape Codecs ------------------------------------------
2783
2784These are the ``Raw Unicode Esacpe'' codec APIs:
2785
2786\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeRawUnicodeEscape}{const char *s,
2787 int size,
2788 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002789Creates a Unicode object by decoding \var{size} bytes of the Raw-Unicode-Esacpe
2790encoded string \var{s}. Returns \NULL{} in case an exception was
2791raised by the codec.
2792\end{cfuncdesc}
2793
2794\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeRawUnicodeEscape}{const Py_UNICODE *s,
2795 int size,
2796 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002797Encodes the \ctype{Py_UNICODE} buffer of the given size using Raw-Unicode-Escape
2798and returns a Python string object. Returns \NULL{} in case an
2799exception was raised by the codec.
2800\end{cfuncdesc}
2801
2802\begin{cfuncdesc}{PyObject*}{PyUnicode_AsRawUnicodeEscapeString}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00002803Encodes a Unicode objects using Raw-Unicode-Escape and returns the result
2804as Python string object. Error handling is ``strict''. Returns
2805\NULL{} in case an exception was raised by the codec.
2806\end{cfuncdesc}
2807
2808% --- Latin-1 Codecs -----------------------------------------------------
2809
2810These are the Latin-1 codec APIs:
2811
2812Latin-1 corresponds to the first 256 Unicode ordinals and only these
2813are accepted by the codecs during encoding.
2814
2815\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeLatin1}{const char *s,
Fred Drake1d158692000-06-18 05:21:21 +00002816 int size,
2817 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002818Creates a Unicode object by decoding \var{size} bytes of the Latin-1
2819encoded string \var{s}. Returns \NULL{} in case an exception was
2820raised by the codec.
2821\end{cfuncdesc}
2822
2823\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeLatin1}{const Py_UNICODE *s,
Fred Drake1d158692000-06-18 05:21:21 +00002824 int size,
2825 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002826Encodes the \ctype{Py_UNICODE} buffer of the given size using Latin-1
2827and returns a Python string object. Returns \NULL{} in case an
2828exception was raised by the codec.
2829\end{cfuncdesc}
2830
2831\begin{cfuncdesc}{PyObject*}{PyUnicode_AsLatin1String}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00002832Encodes a Unicode objects using Latin-1 and returns the result as
2833Python string object. Error handling is ``strict''. Returns
2834\NULL{} in case an exception was raised by the codec.
2835\end{cfuncdesc}
2836
2837% --- ASCII Codecs -------------------------------------------------------
2838
Fred Drake1d158692000-06-18 05:21:21 +00002839These are the \ASCII{} codec APIs. Only 7-bit \ASCII{} data is
2840accepted. All other codes generate errors.
Fred Drakea4cd2612000-04-06 14:10:29 +00002841
2842\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeASCII}{const char *s,
Fred Drake1d158692000-06-18 05:21:21 +00002843 int size,
2844 const char *errors}
2845Creates a Unicode object by decoding \var{size} bytes of the
2846\ASCII{} encoded string \var{s}. Returns \NULL{} in case an exception
2847was raised by the codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00002848\end{cfuncdesc}
2849
2850\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeASCII}{const Py_UNICODE *s,
Fred Drake1d158692000-06-18 05:21:21 +00002851 int size,
2852 const char *errors}
2853Encodes the \ctype{Py_UNICODE} buffer of the given size using
2854\ASCII{} and returns a Python string object. Returns \NULL{} in case
2855an exception was raised by the codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00002856\end{cfuncdesc}
2857
2858\begin{cfuncdesc}{PyObject*}{PyUnicode_AsASCIIString}{PyObject *unicode}
Fred Drake1d158692000-06-18 05:21:21 +00002859Encodes a Unicode objects using \ASCII{} and returns the result as Python
Fred Drakea4cd2612000-04-06 14:10:29 +00002860string object. Error handling is ``strict''. Returns
2861\NULL{} in case an exception was raised by the codec.
2862\end{cfuncdesc}
2863
2864% --- Character Map Codecs -----------------------------------------------
2865
2866These are the mapping codec APIs:
2867
2868This codec is special in that it can be used to implement many
2869different codecs (and this is in fact what was done to obtain most of
2870the standard codecs included in the \module{encodings} package). The
2871codec uses mapping to encode and decode characters.
2872
2873Decoding mappings must map single string characters to single Unicode
2874characters, integers (which are then interpreted as Unicode ordinals)
2875or None (meaning "undefined mapping" and causing an error).
2876
2877Encoding mappings must map single Unicode characters to single string
2878characters, integers (which are then interpreted as Latin-1 ordinals)
2879or None (meaning "undefined mapping" and causing an error).
2880
2881The mapping objects provided must only support the __getitem__ mapping
2882interface.
2883
2884If a character lookup fails with a LookupError, the character is
2885copied as-is meaning that its ordinal value will be interpreted as
2886Unicode or Latin-1 ordinal resp. Because of this, mappings only need
2887to contain those mappings which map characters to different code
2888points.
2889
2890\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeCharmap}{const char *s,
2891 int size,
2892 PyObject *mapping,
2893 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002894Creates a Unicode object by decoding \var{size} bytes of the encoded
2895string \var{s} using the given \var{mapping} object. Returns \NULL{}
2896in case an exception was raised by the codec.
2897\end{cfuncdesc}
2898
2899\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeCharmap}{const Py_UNICODE *s,
2900 int size,
2901 PyObject *mapping,
2902 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002903Encodes the \ctype{Py_UNICODE} buffer of the given size using the
2904given \var{mapping} object and returns a Python string object.
2905Returns \NULL{} in case an exception was raised by the codec.
2906\end{cfuncdesc}
2907
2908\begin{cfuncdesc}{PyObject*}{PyUnicode_AsCharmapString}{PyObject *unicode,
2909 PyObject *mapping}
Fred Drakea4cd2612000-04-06 14:10:29 +00002910Encodes a Unicode objects using the given \var{mapping} object and
2911returns the result as Python string object. Error handling is
2912``strict''. Returns \NULL{} in case an exception was raised by the
2913codec.
2914\end{cfuncdesc}
2915
2916The following codec API is special in that maps Unicode to Unicode.
2917
2918\begin{cfuncdesc}{PyObject*}{PyUnicode_TranslateCharmap}{const Py_UNICODE *s,
2919 int size,
2920 PyObject *table,
2921 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002922Translates a \ctype{Py_UNICODE} buffer of the given length by applying
2923a character mapping \var{table} to it and returns the resulting
Fred Drake1d158692000-06-18 05:21:21 +00002924Unicode object. Returns \NULL{} when an exception was raised by the
2925codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00002926
2927The \var{mapping} table must map Unicode ordinal integers to Unicode
2928ordinal integers or None (causing deletion of the character).
2929
2930Mapping tables must only provide the __getitem__ interface,
2931e.g. dictionaries or sequences. Unmapped character ordinals (ones
2932which cause a LookupError) are left untouched and are copied as-is.
Fred Drakea4cd2612000-04-06 14:10:29 +00002933\end{cfuncdesc}
2934
2935% --- MBCS codecs for Windows --------------------------------------------
2936
Fred Drake1d158692000-06-18 05:21:21 +00002937These are the MBCS codec APIs. They are currently only available on
Fred Drakea4cd2612000-04-06 14:10:29 +00002938Windows and use the Win32 MBCS converters to implement the
Fred Drake1d158692000-06-18 05:21:21 +00002939conversions. Note that MBCS (or DBCS) is a class of encodings, not
2940just one. The target encoding is defined by the user settings on the
2941machine running the codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00002942
2943\begin{cfuncdesc}{PyObject*}{PyUnicode_DecodeMBCS}{const char *s,
2944 int size,
2945 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002946Creates a Unicode object by decoding \var{size} bytes of the MBCS
Fred Drake1d158692000-06-18 05:21:21 +00002947encoded string \var{s}. Returns \NULL{} in case an exception was
Fred Drakea4cd2612000-04-06 14:10:29 +00002948raised by the codec.
2949\end{cfuncdesc}
2950
2951\begin{cfuncdesc}{PyObject*}{PyUnicode_EncodeMBCS}{const Py_UNICODE *s,
2952 int size,
2953 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00002954Encodes the \ctype{Py_UNICODE} buffer of the given size using MBCS
2955and returns a Python string object. Returns \NULL{} in case an
2956exception was raised by the codec.
2957\end{cfuncdesc}
2958
2959\begin{cfuncdesc}{PyObject*}{PyUnicode_AsMBCSString}{PyObject *unicode}
Fred Drakea4cd2612000-04-06 14:10:29 +00002960Encodes a Unicode objects using MBCS and returns the result as Python
Fred Drake1d158692000-06-18 05:21:21 +00002961string object. Error handling is ``strict''. Returns \NULL{} in case
2962an exception was raised by the codec.
Fred Drakea4cd2612000-04-06 14:10:29 +00002963\end{cfuncdesc}
2964
2965% --- Methods & Slots ----------------------------------------------------
2966
2967\subsubsection{Methods and Slot Functions \label{unicodeMethodsAndSlots}}
2968
2969The following APIs are capable of handling Unicode objects and strings
2970on input (we refer to them as strings in the descriptions) and return
2971Unicode objects or integers as apporpriate.
2972
2973They all return \NULL{} or -1 in case an exception occurrs.
2974
2975\begin{cfuncdesc}{PyObject*}{PyUnicode_Concat}{PyObject *left,
2976 PyObject *right}
Fred Drakea4cd2612000-04-06 14:10:29 +00002977Concat two strings giving a new Unicode string.
2978\end{cfuncdesc}
2979
2980\begin{cfuncdesc}{PyObject*}{PyUnicode_Split}{PyObject *s,
2981 PyObject *sep,
2982 int maxsplit}
Fred Drakea4cd2612000-04-06 14:10:29 +00002983Split a string giving a list of Unicode strings.
2984
2985If sep is NULL, splitting will be done at all whitespace
2986substrings. Otherwise, splits occur at the given separator.
2987
2988At most maxsplit splits will be done. If negative, no limit is set.
2989
2990Separators are not included in the resulting list.
2991\end{cfuncdesc}
2992
2993\begin{cfuncdesc}{PyObject*}{PyUnicode_Splitlines}{PyObject *s,
2994 int maxsplit}
Fred Drake1d158692000-06-18 05:21:21 +00002995Split a Unicode string at line breaks, returning a list of Unicode
2996strings. CRLF is considered to be one line break. The Line break
2997characters are not included in the resulting strings.
Fred Drakea4cd2612000-04-06 14:10:29 +00002998\end{cfuncdesc}
2999
3000\begin{cfuncdesc}{PyObject*}{PyUnicode_Translate}{PyObject *str,
3001 PyObject *table,
3002 const char *errors}
Fred Drakea4cd2612000-04-06 14:10:29 +00003003Translate a string by applying a character mapping table to it and
3004return the resulting Unicode object.
3005
3006The mapping table must map Unicode ordinal integers to Unicode ordinal
3007integers or None (causing deletion of the character).
3008
3009Mapping tables must only provide the __getitem__ interface,
3010e.g. dictionaries or sequences. Unmapped character ordinals (ones
3011which cause a LookupError) are left untouched and are copied as-is.
3012
3013\var{errors} has the usual meaning for codecs. It may be \NULL{}
3014which indicates to use the default error handling.
Fred Drakea4cd2612000-04-06 14:10:29 +00003015\end{cfuncdesc}
3016
3017\begin{cfuncdesc}{PyObject*}{PyUnicode_Join}{PyObject *separator,
3018 PyObject *seq}
Fred Drakea4cd2612000-04-06 14:10:29 +00003019Join a sequence of strings using the given separator and return
3020the resulting Unicode string.
3021\end{cfuncdesc}
3022
3023\begin{cfuncdesc}{PyObject*}{PyUnicode_Tailmatch}{PyObject *str,
3024 PyObject *substr,
3025 int start,
3026 int end,
3027 int direction}
Fred Drakea4cd2612000-04-06 14:10:29 +00003028Return 1 if \var{substr} matches \var{str}[\var{start}:\var{end}] at
3029the given tail end (\var{direction} == -1 means to do a prefix match,
3030\var{direction} == 1 a suffix match), 0 otherwise.
3031\end{cfuncdesc}
3032
3033\begin{cfuncdesc}{PyObject*}{PyUnicode_Find}{PyObject *str,
3034 PyObject *substr,
3035 int start,
3036 int end,
3037 int direction}
Fred Drakea4cd2612000-04-06 14:10:29 +00003038Return the first position of \var{substr} in
3039\var{str}[\var{start}:\var{end}] using the given \var{direction}
3040(\var{direction} == 1 means to do a forward search,
3041\var{direction} == -1 a backward search), 0 otherwise.
3042\end{cfuncdesc}
3043
3044\begin{cfuncdesc}{PyObject*}{PyUnicode_Count}{PyObject *str,
3045 PyObject *substr,
3046 int start,
3047 int end}
Fred Drakea4cd2612000-04-06 14:10:29 +00003048Count the number of occurrences of \var{substr} in
3049\var{str}[\var{start}:\var{end}]
3050\end{cfuncdesc}
3051
3052\begin{cfuncdesc}{PyObject*}{PyUnicode_Replace}{PyObject *str,
3053 PyObject *substr,
3054 PyObject *replstr,
3055 int maxcount}
Fred Drakea4cd2612000-04-06 14:10:29 +00003056Replace at most \var{maxcount} occurrences of \var{substr} in
3057\var{str} with \var{replstr} and return the resulting Unicode object.
3058\var{maxcount} == -1 means: replace all occurrences.
3059\end{cfuncdesc}
3060
Fred Drake1d158692000-06-18 05:21:21 +00003061\begin{cfuncdesc}{int}{PyUnicode_Compare}{PyObject *left, PyObject *right}
Fred Drakea4cd2612000-04-06 14:10:29 +00003062Compare two strings and return -1, 0, 1 for less than, equal,
3063greater than resp.
3064\end{cfuncdesc}
3065
3066\begin{cfuncdesc}{PyObject*}{PyUnicode_Format}{PyObject *format,
3067 PyObject *args}
Fred Drake1d158692000-06-18 05:21:21 +00003068Returns a new string object from \var{format} and \var{args}; this is
3069analogous to \code{\var{format} \%\ \var{args}}. The
3070\var{args} argument must be a tuple.
Fred Drakea4cd2612000-04-06 14:10:29 +00003071\end{cfuncdesc}
3072
3073\begin{cfuncdesc}{int}{PyUnicode_Contains}{PyObject *container,
3074 PyObject *element}
Fred Drakea4cd2612000-04-06 14:10:29 +00003075Checks whether \var{element} is contained in \var{container} and
Fred Drake1d158692000-06-18 05:21:21 +00003076returns true or false accordingly.
Fred Drakea4cd2612000-04-06 14:10:29 +00003077
Fred Drake1d158692000-06-18 05:21:21 +00003078\var{element} has to coerce to a one element Unicode string. \code{-1} is
Fred Drakea4cd2612000-04-06 14:10:29 +00003079returned in case of an error.
3080\end{cfuncdesc}
3081
3082
Fred Drake58c5a2a1999-08-04 13:13:24 +00003083\subsection{Buffer Objects \label{bufferObjects}}
Fred Drake659ebfa2000-04-03 15:42:13 +00003084\sectionauthor{Greg Stein}{gstein@lyra.org}
Fred Drake58c5a2a1999-08-04 13:13:24 +00003085
Fred Drake659ebfa2000-04-03 15:42:13 +00003086\obindex{buffer}
3087Python objects implemented in C can export a group of functions called
3088the ``buffer\index{buffer interface} interface.'' These functions can
3089be used by an object to expose its data in a raw, byte-oriented
3090format. Clients of the object can use the buffer interface to access
3091the object data directly, without needing to copy it first.
3092
3093Two examples of objects that support
3094the buffer interface are strings and arrays. The string object exposes
3095the character contents in the buffer interface's byte-oriented
3096form. An array can also expose its contents, but it should be noted
3097that array elements may be multi-byte values.
3098
3099An example user of the buffer interface is the file object's
3100\method{write()} method. Any object that can export a series of bytes
3101through the buffer interface can be written to a file. There are a
3102number of format codes to \cfunction{PyArgs_ParseTuple()} that operate
3103against an object's buffer interface, returning data from the target
3104object.
3105
3106More information on the buffer interface is provided in the section
3107``Buffer Object Structures'' (section \ref{buffer-structs}), under
3108the description for \ctype{PyBufferProcs}\ttindex{PyBufferProcs}.
3109
3110A ``buffer object'' is defined in the \file{bufferobject.h} header
3111(included by \file{Python.h}). These objects look very similar to
3112string objects at the Python programming level: they support slicing,
3113indexing, concatenation, and some other standard string
3114operations. However, their data can come from one of two sources: from
3115a block of memory, or from another object which exports the buffer
3116interface.
3117
3118Buffer objects are useful as a way to expose the data from another
3119object's buffer interface to the Python programmer. They can also be
3120used as a zero-copy slicing mechanism. Using their ability to
3121reference a block of memory, it is possible to expose any data to the
3122Python programmer quite easily. The memory could be a large, constant
3123array in a C extension, it could be a raw block of memory for
3124manipulation before passing to an operating system library, or it
3125could be used to pass around structured data in its native, in-memory
3126format.
3127
3128\begin{ctypedesc}{PyBufferObject}
3129This subtype of \ctype{PyObject} represents a buffer object.
3130\end{ctypedesc}
Fred Drake58c5a2a1999-08-04 13:13:24 +00003131
3132\begin{cvardesc}{PyTypeObject}{PyBuffer_Type}
3133The instance of \ctype{PyTypeObject} which represents the Python
Fred Drake659ebfa2000-04-03 15:42:13 +00003134buffer type; it is the same object as \code{types.BufferType} in the
3135Python layer.\withsubitem{(in module types)}{\ttindex{BufferType}}.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003136\end{cvardesc}
3137
3138\begin{cvardesc}{int}{Py_END_OF_BUFFER}
Fred Drake659ebfa2000-04-03 15:42:13 +00003139This constant may be passed as the \var{size} parameter to
3140\cfunction{PyBuffer_FromObject()} or
3141\cfunction{PyBuffer_FromReadWriteObject()}. It indicates that the new
3142\ctype{PyBufferObject} should refer to \var{base} object from the
3143specified \var{offset} to the end of its exported buffer. Using this
3144enables the caller to avoid querying the \var{base} object for its
3145length.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003146\end{cvardesc}
3147
3148\begin{cfuncdesc}{int}{PyBuffer_Check}{PyObject *p}
3149Return true if the argument has type \cdata{PyBuffer_Type}.
3150\end{cfuncdesc}
3151
3152\begin{cfuncdesc}{PyObject*}{PyBuffer_FromObject}{PyObject *base,
3153 int offset, int size}
Fred Drake659ebfa2000-04-03 15:42:13 +00003154Return a new read-only buffer object. This raises
3155\exception{TypeError} if \var{base} doesn't support the read-only
3156buffer protocol or doesn't provide exactly one buffer segment, or it
3157raises \exception{ValueError} if \var{offset} is less than zero. The
3158buffer will hold a reference to the \var{base} object, and the
3159buffer's contents will refer to the \var{base} object's buffer
3160interface, starting as position \var{offset} and extending for
3161\var{size} bytes. If \var{size} is \constant{Py_END_OF_BUFFER}, then
3162the new buffer's contents extend to the length of the
3163\var{base} object's exported buffer data.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003164\end{cfuncdesc}
3165
3166\begin{cfuncdesc}{PyObject*}{PyBuffer_FromReadWriteObject}{PyObject *base,
3167 int offset,
3168 int size}
3169Return a new writable buffer object. Parameters and exceptions are
3170similar to those for \cfunction{PyBuffer_FromObject()}.
Fred Drake659ebfa2000-04-03 15:42:13 +00003171If the \var{base} object does not export the writeable buffer
3172protocol, then \exception{TypeError} is raised.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003173\end{cfuncdesc}
3174
3175\begin{cfuncdesc}{PyObject*}{PyBuffer_FromMemory}{void *ptr, int size}
Fred Drake659ebfa2000-04-03 15:42:13 +00003176Return a new read-only buffer object that reads from a specified
3177location in memory, with a specified size.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003178The caller is responsible for ensuring that the memory buffer, passed
3179in as \var{ptr}, is not deallocated while the returned buffer object
3180exists. Raises \exception{ValueError} if \var{size} is less than
Fred Drake659ebfa2000-04-03 15:42:13 +00003181zero. Note that \constant{Py_END_OF_BUFFER} may \emph{not} be passed
3182for the \var{size} parameter; \exception{ValueError} will be raised in
3183that case.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003184\end{cfuncdesc}
3185
3186\begin{cfuncdesc}{PyObject*}{PyBuffer_FromReadWriteMemory}{void *ptr, int size}
Fred Drake659ebfa2000-04-03 15:42:13 +00003187Similar to \cfunction{PyBuffer_FromMemory()}, but the returned buffer
3188is writable.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003189\end{cfuncdesc}
3190
3191\begin{cfuncdesc}{PyObject*}{PyBuffer_New}{int size}
3192Returns a new writable buffer object that maintains its own memory
Fred Drake659ebfa2000-04-03 15:42:13 +00003193buffer of \var{size} bytes. \exception{ValueError} is returned if
3194\var{size} is not zero or positive.
Fred Drake58c5a2a1999-08-04 13:13:24 +00003195\end{cfuncdesc}
3196
Guido van Rossum44475131998-04-21 15:30:01 +00003197
Fred Drakeefd146c1999-02-15 15:30:45 +00003198\subsection{Tuple Objects \label{tupleObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003199
Fred Drake659ebfa2000-04-03 15:42:13 +00003200\obindex{tuple}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003201\begin{ctypedesc}{PyTupleObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003202This subtype of \ctype{PyObject} represents a Python tuple object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003203\end{ctypedesc}
3204
3205\begin{cvardesc}{PyTypeObject}{PyTuple_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00003206This instance of \ctype{PyTypeObject} represents the Python tuple
3207type; it is the same object as \code{types.TupleType} in the Python
3208layer.\withsubitem{(in module types)}{\ttindex{TupleType}}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003209\end{cvardesc}
3210
3211\begin{cfuncdesc}{int}{PyTuple_Check}{PyObject *p}
3212Return true if the argument is a tuple object.
3213\end{cfuncdesc}
3214
Fred Drake659ebfa2000-04-03 15:42:13 +00003215\begin{cfuncdesc}{PyObject*}{PyTuple_New}{int len}
3216Return a new tuple object of size \var{len}, or \NULL{} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003217\end{cfuncdesc}
3218
Fred Drakea05460c2001-02-12 17:38:18 +00003219\begin{cfuncdesc}{int}{PyTuple_Size}{PyObject *p}
Fred Drakee058b4f1998-02-16 06:15:35 +00003220Takes a pointer to a tuple object, and returns the size
Fred Drakee5bf8b21998-02-12 21:22:28 +00003221of that tuple.
3222\end{cfuncdesc}
3223
Fred Drakea05460c2001-02-12 17:38:18 +00003224\begin{cfuncdesc}{PyObject*}{PyTuple_GetItem}{PyObject *p, int pos}
Fred Drakee058b4f1998-02-16 06:15:35 +00003225Returns the object at position \var{pos} in the tuple pointed
3226to by \var{p}. If \var{pos} is out of bounds, returns \NULL{} and
Fred Drake659ebfa2000-04-03 15:42:13 +00003227sets an \exception{IndexError} exception.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003228\end{cfuncdesc}
3229
Fred Drakea05460c2001-02-12 17:38:18 +00003230\begin{cfuncdesc}{PyObject*}{PyTuple_GET_ITEM}{PyObject *p, int pos}
Fred Drakefac312f2001-05-29 15:13:00 +00003231Like \cfunction{PyTuple_GetItem()}, but does no checking of its
3232arguments.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003233\end{cfuncdesc}
3234
Fred Drakea05460c2001-02-12 17:38:18 +00003235\begin{cfuncdesc}{PyObject*}{PyTuple_GetSlice}{PyObject *p,
3236 int low, int high}
Fred Drakee058b4f1998-02-16 06:15:35 +00003237Takes a slice of the tuple pointed to by \var{p} from
3238\var{low} to \var{high} and returns it as a new tuple.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003239\end{cfuncdesc}
3240
Fred Drake659ebfa2000-04-03 15:42:13 +00003241\begin{cfuncdesc}{int}{PyTuple_SetItem}{PyObject *p,
3242 int pos, PyObject *o}
Fred Drakee058b4f1998-02-16 06:15:35 +00003243Inserts a reference to object \var{o} at position \var{pos} of
3244the tuple pointed to by \var{p}. It returns \code{0} on success.
Fred Drake659ebfa2000-04-03 15:42:13 +00003245\strong{Note:} This function ``steals'' a reference to \var{o}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003246\end{cfuncdesc}
3247
Fred Drake659ebfa2000-04-03 15:42:13 +00003248\begin{cfuncdesc}{void}{PyTuple_SET_ITEM}{PyObject *p,
3249 int pos, PyObject *o}
Fred Drakefac312f2001-05-29 15:13:00 +00003250Like \cfunction{PyTuple_SetItem()}, but does no error checking, and
Fred Drakee5bf8b21998-02-12 21:22:28 +00003251should \emph{only} be used to fill in brand new tuples.
Fred Drake659ebfa2000-04-03 15:42:13 +00003252\strong{Note:} This function ``steals'' a reference to \var{o}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003253\end{cfuncdesc}
3254
Fred Drakefac312f2001-05-29 15:13:00 +00003255\begin{cfuncdesc}{int}{_PyTuple_Resize}{PyObject **p, int newsize}
Fred Drake659ebfa2000-04-03 15:42:13 +00003256Can be used to resize a tuple. \var{newsize} will be the new length
3257of the tuple. Because tuples are \emph{supposed} to be immutable,
3258this should only be used if there is only one reference to the object.
3259Do \emph{not} use this if the tuple may already be known to some other
Fred Drakefac312f2001-05-29 15:13:00 +00003260part of the code. The tuple will always grow or shrink at the end.
3261Think of this as destroying the old tuple and creating a new one, only
3262more efficiently. Returns \code{0} on success. Client code should
3263never assume that the resulting value of \code{*\var{p}} will be the
3264same as before calling this function. If the object referenced by
3265\code{*\var{p}} is replaced, the original \code{*\var{p}} is
3266destroyed. On failure, returns \code{-1} and sets \code{*\var{p}} to
3267\NULL, and raises \exception{MemoryError} or \exception{SystemError}.
3268\versionchanged[Removed unused third parameter, \var{last_is_sticky}]{2.2}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003269\end{cfuncdesc}
3270
3271
Fred Drakeefd146c1999-02-15 15:30:45 +00003272\subsection{List Objects \label{listObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003273
Fred Drake659ebfa2000-04-03 15:42:13 +00003274\obindex{list}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003275\begin{ctypedesc}{PyListObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003276This subtype of \ctype{PyObject} represents a Python list object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003277\end{ctypedesc}
3278
3279\begin{cvardesc}{PyTypeObject}{PyList_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00003280This instance of \ctype{PyTypeObject} represents the Python list
3281type. This is the same object as \code{types.ListType}.
3282\withsubitem{(in module types)}{\ttindex{ListType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003283\end{cvardesc}
3284
3285\begin{cfuncdesc}{int}{PyList_Check}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003286Returns true if its argument is a \ctype{PyListObject}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003287\end{cfuncdesc}
3288
Fred Drake659ebfa2000-04-03 15:42:13 +00003289\begin{cfuncdesc}{PyObject*}{PyList_New}{int len}
3290Returns a new list of length \var{len} on success, or \NULL{} on
Guido van Rossum3c4378b1998-04-14 20:21:10 +00003291failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003292\end{cfuncdesc}
3293
Fred Drakec6fa34e1998-04-02 06:47:24 +00003294\begin{cfuncdesc}{int}{PyList_Size}{PyObject *list}
Fred Drake659ebfa2000-04-03 15:42:13 +00003295Returns the length of the list object in \var{list}; this is
3296equivalent to \samp{len(\var{list})} on a list object.
3297\bifuncindex{len}
3298\end{cfuncdesc}
3299
3300\begin{cfuncdesc}{int}{PyList_GET_SIZE}{PyObject *list}
Fred Drake5d644212000-10-07 12:31:50 +00003301Macro form of \cfunction{PyList_Size()} without error checking.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003302\end{cfuncdesc}
3303
Fred Drakec6fa34e1998-04-02 06:47:24 +00003304\begin{cfuncdesc}{PyObject*}{PyList_GetItem}{PyObject *list, int index}
Guido van Rossum44475131998-04-21 15:30:01 +00003305Returns the object at position \var{pos} in the list pointed
3306to by \var{p}. If \var{pos} is out of bounds, returns \NULL{} and
Fred Drake659ebfa2000-04-03 15:42:13 +00003307sets an \exception{IndexError} exception.
3308\end{cfuncdesc}
3309
3310\begin{cfuncdesc}{PyObject*}{PyList_GET_ITEM}{PyObject *list, int i}
3311Macro form of \cfunction{PyList_GetItem()} without error checking.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003312\end{cfuncdesc}
3313
Fred Drakec6fa34e1998-04-02 06:47:24 +00003314\begin{cfuncdesc}{int}{PyList_SetItem}{PyObject *list, int index,
3315 PyObject *item}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00003316Sets the item at index \var{index} in list to \var{item}.
Fred Drake00d0cb62001-06-03 03:12:57 +00003317\strong{Note:} This function ``steals'' a reference to \var{item} and
3318discards a reference to an item already in the list at the affected
3319position.
Fred Drake659ebfa2000-04-03 15:42:13 +00003320\end{cfuncdesc}
3321
3322\begin{cfuncdesc}{PyObject*}{PyList_SET_ITEM}{PyObject *list, int i,
3323 PyObject *o}
3324Macro form of \cfunction{PyList_SetItem()} without error checking.
Fred Drake00d0cb62001-06-03 03:12:57 +00003325\strong{Note:} This function ``steals'' a reference to \var{item},
3326and, unlike \cfunction{PyList_SetItem()}, does \emph{not} discard a
3327reference to any item that it being replaced. This is normally only
3328used to fill in new lists where there is no previous content..
Fred Drakee5bf8b21998-02-12 21:22:28 +00003329\end{cfuncdesc}
3330
Fred Drakec6fa34e1998-04-02 06:47:24 +00003331\begin{cfuncdesc}{int}{PyList_Insert}{PyObject *list, int index,
Guido van Rossum44475131998-04-21 15:30:01 +00003332 PyObject *item}
3333Inserts the item \var{item} into list \var{list} in front of index
Fred Drake659ebfa2000-04-03 15:42:13 +00003334\var{index}. Returns \code{0} if successful; returns \code{-1} and
3335raises an exception if unsuccessful. Analogous to
3336\code{\var{list}.insert(\var{index}, \var{item})}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003337\end{cfuncdesc}
3338
Fred Drakec6fa34e1998-04-02 06:47:24 +00003339\begin{cfuncdesc}{int}{PyList_Append}{PyObject *list, PyObject *item}
Guido van Rossum44475131998-04-21 15:30:01 +00003340Appends the object \var{item} at the end of list \var{list}. Returns
Fred Drake659ebfa2000-04-03 15:42:13 +00003341\code{0} if successful; returns \code{-1} and sets an exception if
3342unsuccessful. Analogous to \code{\var{list}.append(\var{item})}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003343\end{cfuncdesc}
3344
Fred Drakec6fa34e1998-04-02 06:47:24 +00003345\begin{cfuncdesc}{PyObject*}{PyList_GetSlice}{PyObject *list,
3346 int low, int high}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00003347Returns a list of the objects in \var{list} containing the objects
Guido van Rossum44475131998-04-21 15:30:01 +00003348\emph{between} \var{low} and \var{high}. Returns NULL and sets an
3349exception if unsuccessful.
Fred Drake659ebfa2000-04-03 15:42:13 +00003350Analogous to \code{\var{list}[\var{low}:\var{high}]}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003351\end{cfuncdesc}
3352
Fred Drakec6fa34e1998-04-02 06:47:24 +00003353\begin{cfuncdesc}{int}{PyList_SetSlice}{PyObject *list,
3354 int low, int high,
3355 PyObject *itemlist}
Fred Drake659ebfa2000-04-03 15:42:13 +00003356Sets the slice of \var{list} between \var{low} and \var{high} to the
3357contents of \var{itemlist}. Analogous to
3358\code{\var{list}[\var{low}:\var{high}] = \var{itemlist}}. Returns
3359\code{0} on success, \code{-1} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003360\end{cfuncdesc}
3361
Fred Drakec6fa34e1998-04-02 06:47:24 +00003362\begin{cfuncdesc}{int}{PyList_Sort}{PyObject *list}
Fred Drake659ebfa2000-04-03 15:42:13 +00003363Sorts the items of \var{list} in place. Returns \code{0} on success,
3364\code{-1} on failure. This is equivalent to
3365\samp{\var{list}.sort()}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003366\end{cfuncdesc}
3367
Fred Drakec6fa34e1998-04-02 06:47:24 +00003368\begin{cfuncdesc}{int}{PyList_Reverse}{PyObject *list}
Fred Drake659ebfa2000-04-03 15:42:13 +00003369Reverses the items of \var{list} in place. Returns \code{0} on
3370success, \code{-1} on failure. This is the equivalent of
3371\samp{\var{list}.reverse()}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003372\end{cfuncdesc}
3373
Fred Drakec6fa34e1998-04-02 06:47:24 +00003374\begin{cfuncdesc}{PyObject*}{PyList_AsTuple}{PyObject *list}
Fred Drake659ebfa2000-04-03 15:42:13 +00003375Returns a new tuple object containing the contents of \var{list};
3376equivalent to \samp{tuple(\var{list})}.\bifuncindex{tuple}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003377\end{cfuncdesc}
3378
3379
Fred Drakeefd146c1999-02-15 15:30:45 +00003380\section{Mapping Objects \label{mapObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003381
Fred Drake659ebfa2000-04-03 15:42:13 +00003382\obindex{mapping}
3383
3384
Fred Drakeefd146c1999-02-15 15:30:45 +00003385\subsection{Dictionary Objects \label{dictObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003386
Fred Drake659ebfa2000-04-03 15:42:13 +00003387\obindex{dictionary}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003388\begin{ctypedesc}{PyDictObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003389This subtype of \ctype{PyObject} represents a Python dictionary object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003390\end{ctypedesc}
3391
3392\begin{cvardesc}{PyTypeObject}{PyDict_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00003393This instance of \ctype{PyTypeObject} represents the Python dictionary
3394type. This is exposed to Python programs as \code{types.DictType} and
3395\code{types.DictionaryType}.
3396\withsubitem{(in module types)}{\ttindex{DictType}\ttindex{DictionaryType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003397\end{cvardesc}
3398
3399\begin{cfuncdesc}{int}{PyDict_Check}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003400Returns true if its argument is a \ctype{PyDictObject}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003401\end{cfuncdesc}
3402
Fred Drakec6fa34e1998-04-02 06:47:24 +00003403\begin{cfuncdesc}{PyObject*}{PyDict_New}{}
Fred Drake659ebfa2000-04-03 15:42:13 +00003404Returns a new empty dictionary, or \NULL{} on failure.
3405\end{cfuncdesc}
3406
3407\begin{cfuncdesc}{void}{PyDict_Clear}{PyObject *p}
3408Empties an existing dictionary of all key-value pairs.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003409\end{cfuncdesc}
3410
Jeremy Hyltona12c7a72000-03-30 22:27:31 +00003411\begin{cfuncdesc}{PyObject*}{PyDict_Copy}{PyObject *p}
Fred Drake659ebfa2000-04-03 15:42:13 +00003412Returns a new dictionary that contains the same key-value pairs as p.
3413Empties an existing dictionary of all key-value pairs.
Jeremy Hyltona12c7a72000-03-30 22:27:31 +00003414\end{cfuncdesc}
3415
Fred Drake659ebfa2000-04-03 15:42:13 +00003416\begin{cfuncdesc}{int}{PyDict_SetItem}{PyObject *p, PyObject *key,
3417 PyObject *val}
3418Inserts \var{value} into the dictionary with a key of \var{key}.
3419\var{key} must be hashable; if it isn't, \exception{TypeError} will be
3420raised.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003421\end{cfuncdesc}
3422
Fred Drake83e01bf2001-03-16 15:41:29 +00003423\begin{cfuncdesc}{int}{PyDict_SetItemString}{PyObject *p,
Fred Drakee5bf8b21998-02-12 21:22:28 +00003424 char *key,
3425 PyObject *val}
Fred Drakee058b4f1998-02-16 06:15:35 +00003426Inserts \var{value} into the dictionary using \var{key}
Fred Drake1d158692000-06-18 05:21:21 +00003427as a key. \var{key} should be a \ctype{char*}. The key object is
Fred Drakee058b4f1998-02-16 06:15:35 +00003428created using \code{PyString_FromString(\var{key})}.
Fred Drake659ebfa2000-04-03 15:42:13 +00003429\ttindex{PyString_FromString()}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003430\end{cfuncdesc}
3431
Fred Drake659ebfa2000-04-03 15:42:13 +00003432\begin{cfuncdesc}{int}{PyDict_DelItem}{PyObject *p, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00003433Removes the entry in dictionary \var{p} with key \var{key}.
Fred Drake659ebfa2000-04-03 15:42:13 +00003434\var{key} must be hashable; if it isn't, \exception{TypeError} is
3435raised.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003436\end{cfuncdesc}
3437
Fred Drake659ebfa2000-04-03 15:42:13 +00003438\begin{cfuncdesc}{int}{PyDict_DelItemString}{PyObject *p, char *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00003439Removes the entry in dictionary \var{p} which has a key
Fred Drake659ebfa2000-04-03 15:42:13 +00003440specified by the string \var{key}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003441\end{cfuncdesc}
3442
Fred Drake659ebfa2000-04-03 15:42:13 +00003443\begin{cfuncdesc}{PyObject*}{PyDict_GetItem}{PyObject *p, PyObject *key}
Fred Drakee058b4f1998-02-16 06:15:35 +00003444Returns the object from dictionary \var{p} which has a key
Guido van Rossum44475131998-04-21 15:30:01 +00003445\var{key}. Returns \NULL{} if the key \var{key} is not present, but
Fred Drake659ebfa2000-04-03 15:42:13 +00003446\emph{without} setting an exception.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003447\end{cfuncdesc}
3448
Fred Drake659ebfa2000-04-03 15:42:13 +00003449\begin{cfuncdesc}{PyObject*}{PyDict_GetItemString}{PyObject *p, char *key}
Fred Drakef8830d11998-04-23 14:06:01 +00003450This is the same as \cfunction{PyDict_GetItem()}, but \var{key} is
Fred Drake659ebfa2000-04-03 15:42:13 +00003451specified as a \ctype{char*}, rather than a \ctype{PyObject*}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003452\end{cfuncdesc}
3453
Fred Drake659ebfa2000-04-03 15:42:13 +00003454\begin{cfuncdesc}{PyObject*}{PyDict_Items}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003455Returns a \ctype{PyListObject} containing all the items
Guido van Rossum44475131998-04-21 15:30:01 +00003456from the dictionary, as in the dictinoary method \method{items()} (see
Fred Drakebe486461999-11-09 17:03:03 +00003457the \citetitle[../lib/lib.html]{Python Library Reference}).
Fred Drakee5bf8b21998-02-12 21:22:28 +00003458\end{cfuncdesc}
3459
Fred Drake659ebfa2000-04-03 15:42:13 +00003460\begin{cfuncdesc}{PyObject*}{PyDict_Keys}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003461Returns a \ctype{PyListObject} containing all the keys
Guido van Rossum44475131998-04-21 15:30:01 +00003462from the dictionary, as in the dictionary method \method{keys()} (see the
Fred Drakebe486461999-11-09 17:03:03 +00003463\citetitle[../lib/lib.html]{Python Library Reference}).
Fred Drakee5bf8b21998-02-12 21:22:28 +00003464\end{cfuncdesc}
3465
Fred Drake659ebfa2000-04-03 15:42:13 +00003466\begin{cfuncdesc}{PyObject*}{PyDict_Values}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003467Returns a \ctype{PyListObject} containing all the values
Guido van Rossum44475131998-04-21 15:30:01 +00003468from the dictionary \var{p}, as in the dictionary method
Fred Drakebe486461999-11-09 17:03:03 +00003469\method{values()} (see the \citetitle[../lib/lib.html]{Python Library
3470Reference}).
Fred Drakee5bf8b21998-02-12 21:22:28 +00003471\end{cfuncdesc}
3472
Fred Drake659ebfa2000-04-03 15:42:13 +00003473\begin{cfuncdesc}{int}{PyDict_Size}{PyObject *p}
3474Returns the number of items in the dictionary. This is equivalent to
3475\samp{len(\var{p})} on a dictionary.\bifuncindex{len}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003476\end{cfuncdesc}
3477
Fred Drake83e01bf2001-03-16 15:41:29 +00003478\begin{cfuncdesc}{int}{PyDict_Next}{PyObject *p, int *ppos,
Fred Drake7d45d342000-08-11 17:07:32 +00003479 PyObject **pkey, PyObject **pvalue}
Fred Drake83e01bf2001-03-16 15:41:29 +00003480Iterate over all key-value pairs in the dictionary \var{p}. The
3481\ctype{int} referred to by \var{ppos} must be initialized to \code{0}
3482prior to the first call to this function to start the iteration; the
3483function returns true for each pair in the dictionary, and false once
3484all pairs have been reported. The parameters \var{pkey} and
3485\var{pvalue} should either point to \ctype{PyObject*} variables that
3486will be filled in with each key and value, respectively, or may be
Fred Drake8d00a0f2001-04-13 17:55:02 +00003487\NULL.
3488
Fred Drake83e01bf2001-03-16 15:41:29 +00003489For example:
Fred Drakee5bf8b21998-02-12 21:22:28 +00003490
Fred Drake83e01bf2001-03-16 15:41:29 +00003491\begin{verbatim}
3492PyObject *key, *value;
3493int pos = 0;
3494
3495while (PyDict_Next(self->dict, &pos, &key, &value)) {
3496 /* do something interesting with the values... */
3497 ...
3498}
3499\end{verbatim}
Fred Drake8d00a0f2001-04-13 17:55:02 +00003500
3501The dictionary \var{p} should not be mutated during iteration. It is
3502safe (since Python 2.1) to modify the values of the keys as you
3503iterate over the dictionary, for example:
3504
3505\begin{verbatim}
3506PyObject *key, *value;
3507int pos = 0;
3508
3509while (PyDict_Next(self->dict, &pos, &key, &value)) {
3510 int i = PyInt_AS_LONG(value) + 1;
3511 PyObject *o = PyInt_FromLong(i);
3512 if (o == NULL)
3513 return -1;
3514 if (PyDict_SetItem(self->dict, key, o) < 0) {
3515 Py_DECREF(o);
3516 return -1;
3517 }
3518 Py_DECREF(o);
3519}
3520\end{verbatim}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003521\end{cfuncdesc}
3522
3523
Fred Drakeefd146c1999-02-15 15:30:45 +00003524\section{Numeric Objects \label{numericObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003525
Fred Drake659ebfa2000-04-03 15:42:13 +00003526\obindex{numeric}
3527
3528
Fred Drakeefd146c1999-02-15 15:30:45 +00003529\subsection{Plain Integer Objects \label{intObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003530
Fred Drake659ebfa2000-04-03 15:42:13 +00003531\obindex{integer}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003532\begin{ctypedesc}{PyIntObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003533This subtype of \ctype{PyObject} represents a Python integer object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003534\end{ctypedesc}
3535
3536\begin{cvardesc}{PyTypeObject}{PyInt_Type}
Fred Drakef8830d11998-04-23 14:06:01 +00003537This instance of \ctype{PyTypeObject} represents the Python plain
Fred Drake659ebfa2000-04-03 15:42:13 +00003538integer type. This is the same object as \code{types.IntType}.
3539\withsubitem{(in modules types)}{\ttindex{IntType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003540\end{cvardesc}
3541
Fred Drake659ebfa2000-04-03 15:42:13 +00003542\begin{cfuncdesc}{int}{PyInt_Check}{PyObject* o}
3543Returns true if \var{o} is of type \cdata{PyInt_Type}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003544\end{cfuncdesc}
3545
Fred Drakec6fa34e1998-04-02 06:47:24 +00003546\begin{cfuncdesc}{PyObject*}{PyInt_FromLong}{long ival}
Fred Drakee058b4f1998-02-16 06:15:35 +00003547Creates a new integer object with a value of \var{ival}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003548
3549The current implementation keeps an array of integer objects for all
Fred Drakee058b4f1998-02-16 06:15:35 +00003550integers between \code{-1} and \code{100}, when you create an int in
3551that range you actually just get back a reference to the existing
3552object. So it should be possible to change the value of \code{1}. I
Fred Drake7e9d3141998-04-03 05:02:28 +00003553suspect the behaviour of Python in this case is undefined. :-)
Fred Drakee5bf8b21998-02-12 21:22:28 +00003554\end{cfuncdesc}
3555
Fred Drakee5bf8b21998-02-12 21:22:28 +00003556\begin{cfuncdesc}{long}{PyInt_AsLong}{PyObject *io}
Fred Drakef8830d11998-04-23 14:06:01 +00003557Will first attempt to cast the object to a \ctype{PyIntObject}, if
Fred Drakee058b4f1998-02-16 06:15:35 +00003558it is not already one, and then return its value.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003559\end{cfuncdesc}
3560
Fred Drake659ebfa2000-04-03 15:42:13 +00003561\begin{cfuncdesc}{long}{PyInt_AS_LONG}{PyObject *io}
3562Returns the value of the object \var{io}. No error checking is
3563performed.
3564\end{cfuncdesc}
3565
Fred Drakee5bf8b21998-02-12 21:22:28 +00003566\begin{cfuncdesc}{long}{PyInt_GetMax}{}
Fred Drake659ebfa2000-04-03 15:42:13 +00003567Returns the system's idea of the largest integer it can handle
3568(\constant{LONG_MAX}\ttindex{LONG_MAX}, as defined in the system
3569header files).
Fred Drakee5bf8b21998-02-12 21:22:28 +00003570\end{cfuncdesc}
3571
3572
Fred Drakeefd146c1999-02-15 15:30:45 +00003573\subsection{Long Integer Objects \label{longObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003574
Fred Drake659ebfa2000-04-03 15:42:13 +00003575\obindex{long integer}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003576\begin{ctypedesc}{PyLongObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003577This subtype of \ctype{PyObject} represents a Python long integer
Fred Drakee058b4f1998-02-16 06:15:35 +00003578object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003579\end{ctypedesc}
3580
3581\begin{cvardesc}{PyTypeObject}{PyLong_Type}
Fred Drakef8830d11998-04-23 14:06:01 +00003582This instance of \ctype{PyTypeObject} represents the Python long
Fred Drake659ebfa2000-04-03 15:42:13 +00003583integer type. This is the same object as \code{types.LongType}.
3584\withsubitem{(in modules types)}{\ttindex{LongType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003585\end{cvardesc}
3586
3587\begin{cfuncdesc}{int}{PyLong_Check}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003588Returns true if its argument is a \ctype{PyLongObject}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003589\end{cfuncdesc}
3590
Fred Drakec6fa34e1998-04-02 06:47:24 +00003591\begin{cfuncdesc}{PyObject*}{PyLong_FromLong}{long v}
Fred Drake659ebfa2000-04-03 15:42:13 +00003592Returns a new \ctype{PyLongObject} object from \var{v}, or \NULL{} on
3593failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003594\end{cfuncdesc}
3595
Fred Drakec6fa34e1998-04-02 06:47:24 +00003596\begin{cfuncdesc}{PyObject*}{PyLong_FromUnsignedLong}{unsigned long v}
Fred Drake659ebfa2000-04-03 15:42:13 +00003597Returns a new \ctype{PyLongObject} object from a C \ctype{unsigned
3598long}, or \NULL{} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003599\end{cfuncdesc}
3600
Fred Drakec6fa34e1998-04-02 06:47:24 +00003601\begin{cfuncdesc}{PyObject*}{PyLong_FromDouble}{double v}
Fred Drake659ebfa2000-04-03 15:42:13 +00003602Returns a new \ctype{PyLongObject} object from the integer part of
3603\var{v}, or \NULL{} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003604\end{cfuncdesc}
3605
Fred Drakec6fa34e1998-04-02 06:47:24 +00003606\begin{cfuncdesc}{long}{PyLong_AsLong}{PyObject *pylong}
Fred Drake659ebfa2000-04-03 15:42:13 +00003607Returns a C \ctype{long} representation of the contents of
3608\var{pylong}. If \var{pylong} is greater than
3609\constant{LONG_MAX}\ttindex{LONG_MAX}, an \exception{OverflowError} is
3610raised.\withsubitem{(built-in exception)}{OverflowError}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003611\end{cfuncdesc}
3612
Fred Drakec6fa34e1998-04-02 06:47:24 +00003613\begin{cfuncdesc}{unsigned long}{PyLong_AsUnsignedLong}{PyObject *pylong}
Fred Drake659ebfa2000-04-03 15:42:13 +00003614Returns a C \ctype{unsigned long} representation of the contents of
3615\var{pylong}. If \var{pylong} is greater than
3616\constant{ULONG_MAX}\ttindex{ULONG_MAX}, an \exception{OverflowError}
3617is raised.\withsubitem{(built-in exception)}{OverflowError}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003618\end{cfuncdesc}
3619
Fred Drakec6fa34e1998-04-02 06:47:24 +00003620\begin{cfuncdesc}{double}{PyLong_AsDouble}{PyObject *pylong}
Fred Drake659ebfa2000-04-03 15:42:13 +00003621Returns a C \ctype{double} representation of the contents of \var{pylong}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003622\end{cfuncdesc}
3623
Fred Drakec6fa34e1998-04-02 06:47:24 +00003624\begin{cfuncdesc}{PyObject*}{PyLong_FromString}{char *str, char **pend,
3625 int base}
Fred Drake659ebfa2000-04-03 15:42:13 +00003626Return a new \ctype{PyLongObject} based on the string value in
3627\var{str}, which is interpreted according to the radix in \var{base}.
3628If \var{pend} is non-\NULL, \code{*\var{pend}} will point to the first
3629character in \var{str} which follows the representation of the
3630number. If \var{base} is \code{0}, the radix will be determined base
3631on the leading characters of \var{str}: if \var{str} starts with
3632\code{'0x'} or \code{'0X'}, radix 16 will be used; if \var{str} starts
3633with \code{'0'}, radix 8 will be used; otherwise radix 10 will be
3634used. If \var{base} is not \code{0}, it must be between \code{2} and
3635\code{36}, inclusive. Leading spaces are ignored. If there are no
3636digits, \exception{ValueError} will be raised.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003637\end{cfuncdesc}
3638
3639
Fred Drakeefd146c1999-02-15 15:30:45 +00003640\subsection{Floating Point Objects \label{floatObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003641
Fred Drake659ebfa2000-04-03 15:42:13 +00003642\obindex{floating point}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003643\begin{ctypedesc}{PyFloatObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003644This subtype of \ctype{PyObject} represents a Python floating point
Fred Drakee058b4f1998-02-16 06:15:35 +00003645object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003646\end{ctypedesc}
3647
3648\begin{cvardesc}{PyTypeObject}{PyFloat_Type}
Fred Drakef8830d11998-04-23 14:06:01 +00003649This instance of \ctype{PyTypeObject} represents the Python floating
Fred Drake659ebfa2000-04-03 15:42:13 +00003650point type. This is the same object as \code{types.FloatType}.
3651\withsubitem{(in modules types)}{\ttindex{FloatType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003652\end{cvardesc}
3653
3654\begin{cfuncdesc}{int}{PyFloat_Check}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003655Returns true if its argument is a \ctype{PyFloatObject}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003656\end{cfuncdesc}
3657
Fred Drakec6fa34e1998-04-02 06:47:24 +00003658\begin{cfuncdesc}{PyObject*}{PyFloat_FromDouble}{double v}
Fred Drake659ebfa2000-04-03 15:42:13 +00003659Creates a \ctype{PyFloatObject} object from \var{v}, or \NULL{} on
3660failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003661\end{cfuncdesc}
3662
Fred Drakec6fa34e1998-04-02 06:47:24 +00003663\begin{cfuncdesc}{double}{PyFloat_AsDouble}{PyObject *pyfloat}
Fred Drake659ebfa2000-04-03 15:42:13 +00003664Returns a C \ctype{double} representation of the contents of \var{pyfloat}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003665\end{cfuncdesc}
3666
Fred Drakec6fa34e1998-04-02 06:47:24 +00003667\begin{cfuncdesc}{double}{PyFloat_AS_DOUBLE}{PyObject *pyfloat}
Fred Drake659ebfa2000-04-03 15:42:13 +00003668Returns a C \ctype{double} representation of the contents of
Fred Drakef8830d11998-04-23 14:06:01 +00003669\var{pyfloat}, but without error checking.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003670\end{cfuncdesc}
3671
3672
Fred Drakeefd146c1999-02-15 15:30:45 +00003673\subsection{Complex Number Objects \label{complexObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003674
Fred Drake659ebfa2000-04-03 15:42:13 +00003675\obindex{complex number}
3676Python's complex number objects are implemented as two distinct types
3677when viewed from the C API: one is the Python object exposed to
3678Python programs, and the other is a C structure which represents the
3679actual complex number value. The API provides functions for working
3680with both.
3681
3682\subsubsection{Complex Numbers as C Structures}
3683
3684Note that the functions which accept these structures as parameters
3685and return them as results do so \emph{by value} rather than
3686dereferencing them through pointers. This is consistent throughout
3687the API.
3688
Fred Drakee5bf8b21998-02-12 21:22:28 +00003689\begin{ctypedesc}{Py_complex}
Fred Drake659ebfa2000-04-03 15:42:13 +00003690The C structure which corresponds to the value portion of a Python
Fred Drake4de05a91998-02-16 14:25:26 +00003691complex number object. Most of the functions for dealing with complex
3692number objects use structures of this type as input or output values,
3693as appropriate. It is defined as:
3694
Fred Drakee058b4f1998-02-16 06:15:35 +00003695\begin{verbatim}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003696typedef struct {
3697 double real;
3698 double imag;
Fred Drake4de05a91998-02-16 14:25:26 +00003699} Py_complex;
Fred Drakee058b4f1998-02-16 06:15:35 +00003700\end{verbatim}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003701\end{ctypedesc}
3702
Fred Drake659ebfa2000-04-03 15:42:13 +00003703\begin{cfuncdesc}{Py_complex}{_Py_c_sum}{Py_complex left, Py_complex right}
3704Return the sum of two complex numbers, using the C
3705\ctype{Py_complex} representation.
3706\end{cfuncdesc}
3707
3708\begin{cfuncdesc}{Py_complex}{_Py_c_diff}{Py_complex left, Py_complex right}
3709Return the difference between two complex numbers, using the C
3710\ctype{Py_complex} representation.
3711\end{cfuncdesc}
3712
3713\begin{cfuncdesc}{Py_complex}{_Py_c_neg}{Py_complex complex}
3714Return the negation of the complex number \var{complex}, using the C
3715\ctype{Py_complex} representation.
3716\end{cfuncdesc}
3717
3718\begin{cfuncdesc}{Py_complex}{_Py_c_prod}{Py_complex left, Py_complex right}
3719Return the product of two complex numbers, using the C
3720\ctype{Py_complex} representation.
3721\end{cfuncdesc}
3722
3723\begin{cfuncdesc}{Py_complex}{_Py_c_quot}{Py_complex dividend,
3724 Py_complex divisor}
3725Return the quotient of two complex numbers, using the C
3726\ctype{Py_complex} representation.
3727\end{cfuncdesc}
3728
3729\begin{cfuncdesc}{Py_complex}{_Py_c_pow}{Py_complex num, Py_complex exp}
3730Return the exponentiation of \var{num} by \var{exp}, using the C
3731\ctype{Py_complex} representation.
3732\end{cfuncdesc}
3733
3734
3735\subsubsection{Complex Numbers as Python Objects}
3736
Fred Drakee5bf8b21998-02-12 21:22:28 +00003737\begin{ctypedesc}{PyComplexObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003738This subtype of \ctype{PyObject} represents a Python complex number object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003739\end{ctypedesc}
3740
3741\begin{cvardesc}{PyTypeObject}{PyComplex_Type}
Fred Drakef8830d11998-04-23 14:06:01 +00003742This instance of \ctype{PyTypeObject} represents the Python complex
Fred Drakee5bf8b21998-02-12 21:22:28 +00003743number type.
3744\end{cvardesc}
3745
3746\begin{cfuncdesc}{int}{PyComplex_Check}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003747Returns true if its argument is a \ctype{PyComplexObject}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003748\end{cfuncdesc}
3749
Fred Drakec6fa34e1998-04-02 06:47:24 +00003750\begin{cfuncdesc}{PyObject*}{PyComplex_FromCComplex}{Py_complex v}
Fred Drake659ebfa2000-04-03 15:42:13 +00003751Create a new Python complex number object from a C
3752\ctype{Py_complex} value.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003753\end{cfuncdesc}
3754
Fred Drakec6fa34e1998-04-02 06:47:24 +00003755\begin{cfuncdesc}{PyObject*}{PyComplex_FromDoubles}{double real, double imag}
Fred Drakef8830d11998-04-23 14:06:01 +00003756Returns a new \ctype{PyComplexObject} object from \var{real} and \var{imag}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003757\end{cfuncdesc}
3758
3759\begin{cfuncdesc}{double}{PyComplex_RealAsDouble}{PyObject *op}
Fred Drake659ebfa2000-04-03 15:42:13 +00003760Returns the real part of \var{op} as a C \ctype{double}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003761\end{cfuncdesc}
3762
3763\begin{cfuncdesc}{double}{PyComplex_ImagAsDouble}{PyObject *op}
Fred Drake659ebfa2000-04-03 15:42:13 +00003764Returns the imaginary part of \var{op} as a C \ctype{double}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003765\end{cfuncdesc}
3766
3767\begin{cfuncdesc}{Py_complex}{PyComplex_AsCComplex}{PyObject *op}
Fred Drake659ebfa2000-04-03 15:42:13 +00003768Returns the \ctype{Py_complex} value of the complex number \var{op}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003769\end{cfuncdesc}
3770
3771
3772
Fred Drakeefd146c1999-02-15 15:30:45 +00003773\section{Other Objects \label{otherObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003774
Fred Drakeefd146c1999-02-15 15:30:45 +00003775\subsection{File Objects \label{fileObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003776
Fred Drake659ebfa2000-04-03 15:42:13 +00003777\obindex{file}
3778Python's built-in file objects are implemented entirely on the
3779\ctype{FILE*} support from the C standard library. This is an
3780implementation detail and may change in future releases of Python.
3781
Fred Drakee5bf8b21998-02-12 21:22:28 +00003782\begin{ctypedesc}{PyFileObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003783This subtype of \ctype{PyObject} represents a Python file object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003784\end{ctypedesc}
3785
3786\begin{cvardesc}{PyTypeObject}{PyFile_Type}
Fred Drake659ebfa2000-04-03 15:42:13 +00003787This instance of \ctype{PyTypeObject} represents the Python file
3788type. This is exposed to Python programs as \code{types.FileType}.
3789\withsubitem{(in module types)}{\ttindex{FileType}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003790\end{cvardesc}
3791
3792\begin{cfuncdesc}{int}{PyFile_Check}{PyObject *p}
Fred Drakef8830d11998-04-23 14:06:01 +00003793Returns true if its argument is a \ctype{PyFileObject}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003794\end{cfuncdesc}
3795
Fred Drake659ebfa2000-04-03 15:42:13 +00003796\begin{cfuncdesc}{PyObject*}{PyFile_FromString}{char *filename, char *mode}
3797On success, returns a new file object that is opened on the
3798file given by \var{filename}, with a file mode given by \var{mode},
3799where \var{mode} has the same semantics as the standard C routine
3800\cfunction{fopen()}\ttindex{fopen()}. On failure, returns \NULL.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003801\end{cfuncdesc}
3802
Fred Drakec6fa34e1998-04-02 06:47:24 +00003803\begin{cfuncdesc}{PyObject*}{PyFile_FromFile}{FILE *fp,
Fred Drake659ebfa2000-04-03 15:42:13 +00003804 char *name, char *mode,
3805 int (*close)(FILE*)}
3806Creates a new \ctype{PyFileObject} from the already-open standard C
3807file pointer, \var{fp}. The function \var{close} will be called when
3808the file should be closed. Returns \NULL{} on failure.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003809\end{cfuncdesc}
3810
Fred Drake659ebfa2000-04-03 15:42:13 +00003811\begin{cfuncdesc}{FILE*}{PyFile_AsFile}{PyFileObject *p}
3812Returns the file object associated with \var{p} as a \ctype{FILE*}.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003813\end{cfuncdesc}
3814
Fred Drakec6fa34e1998-04-02 06:47:24 +00003815\begin{cfuncdesc}{PyObject*}{PyFile_GetLine}{PyObject *p, int n}
Fred Drake659ebfa2000-04-03 15:42:13 +00003816Equivalent to \code{\var{p}.readline(\optional{\var{n}})}, this
3817function reads one line from the object \var{p}. \var{p} may be a
3818file object or any object with a \method{readline()} method. If
3819\var{n} is \code{0}, exactly one line is read, regardless of the
3820length of the line. If \var{n} is greater than \code{0}, no more than
3821\var{n} bytes will be read from the file; a partial line can be
3822returned. In both cases, an empty string is returned if the end of
3823the file is reached immediately. If \var{n} is less than \code{0},
3824however, one line is read regardless of length, but
3825\exception{EOFError} is raised if the end of the file is reached
3826immediately.
3827\withsubitem{(built-in exception)}{\ttindex{EOFError}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003828\end{cfuncdesc}
3829
Fred Drakec6fa34e1998-04-02 06:47:24 +00003830\begin{cfuncdesc}{PyObject*}{PyFile_Name}{PyObject *p}
Fred Drake659ebfa2000-04-03 15:42:13 +00003831Returns the name of the file specified by \var{p} as a string object.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003832\end{cfuncdesc}
3833
3834\begin{cfuncdesc}{void}{PyFile_SetBufSize}{PyFileObject *p, int n}
Fred Drake659ebfa2000-04-03 15:42:13 +00003835Available on systems with \cfunction{setvbuf()}\ttindex{setvbuf()}
3836only. This should only be called immediately after file object
3837creation.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003838\end{cfuncdesc}
3839
Fred Drake659ebfa2000-04-03 15:42:13 +00003840\begin{cfuncdesc}{int}{PyFile_SoftSpace}{PyObject *p, int newflag}
3841This function exists for internal use by the interpreter.
3842Sets the \member{softspace} attribute of \var{p} to \var{newflag} and
3843\withsubitem{(file attribute)}{\ttindex{softspace}}returns the
3844previous value. \var{p} does not have to be a file object
3845for this function to work properly; any object is supported (thought
3846its only interesting if the \member{softspace} attribute can be set).
3847This function clears any errors, and will return \code{0} as the
3848previous value if the attribute either does not exist or if there were
3849errors in retrieving it. There is no way to detect errors from this
3850function, but doing so should not be needed.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003851\end{cfuncdesc}
3852
Fred Drakec6fa34e1998-04-02 06:47:24 +00003853\begin{cfuncdesc}{int}{PyFile_WriteObject}{PyObject *obj, PyFileObject *p,
3854 int flags}
Fred Drake659ebfa2000-04-03 15:42:13 +00003855Writes object \var{obj} to file object \var{p}. The only supported
3856flag for \var{flags} is \constant{Py_PRINT_RAW}\ttindex{Py_PRINT_RAW};
3857if given, the \function{str()} of the object is written instead of the
3858\function{repr()}. Returns \code{0} on success or \code{-1} on
3859failure; the appropriate exception will be set.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003860\end{cfuncdesc}
3861
Fred Drakec6fa34e1998-04-02 06:47:24 +00003862\begin{cfuncdesc}{int}{PyFile_WriteString}{char *s, PyFileObject *p,
3863 int flags}
Fred Drake659ebfa2000-04-03 15:42:13 +00003864Writes string \var{s} to file object \var{p}. Returns \code{0} on
3865success or \code{-1} on failure; the appropriate exception will be
3866set.
Fred Drakee5bf8b21998-02-12 21:22:28 +00003867\end{cfuncdesc}
3868
3869
Fred Drake5838d0f2001-01-28 06:39:35 +00003870\subsection{Instance Objects \label{instanceObjects}}
3871
3872\obindex{instance}
3873There are very few functions specific to instance objects.
3874
3875\begin{cvardesc}{PyTypeObject}{PyInstance_Type}
3876 Type object for class instances.
3877\end{cvardesc}
3878
3879\begin{cfuncdesc}{int}{PyInstance_Check}{PyObject *obj}
3880 Returns true if \var{obj} is an instance.
3881\end{cfuncdesc}
3882
3883\begin{cfuncdesc}{PyObject*}{PyInstance_New}{PyObject *class,
3884 PyObject *arg,
3885 PyObject *kw}
3886 Create a new instance of a specific class. The parameters \var{arg}
3887 and \var{kw} are used as the positional and keyword parameters to
3888 the object's constructor.
3889\end{cfuncdesc}
3890
3891\begin{cfuncdesc}{PyObject*}{PyInstance_NewRaw}{PyObject *class,
3892 PyObject *dict}
3893 Create a new instance of a specific class without calling it's
3894 constructor. \var{class} is the class of new object. The
3895 \var{dict} parameter will be used as the object's \member{__dict__};
3896 if \NULL, a new dictionary will be created for the instance.
3897\end{cfuncdesc}
3898
3899
Fred Drakeefd146c1999-02-15 15:30:45 +00003900\subsection{Module Objects \label{moduleObjects}}
3901
3902\obindex{module}
3903There are only a few functions special to module objects.
3904
Fred Drake659ebfa2000-04-03 15:42:13 +00003905\begin{cvardesc}{PyTypeObject}{PyModule_Type}
3906This instance of \ctype{PyTypeObject} represents the Python module
3907type. This is exposed to Python programs as \code{types.ModuleType}.
3908\withsubitem{(in module types)}{\ttindex{ModuleType}}
3909\end{cvardesc}
3910
3911\begin{cfuncdesc}{int}{PyModule_Check}{PyObject *p}
3912Returns true if its argument is a module object.
Fred Drakeefd146c1999-02-15 15:30:45 +00003913\end{cfuncdesc}
3914
Fred Drake659ebfa2000-04-03 15:42:13 +00003915\begin{cfuncdesc}{PyObject*}{PyModule_New}{char *name}
3916Return a new module object with the \member{__name__} attribute set to
3917\var{name}. Only the module's \member{__doc__} and
3918\member{__name__} attributes are filled in; the caller is responsible
3919for providing a \member{__file__} attribute.
3920\withsubitem{(module attribute)}{
3921 \ttindex{__name__}\ttindex{__doc__}\ttindex{__file__}}
3922\end{cfuncdesc}
3923
3924\begin{cfuncdesc}{PyObject*}{PyModule_GetDict}{PyObject *module}
Fred Drakeefd146c1999-02-15 15:30:45 +00003925Return the dictionary object that implements \var{module}'s namespace;
3926this object is the same as the \member{__dict__} attribute of the
3927module object. This function never fails.
Fred Drake659ebfa2000-04-03 15:42:13 +00003928\withsubitem{(module attribute)}{\ttindex{__dict__}}
Fred Drakeefd146c1999-02-15 15:30:45 +00003929\end{cfuncdesc}
3930
Fred Drake659ebfa2000-04-03 15:42:13 +00003931\begin{cfuncdesc}{char*}{PyModule_GetName}{PyObject *module}
Fred Drakeefd146c1999-02-15 15:30:45 +00003932Return \var{module}'s \member{__name__} value. If the module does not
Fred Drake659ebfa2000-04-03 15:42:13 +00003933provide one, or if it is not a string, \exception{SystemError} is
3934raised and \NULL{} is returned.
3935\withsubitem{(module attribute)}{\ttindex{__name__}}
3936\withsubitem{(built-in exception)}{\ttindex{SystemError}}
Fred Drakeefd146c1999-02-15 15:30:45 +00003937\end{cfuncdesc}
3938
Fred Drake659ebfa2000-04-03 15:42:13 +00003939\begin{cfuncdesc}{char*}{PyModule_GetFilename}{PyObject *module}
Fred Drakeefd146c1999-02-15 15:30:45 +00003940Return the name of the file from which \var{module} was loaded using
3941\var{module}'s \member{__file__} attribute. If this is not defined,
Fred Drake659ebfa2000-04-03 15:42:13 +00003942or if it is not a string, raise \exception{SystemError} and return
3943\NULL.
3944\withsubitem{(module attribute)}{\ttindex{__file__}}
3945\withsubitem{(built-in exception)}{\ttindex{SystemError}}
Fred Drakeefd146c1999-02-15 15:30:45 +00003946\end{cfuncdesc}
3947
Fred Drake891150b2000-09-23 03:25:42 +00003948\begin{cfuncdesc}{int}{PyModule_AddObject}{PyObject *module,
3949 char *name, PyObject *value}
3950Add an object to \var{module} as \var{name}. This is a convenience
3951function which can be used from the module's initialization function.
3952This steals a reference to \var{value}. Returns \code{-1} on error,
3953\code{0} on success.
3954\versionadded{2.0}
3955\end{cfuncdesc}
3956
3957\begin{cfuncdesc}{int}{PyModule_AddIntConstant}{PyObject *module,
3958 char *name, int value}
3959Add an integer constant to \var{module} as \var{name}. This convenience
3960function can be used from the module's initialization function.
3961Returns \code{-1} on error, \code{0} on success.
3962\versionadded{2.0}
3963\end{cfuncdesc}
3964
3965\begin{cfuncdesc}{int}{PyModule_AddStringConstant}{PyObject *module,
3966 char *name, char *value}
3967Add a string constant to \var{module} as \var{name}. This convenience
3968function can be used from the module's initialization function. The
3969string \var{value} must be null-terminated. Returns \code{-1} on
3970error, \code{0} on success.
3971\versionadded{2.0}
3972\end{cfuncdesc}
3973
Fred Drakeefd146c1999-02-15 15:30:45 +00003974
3975\subsection{CObjects \label{cObjects}}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003976
Fred Drake659ebfa2000-04-03 15:42:13 +00003977\obindex{CObject}
3978Refer to \emph{Extending and Embedding the Python Interpreter},
3979section 1.12 (``Providing a C API for an Extension Module''), for more
3980information on using these objects.
3981
3982
Guido van Rossum44475131998-04-21 15:30:01 +00003983\begin{ctypedesc}{PyCObject}
Fred Drakef8830d11998-04-23 14:06:01 +00003984This subtype of \ctype{PyObject} represents an opaque value, useful for
Fred Drake659ebfa2000-04-03 15:42:13 +00003985C extension modules who need to pass an opaque value (as a
3986\ctype{void*} pointer) through Python code to other C code. It is
Guido van Rossum44475131998-04-21 15:30:01 +00003987often used to make a C function pointer defined in one module
3988available to other modules, so the regular import mechanism can be
3989used to access C APIs defined in dynamically loaded modules.
3990\end{ctypedesc}
Fred Drakee5bf8b21998-02-12 21:22:28 +00003991
Fred Drake659ebfa2000-04-03 15:42:13 +00003992\begin{cfuncdesc}{int}{PyCObject_Check}{PyObject *p}
3993Returns true if its argument is a \ctype{PyCObject}.
3994\end{cfuncdesc}
3995
3996\begin{cfuncdesc}{PyObject*}{PyCObject_FromVoidPtr}{void* cobj,
Marc-André Lemburga544ea22001-01-17 18:04:31 +00003997 void (*destr)(void *)}
Fred Drake1d158692000-06-18 05:21:21 +00003998Creates a \ctype{PyCObject} from the \code{void *}\var{cobj}. The
Fred Drakedab44681999-05-13 18:41:14 +00003999\var{destr} function will be called when the object is reclaimed, unless
4000it is \NULL.
Guido van Rossum44475131998-04-21 15:30:01 +00004001\end{cfuncdesc}
4002
Fred Drake659ebfa2000-04-03 15:42:13 +00004003\begin{cfuncdesc}{PyObject*}{PyCObject_FromVoidPtrAndDesc}{void* cobj,
Marc-André Lemburga544ea22001-01-17 18:04:31 +00004004 void* desc, void (*destr)(void *, void *) }
Fred Drakef8830d11998-04-23 14:06:01 +00004005Creates a \ctype{PyCObject} from the \ctype{void *}\var{cobj}. The
4006\var{destr} function will be called when the object is reclaimed. The
4007\var{desc} argument can be used to pass extra callback data for the
4008destructor function.
Guido van Rossum44475131998-04-21 15:30:01 +00004009\end{cfuncdesc}
4010
Fred Drake659ebfa2000-04-03 15:42:13 +00004011\begin{cfuncdesc}{void*}{PyCObject_AsVoidPtr}{PyObject* self}
4012Returns the object \ctype{void *} that the
4013\ctype{PyCObject} \var{self} was created with.
Guido van Rossum44475131998-04-21 15:30:01 +00004014\end{cfuncdesc}
4015
Fred Drake659ebfa2000-04-03 15:42:13 +00004016\begin{cfuncdesc}{void*}{PyCObject_GetDesc}{PyObject* self}
4017Returns the description \ctype{void *} that the
4018\ctype{PyCObject} \var{self} was created with.
Guido van Rossum44475131998-04-21 15:30:01 +00004019\end{cfuncdesc}
Fred Drakee5bf8b21998-02-12 21:22:28 +00004020
Fred Drake659ebfa2000-04-03 15:42:13 +00004021
Fred Drakeefd146c1999-02-15 15:30:45 +00004022\chapter{Initialization, Finalization, and Threads
4023 \label{initialization}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004024
Guido van Rossum4a944d71997-08-14 20:35:38 +00004025\begin{cfuncdesc}{void}{Py_Initialize}{}
4026Initialize the Python interpreter. In an application embedding
4027Python, this should be called before using any other Python/C API
Fred Drake659ebfa2000-04-03 15:42:13 +00004028functions; with the exception of
4029\cfunction{Py_SetProgramName()}\ttindex{Py_SetProgramName()},
4030\cfunction{PyEval_InitThreads()}\ttindex{PyEval_InitThreads()},
4031\cfunction{PyEval_ReleaseLock()}\ttindex{PyEval_ReleaseLock()},
4032and \cfunction{PyEval_AcquireLock()}\ttindex{PyEval_AcquireLock()}.
4033This initializes the table of loaded modules (\code{sys.modules}), and
4034\withsubitem{(in module sys)}{\ttindex{modules}\ttindex{path}}creates the
4035fundamental modules \module{__builtin__}\refbimodindex{__builtin__},
Fred Drake4de05a91998-02-16 14:25:26 +00004036\module{__main__}\refbimodindex{__main__} and
4037\module{sys}\refbimodindex{sys}. It also initializes the module
Fred Drake659ebfa2000-04-03 15:42:13 +00004038search\indexiii{module}{search}{path} path (\code{sys.path}).
4039It does not set \code{sys.argv}; use
4040\cfunction{PySys_SetArgv()}\ttindex{PySys_SetArgv()} for that. This
4041is a no-op when called for a second time (without calling
4042\cfunction{Py_Finalize()}\ttindex{Py_Finalize()} first). There is no
4043return value; it is a fatal error if the initialization fails.
Guido van Rossum42cefd01997-10-05 15:27:29 +00004044\end{cfuncdesc}
4045
4046\begin{cfuncdesc}{int}{Py_IsInitialized}{}
Guido van Rossum42cefd01997-10-05 15:27:29 +00004047Return true (nonzero) when the Python interpreter has been
Fred Drakee058b4f1998-02-16 06:15:35 +00004048initialized, false (zero) if not. After \cfunction{Py_Finalize()} is
4049called, this returns false until \cfunction{Py_Initialize()} is called
Guido van Rossum42cefd01997-10-05 15:27:29 +00004050again.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004051\end{cfuncdesc}
4052
4053\begin{cfuncdesc}{void}{Py_Finalize}{}
Fred Drakee058b4f1998-02-16 06:15:35 +00004054Undo all initializations made by \cfunction{Py_Initialize()} and
4055subsequent use of Python/C API functions, and destroy all
4056sub-interpreters (see \cfunction{Py_NewInterpreter()} below) that were
4057created and not yet destroyed since the last call to
4058\cfunction{Py_Initialize()}. Ideally, this frees all memory allocated
4059by the Python interpreter. This is a no-op when called for a second
4060time (without calling \cfunction{Py_Initialize()} again first). There
4061is no return value; errors during finalization are ignored.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004062
4063This function is provided for a number of reasons. An embedding
4064application might want to restart Python without having to restart the
4065application itself. An application that has loaded the Python
4066interpreter from a dynamically loadable library (or DLL) might want to
4067free all memory allocated by Python before unloading the DLL. During a
4068hunt for memory leaks in an application a developer might want to free
4069all memory allocated by Python before exiting from the application.
4070
Fred Drakee058b4f1998-02-16 06:15:35 +00004071\strong{Bugs and caveats:} The destruction of modules and objects in
Guido van Rossum4a944d71997-08-14 20:35:38 +00004072modules is done in random order; this may cause destructors
Fred Drakee058b4f1998-02-16 06:15:35 +00004073(\method{__del__()} methods) to fail when they depend on other objects
Guido van Rossum4a944d71997-08-14 20:35:38 +00004074(even functions) or modules. Dynamically loaded extension modules
4075loaded by Python are not unloaded. Small amounts of memory allocated
4076by the Python interpreter may not be freed (if you find a leak, please
4077report it). Memory tied up in circular references between objects is
4078not freed. Some memory allocated by extension modules may not be
4079freed. Some extension may not work properly if their initialization
4080routine is called more than once; this can happen if an applcation
Fred Drakee058b4f1998-02-16 06:15:35 +00004081calls \cfunction{Py_Initialize()} and \cfunction{Py_Finalize()} more
4082than once.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004083\end{cfuncdesc}
4084
Fred Drakec6fa34e1998-04-02 06:47:24 +00004085\begin{cfuncdesc}{PyThreadState*}{Py_NewInterpreter}{}
Fred Drake4de05a91998-02-16 14:25:26 +00004086Create a new sub-interpreter. This is an (almost) totally separate
4087environment for the execution of Python code. In particular, the new
4088interpreter has separate, independent versions of all imported
4089modules, including the fundamental modules
4090\module{__builtin__}\refbimodindex{__builtin__},
4091\module{__main__}\refbimodindex{__main__} and
4092\module{sys}\refbimodindex{sys}. The table of loaded modules
4093(\code{sys.modules}) and the module search path (\code{sys.path}) are
4094also separate. The new environment has no \code{sys.argv} variable.
4095It has new standard I/O stream file objects \code{sys.stdin},
4096\code{sys.stdout} and \code{sys.stderr} (however these refer to the
Fred Drake659ebfa2000-04-03 15:42:13 +00004097same underlying \ctype{FILE} structures in the C library).
4098\withsubitem{(in module sys)}{
4099 \ttindex{stdout}\ttindex{stderr}\ttindex{stdin}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004100
4101The return value points to the first thread state created in the new
4102sub-interpreter. This thread state is made the current thread state.
4103Note that no actual thread is created; see the discussion of thread
4104states below. If creation of the new interpreter is unsuccessful,
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004105\NULL{} is returned; no exception is set since the exception state
Guido van Rossum4a944d71997-08-14 20:35:38 +00004106is stored in the current thread state and there may not be a current
4107thread state. (Like all other Python/C API functions, the global
4108interpreter lock must be held before calling this function and is
4109still held when it returns; however, unlike most other Python/C API
4110functions, there needn't be a current thread state on entry.)
4111
4112Extension modules are shared between (sub-)interpreters as follows:
4113the first time a particular extension is imported, it is initialized
4114normally, and a (shallow) copy of its module's dictionary is
4115squirreled away. When the same extension is imported by another
4116(sub-)interpreter, a new module is initialized and filled with the
Fred Drakee058b4f1998-02-16 06:15:35 +00004117contents of this copy; the extension's \code{init} function is not
4118called. Note that this is different from what happens when an
4119extension is imported after the interpreter has been completely
Fred Drake659ebfa2000-04-03 15:42:13 +00004120re-initialized by calling
4121\cfunction{Py_Finalize()}\ttindex{Py_Finalize()} and
4122\cfunction{Py_Initialize()}\ttindex{Py_Initialize()}; in that case,
4123the extension's \code{init\var{module}} function \emph{is} called
4124again.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004125
Fred Drakee058b4f1998-02-16 06:15:35 +00004126\strong{Bugs and caveats:} Because sub-interpreters (and the main
Guido van Rossum4a944d71997-08-14 20:35:38 +00004127interpreter) are part of the same process, the insulation between them
Fred Drakee058b4f1998-02-16 06:15:35 +00004128isn't perfect --- for example, using low-level file operations like
Fred Drake659ebfa2000-04-03 15:42:13 +00004129\withsubitem{(in module os)}{\ttindex{close()}}
Fred Drakef8830d11998-04-23 14:06:01 +00004130\function{os.close()} they can (accidentally or maliciously) affect each
Guido van Rossum4a944d71997-08-14 20:35:38 +00004131other's open files. Because of the way extensions are shared between
4132(sub-)interpreters, some extensions may not work properly; this is
4133especially likely when the extension makes use of (static) global
4134variables, or when the extension manipulates its module's dictionary
4135after its initialization. It is possible to insert objects created in
4136one sub-interpreter into a namespace of another sub-interpreter; this
4137should be done with great care to avoid sharing user-defined
4138functions, methods, instances or classes between sub-interpreters,
4139since import operations executed by such objects may affect the
4140wrong (sub-)interpreter's dictionary of loaded modules. (XXX This is
4141a hard-to-fix bug that will be addressed in a future release.)
4142\end{cfuncdesc}
4143
4144\begin{cfuncdesc}{void}{Py_EndInterpreter}{PyThreadState *tstate}
4145Destroy the (sub-)interpreter represented by the given thread state.
4146The given thread state must be the current thread state. See the
4147discussion of thread states below. When the call returns, the current
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004148thread state is \NULL{}. All thread states associated with this
Guido van Rossum4a944d71997-08-14 20:35:38 +00004149interpreted are destroyed. (The global interpreter lock must be held
4150before calling this function and is still held when it returns.)
Fred Drake659ebfa2000-04-03 15:42:13 +00004151\cfunction{Py_Finalize()}\ttindex{Py_Finalize()} will destroy all
4152sub-interpreters that haven't been explicitly destroyed at that point.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004153\end{cfuncdesc}
4154
4155\begin{cfuncdesc}{void}{Py_SetProgramName}{char *name}
Fred Drake659ebfa2000-04-03 15:42:13 +00004156This function should be called before
4157\cfunction{Py_Initialize()}\ttindex{Py_Initialize()} is called
Guido van Rossum4a944d71997-08-14 20:35:38 +00004158for the first time, if it is called at all. It tells the interpreter
Fred Drake659ebfa2000-04-03 15:42:13 +00004159the value of the \code{argv[0]} argument to the
4160\cfunction{main()}\ttindex{main()} function of the program. This is
4161used by \cfunction{Py_GetPath()}\ttindex{Py_GetPath()} and some other
Guido van Rossum4a944d71997-08-14 20:35:38 +00004162functions below to find the Python run-time libraries relative to the
Fred Drakea8455ab2000-06-16 19:58:42 +00004163interpreter executable. The default value is \code{'python'}. The
Guido van Rossum4a944d71997-08-14 20:35:38 +00004164argument should point to a zero-terminated character string in static
4165storage whose contents will not change for the duration of the
4166program's execution. No code in the Python interpreter will change
4167the contents of this storage.
4168\end{cfuncdesc}
4169
Fred Drakec6fa34e1998-04-02 06:47:24 +00004170\begin{cfuncdesc}{char*}{Py_GetProgramName}{}
Fred Drake659ebfa2000-04-03 15:42:13 +00004171Return the program name set with
4172\cfunction{Py_SetProgramName()}\ttindex{Py_SetProgramName()}, or the
Guido van Rossum4a944d71997-08-14 20:35:38 +00004173default. The returned string points into static storage; the caller
4174should not modify its value.
4175\end{cfuncdesc}
4176
Fred Drakec6fa34e1998-04-02 06:47:24 +00004177\begin{cfuncdesc}{char*}{Py_GetPrefix}{}
Fred Drakee058b4f1998-02-16 06:15:35 +00004178Return the \emph{prefix} for installed platform-independent files. This
Guido van Rossum4a944d71997-08-14 20:35:38 +00004179is derived through a number of complicated rules from the program name
Fred Drakee058b4f1998-02-16 06:15:35 +00004180set with \cfunction{Py_SetProgramName()} and some environment variables;
Fred Drakea8455ab2000-06-16 19:58:42 +00004181for example, if the program name is \code{'/usr/local/bin/python'},
4182the prefix is \code{'/usr/local'}. The returned string points into
Guido van Rossum4a944d71997-08-14 20:35:38 +00004183static storage; the caller should not modify its value. This
Fred Drakec94d9341998-04-12 02:39:13 +00004184corresponds to the \makevar{prefix} variable in the top-level
Fred Drakea8455ab2000-06-16 19:58:42 +00004185\file{Makefile} and the \longprogramopt{prefix} argument to the
Fred Drakee058b4f1998-02-16 06:15:35 +00004186\program{configure} script at build time. The value is available to
Fred Drakeb0a78731998-01-13 18:51:10 +00004187Python code as \code{sys.prefix}. It is only useful on \UNIX{}. See
Guido van Rossum4a944d71997-08-14 20:35:38 +00004188also the next function.
4189\end{cfuncdesc}
4190
Fred Drakec6fa34e1998-04-02 06:47:24 +00004191\begin{cfuncdesc}{char*}{Py_GetExecPrefix}{}
Fred Drakee058b4f1998-02-16 06:15:35 +00004192Return the \emph{exec-prefix} for installed platform-\emph{de}pendent
Guido van Rossum4a944d71997-08-14 20:35:38 +00004193files. This is derived through a number of complicated rules from the
Fred Drakee058b4f1998-02-16 06:15:35 +00004194program name set with \cfunction{Py_SetProgramName()} and some environment
Guido van Rossum4a944d71997-08-14 20:35:38 +00004195variables; for example, if the program name is
Fred Drakea8455ab2000-06-16 19:58:42 +00004196\code{'/usr/local/bin/python'}, the exec-prefix is
4197\code{'/usr/local'}. The returned string points into static storage;
Guido van Rossum4a944d71997-08-14 20:35:38 +00004198the caller should not modify its value. This corresponds to the
Fred Drakec94d9341998-04-12 02:39:13 +00004199\makevar{exec_prefix} variable in the top-level \file{Makefile} and the
Fred Drakea8455ab2000-06-16 19:58:42 +00004200\longprogramopt{exec-prefix} argument to the
Fred Drake310ee611999-11-09 17:31:42 +00004201\program{configure} script at build time. The value is available to
4202Python code as \code{sys.exec_prefix}. It is only useful on \UNIX{}.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004203
4204Background: The exec-prefix differs from the prefix when platform
4205dependent files (such as executables and shared libraries) are
4206installed in a different directory tree. In a typical installation,
4207platform dependent files may be installed in the
Fred Drakea8455ab2000-06-16 19:58:42 +00004208\file{/usr/local/plat} subtree while platform independent may be
4209installed in \file{/usr/local}.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004210
4211Generally speaking, a platform is a combination of hardware and
4212software families, e.g. Sparc machines running the Solaris 2.x
4213operating system are considered the same platform, but Intel machines
4214running Solaris 2.x are another platform, and Intel machines running
4215Linux are yet another platform. Different major revisions of the same
Fred Drakeb0a78731998-01-13 18:51:10 +00004216operating system generally also form different platforms. Non-\UNIX{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004217operating systems are a different story; the installation strategies
4218on those systems are so different that the prefix and exec-prefix are
4219meaningless, and set to the empty string. Note that compiled Python
4220bytecode files are platform independent (but not independent from the
4221Python version by which they were compiled!).
4222
Fred Drakee058b4f1998-02-16 06:15:35 +00004223System administrators will know how to configure the \program{mount} or
Fred Drakea8455ab2000-06-16 19:58:42 +00004224\program{automount} programs to share \file{/usr/local} between platforms
4225while having \file{/usr/local/plat} be a different filesystem for each
Guido van Rossum4a944d71997-08-14 20:35:38 +00004226platform.
4227\end{cfuncdesc}
4228
Fred Drakec6fa34e1998-04-02 06:47:24 +00004229\begin{cfuncdesc}{char*}{Py_GetProgramFullPath}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004230Return the full program name of the Python executable; this is
4231computed as a side-effect of deriving the default module search path
Fred Drake659ebfa2000-04-03 15:42:13 +00004232from the program name (set by
4233\cfunction{Py_SetProgramName()}\ttindex{Py_SetProgramName()} above).
4234The returned string points into static storage; the caller should not
Guido van Rossum4a944d71997-08-14 20:35:38 +00004235modify its value. The value is available to Python code as
Guido van Rossum42cefd01997-10-05 15:27:29 +00004236\code{sys.executable}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004237\withsubitem{(in module sys)}{\ttindex{executable}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004238\end{cfuncdesc}
4239
Fred Drakec6fa34e1998-04-02 06:47:24 +00004240\begin{cfuncdesc}{char*}{Py_GetPath}{}
Fred Drake4de05a91998-02-16 14:25:26 +00004241\indexiii{module}{search}{path}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004242Return the default module search path; this is computed from the
Fred Drakee058b4f1998-02-16 06:15:35 +00004243program name (set by \cfunction{Py_SetProgramName()} above) and some
Guido van Rossum4a944d71997-08-14 20:35:38 +00004244environment variables. The returned string consists of a series of
4245directory names separated by a platform dependent delimiter character.
Fred Drakef8830d11998-04-23 14:06:01 +00004246The delimiter character is \character{:} on \UNIX{}, \character{;} on
Fred Drake659ebfa2000-04-03 15:42:13 +00004247DOS/Windows, and \character{\e n} (the \ASCII{} newline character) on
Fred Drakee5bc4971998-02-12 23:36:49 +00004248Macintosh. The returned string points into static storage; the caller
Guido van Rossum4a944d71997-08-14 20:35:38 +00004249should not modify its value. The value is available to Python code
Fred Drake659ebfa2000-04-03 15:42:13 +00004250as the list \code{sys.path}\withsubitem{(in module sys)}{\ttindex{path}},
4251which may be modified to change the future search path for loaded
4252modules.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004253
4254% XXX should give the exact rules
4255\end{cfuncdesc}
4256
Fred Drakec6fa34e1998-04-02 06:47:24 +00004257\begin{cfuncdesc}{const char*}{Py_GetVersion}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004258Return the version of this Python interpreter. This is a string that
4259looks something like
4260
Guido van Rossum09270b51997-08-15 18:57:32 +00004261\begin{verbatim}
Fred Drakee058b4f1998-02-16 06:15:35 +00004262"1.5 (#67, Dec 31 1997, 22:34:28) [GCC 2.7.2.2]"
Guido van Rossum09270b51997-08-15 18:57:32 +00004263\end{verbatim}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004264
4265The first word (up to the first space character) is the current Python
4266version; the first three characters are the major and minor version
4267separated by a period. The returned string points into static storage;
4268the caller should not modify its value. The value is available to
4269Python code as the list \code{sys.version}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004270\withsubitem{(in module sys)}{\ttindex{version}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004271\end{cfuncdesc}
4272
Fred Drakec6fa34e1998-04-02 06:47:24 +00004273\begin{cfuncdesc}{const char*}{Py_GetPlatform}{}
Fred Drakeb0a78731998-01-13 18:51:10 +00004274Return the platform identifier for the current platform. On \UNIX{},
Guido van Rossum4a944d71997-08-14 20:35:38 +00004275this is formed from the ``official'' name of the operating system,
4276converted to lower case, followed by the major revision number; e.g.,
4277for Solaris 2.x, which is also known as SunOS 5.x, the value is
Fred Drakea8455ab2000-06-16 19:58:42 +00004278\code{'sunos5'}. On Macintosh, it is \code{'mac'}. On Windows, it
4279is \code{'win'}. The returned string points into static storage;
Guido van Rossum4a944d71997-08-14 20:35:38 +00004280the caller should not modify its value. The value is available to
4281Python code as \code{sys.platform}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004282\withsubitem{(in module sys)}{\ttindex{platform}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004283\end{cfuncdesc}
4284
Fred Drakec6fa34e1998-04-02 06:47:24 +00004285\begin{cfuncdesc}{const char*}{Py_GetCopyright}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004286Return the official copyright string for the current Python version,
4287for example
4288
Fred Drakea8455ab2000-06-16 19:58:42 +00004289\code{'Copyright 1991-1995 Stichting Mathematisch Centrum, Amsterdam'}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004290
4291The returned string points into static storage; the caller should not
4292modify its value. The value is available to Python code as the list
4293\code{sys.copyright}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004294\withsubitem{(in module sys)}{\ttindex{copyright}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004295\end{cfuncdesc}
4296
Fred Drakec6fa34e1998-04-02 06:47:24 +00004297\begin{cfuncdesc}{const char*}{Py_GetCompiler}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004298Return an indication of the compiler used to build the current Python
Fred Drakee058b4f1998-02-16 06:15:35 +00004299version, in square brackets, for example:
Guido van Rossum4a944d71997-08-14 20:35:38 +00004300
Fred Drakee058b4f1998-02-16 06:15:35 +00004301\begin{verbatim}
4302"[GCC 2.7.2.2]"
4303\end{verbatim}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004304
4305The returned string points into static storage; the caller should not
4306modify its value. The value is available to Python code as part of
4307the variable \code{sys.version}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004308\withsubitem{(in module sys)}{\ttindex{version}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004309\end{cfuncdesc}
4310
Fred Drakec6fa34e1998-04-02 06:47:24 +00004311\begin{cfuncdesc}{const char*}{Py_GetBuildInfo}{}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004312Return information about the sequence number and build date and time
4313of the current Python interpreter instance, for example
4314
Guido van Rossum09270b51997-08-15 18:57:32 +00004315\begin{verbatim}
4316"#67, Aug 1 1997, 22:34:28"
4317\end{verbatim}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004318
4319The returned string points into static storage; the caller should not
4320modify its value. The value is available to Python code as part of
4321the variable \code{sys.version}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004322\withsubitem{(in module sys)}{\ttindex{version}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004323\end{cfuncdesc}
4324
4325\begin{cfuncdesc}{int}{PySys_SetArgv}{int argc, char **argv}
Fred Drake659ebfa2000-04-03 15:42:13 +00004326Set \code{sys.argv} based on \var{argc} and \var{argv}. These
4327parameters are similar to those passed to the program's
4328\cfunction{main()}\ttindex{main()} function with the difference that
4329the first entry should refer to the script file to be executed rather
4330than the executable hosting the Python interpreter. If there isn't a
4331script that will be run, the first entry in \var{argv} can be an empty
4332string. If this function fails to initialize \code{sys.argv}, a fatal
4333condition is signalled using
4334\cfunction{Py_FatalError()}\ttindex{Py_FatalError()}.
4335\withsubitem{(in module sys)}{\ttindex{argv}}
4336% XXX impl. doesn't seem consistent in allowing 0/NULL for the params;
4337% check w/ Guido.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004338\end{cfuncdesc}
4339
4340% XXX Other PySys thingies (doesn't really belong in this chapter)
4341
Fred Drakeefd146c1999-02-15 15:30:45 +00004342\section{Thread State and the Global Interpreter Lock
4343 \label{threads}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004344
Fred Drake659ebfa2000-04-03 15:42:13 +00004345\index{global interpreter lock}
4346\index{interpreter lock}
4347\index{lock, interpreter}
4348
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004349The Python interpreter is not fully thread safe. In order to support
4350multi-threaded Python programs, there's a global lock that must be
4351held by the current thread before it can safely access Python objects.
4352Without the lock, even the simplest operations could cause problems in
Fred Drake7baf3d41998-02-20 00:45:52 +00004353a multi-threaded program: for example, when two threads simultaneously
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004354increment the reference count of the same object, the reference count
4355could end up being incremented only once instead of twice.
4356
4357Therefore, the rule exists that only the thread that has acquired the
4358global interpreter lock may operate on Python objects or call Python/C
4359API functions. In order to support multi-threaded Python programs,
Fred Drake659ebfa2000-04-03 15:42:13 +00004360the interpreter regularly releases and reacquires the lock --- by
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004361default, every ten bytecode instructions (this can be changed with
Fred Drake659ebfa2000-04-03 15:42:13 +00004362\withsubitem{(in module sys)}{\ttindex{setcheckinterval()}}
Fred Drakee058b4f1998-02-16 06:15:35 +00004363\function{sys.setcheckinterval()}). The lock is also released and
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004364reacquired around potentially blocking I/O operations like reading or
4365writing a file, so that other threads can run while the thread that
4366requests the I/O is waiting for the I/O operation to complete.
4367
4368The Python interpreter needs to keep some bookkeeping information
Fred Drakee058b4f1998-02-16 06:15:35 +00004369separate per thread --- for this it uses a data structure called
Fred Drake659ebfa2000-04-03 15:42:13 +00004370\ctype{PyThreadState}\ttindex{PyThreadState}. This is new in Python
43711.5; in earlier versions, such state was stored in global variables,
4372and switching threads could cause problems. In particular, exception
4373handling is now thread safe, when the application uses
4374\withsubitem{(in module sys)}{\ttindex{exc_info()}}
4375\function{sys.exc_info()} to access the exception last raised in the
4376current thread.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004377
4378There's one global variable left, however: the pointer to the current
Fred Drake659ebfa2000-04-03 15:42:13 +00004379\ctype{PyThreadState}\ttindex{PyThreadState} structure. While most
4380thread packages have a way to store ``per-thread global data,''
4381Python's internal platform independent thread abstraction doesn't
4382support this yet. Therefore, the current thread state must be
4383manipulated explicitly.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004384
4385This is easy enough in most cases. Most code manipulating the global
4386interpreter lock has the following simple structure:
4387
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004388\begin{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004389Save the thread state in a local variable.
4390Release the interpreter lock.
4391...Do some blocking I/O operation...
4392Reacquire the interpreter lock.
4393Restore the thread state from the local variable.
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004394\end{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004395
4396This is so common that a pair of macros exists to simplify it:
4397
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004398\begin{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004399Py_BEGIN_ALLOW_THREADS
4400...Do some blocking I/O operation...
4401Py_END_ALLOW_THREADS
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004402\end{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004403
Fred Drake659ebfa2000-04-03 15:42:13 +00004404The \code{Py_BEGIN_ALLOW_THREADS}\ttindex{Py_BEGIN_ALLOW_THREADS} macro
4405opens a new block and declares a hidden local variable; the
4406\code{Py_END_ALLOW_THREADS}\ttindex{Py_END_ALLOW_THREADS} macro closes
Fred Drakee058b4f1998-02-16 06:15:35 +00004407the block. Another advantage of using these two macros is that when
4408Python is compiled without thread support, they are defined empty,
4409thus saving the thread state and lock manipulations.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004410
4411When thread support is enabled, the block above expands to the
4412following code:
4413
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004414\begin{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004415 PyThreadState *_save;
Fred Drake659ebfa2000-04-03 15:42:13 +00004416
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004417 _save = PyEval_SaveThread();
4418 ...Do some blocking I/O operation...
4419 PyEval_RestoreThread(_save);
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004420\end{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004421
4422Using even lower level primitives, we can get roughly the same effect
4423as follows:
4424
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004425\begin{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004426 PyThreadState *_save;
Fred Drake659ebfa2000-04-03 15:42:13 +00004427
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004428 _save = PyThreadState_Swap(NULL);
4429 PyEval_ReleaseLock();
4430 ...Do some blocking I/O operation...
4431 PyEval_AcquireLock();
4432 PyThreadState_Swap(_save);
Guido van Rossum9faf4c51997-10-07 14:38:54 +00004433\end{verbatim}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004434
4435There are some subtle differences; in particular,
Fred Drake659ebfa2000-04-03 15:42:13 +00004436\cfunction{PyEval_RestoreThread()}\ttindex{PyEval_RestoreThread()} saves
4437and restores the value of the global variable
4438\cdata{errno}\ttindex{errno}, since the lock manipulation does not
Fred Drakef8830d11998-04-23 14:06:01 +00004439guarantee that \cdata{errno} is left alone. Also, when thread support
Fred Drake659ebfa2000-04-03 15:42:13 +00004440is disabled,
4441\cfunction{PyEval_SaveThread()}\ttindex{PyEval_SaveThread()} and
Fred Drakee058b4f1998-02-16 06:15:35 +00004442\cfunction{PyEval_RestoreThread()} don't manipulate the lock; in this
Fred Drake659ebfa2000-04-03 15:42:13 +00004443case, \cfunction{PyEval_ReleaseLock()}\ttindex{PyEval_ReleaseLock()} and
4444\cfunction{PyEval_AcquireLock()}\ttindex{PyEval_AcquireLock()} are not
4445available. This is done so that dynamically loaded extensions
4446compiled with thread support enabled can be loaded by an interpreter
4447that was compiled with disabled thread support.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004448
4449The global interpreter lock is used to protect the pointer to the
4450current thread state. When releasing the lock and saving the thread
4451state, the current thread state pointer must be retrieved before the
4452lock is released (since another thread could immediately acquire the
4453lock and store its own thread state in the global variable).
Fred Drakeffe58ca2000-09-29 17:31:54 +00004454Conversely, when acquiring the lock and restoring the thread state,
4455the lock must be acquired before storing the thread state pointer.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004456
4457Why am I going on with so much detail about this? Because when
Fred Drake659ebfa2000-04-03 15:42:13 +00004458threads are created from C, they don't have the global interpreter
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004459lock, nor is there a thread state data structure for them. Such
4460threads must bootstrap themselves into existence, by first creating a
4461thread state data structure, then acquiring the lock, and finally
4462storing their thread state pointer, before they can start using the
4463Python/C API. When they are done, they should reset the thread state
4464pointer, release the lock, and finally free their thread state data
4465structure.
4466
4467When creating a thread data structure, you need to provide an
4468interpreter state data structure. The interpreter state data
4469structure hold global data that is shared by all threads in an
4470interpreter, for example the module administration
4471(\code{sys.modules}). Depending on your needs, you can either create
4472a new interpreter state data structure, or share the interpreter state
4473data structure used by the Python main thread (to access the latter,
Fred Drakef8830d11998-04-23 14:06:01 +00004474you must obtain the thread state and access its \member{interp} member;
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004475this must be done by a thread that is created by Python or by the main
4476thread after Python is initialized).
4477
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004478
4479\begin{ctypedesc}{PyInterpreterState}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004480This data structure represents the state shared by a number of
4481cooperating threads. Threads belonging to the same interpreter
4482share their module administration and a few other internal items.
4483There are no public members in this structure.
4484
4485Threads belonging to different interpreters initially share nothing,
4486except process state like available memory, open file descriptors and
4487such. The global interpreter lock is also shared by all threads,
4488regardless of to which interpreter they belong.
4489\end{ctypedesc}
4490
4491\begin{ctypedesc}{PyThreadState}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004492This data structure represents the state of a single thread. The only
Fred Drakef8830d11998-04-23 14:06:01 +00004493public data member is \ctype{PyInterpreterState *}\member{interp},
4494which points to this thread's interpreter state.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004495\end{ctypedesc}
4496
4497\begin{cfuncdesc}{void}{PyEval_InitThreads}{}
4498Initialize and acquire the global interpreter lock. It should be
4499called in the main thread before creating a second thread or engaging
Fred Drakee058b4f1998-02-16 06:15:35 +00004500in any other thread operations such as
Fred Drake659ebfa2000-04-03 15:42:13 +00004501\cfunction{PyEval_ReleaseLock()}\ttindex{PyEval_ReleaseLock()} or
4502\code{PyEval_ReleaseThread(\var{tstate})}\ttindex{PyEval_ReleaseThread()}.
4503It is not needed before calling
4504\cfunction{PyEval_SaveThread()}\ttindex{PyEval_SaveThread()} or
4505\cfunction{PyEval_RestoreThread()}\ttindex{PyEval_RestoreThread()}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004506
4507This is a no-op when called for a second time. It is safe to call
Fred Drake659ebfa2000-04-03 15:42:13 +00004508this function before calling
4509\cfunction{Py_Initialize()}\ttindex{Py_Initialize()}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004510
4511When only the main thread exists, no lock operations are needed. This
4512is a common situation (most Python programs do not use threads), and
4513the lock operations slow the interpreter down a bit. Therefore, the
4514lock is not created initially. This situation is equivalent to having
4515acquired the lock: when there is only a single thread, all object
4516accesses are safe. Therefore, when this function initializes the
Fred Drake4de05a91998-02-16 14:25:26 +00004517lock, it also acquires it. Before the Python
4518\module{thread}\refbimodindex{thread} module creates a new thread,
4519knowing that either it has the lock or the lock hasn't been created
4520yet, it calls \cfunction{PyEval_InitThreads()}. When this call
4521returns, it is guaranteed that the lock has been created and that it
4522has acquired it.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004523
4524It is \strong{not} safe to call this function when it is unknown which
4525thread (if any) currently has the global interpreter lock.
4526
4527This function is not available when thread support is disabled at
4528compile time.
4529\end{cfuncdesc}
4530
Guido van Rossum4a944d71997-08-14 20:35:38 +00004531\begin{cfuncdesc}{void}{PyEval_AcquireLock}{}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004532Acquire the global interpreter lock. The lock must have been created
4533earlier. If this thread already has the lock, a deadlock ensues.
4534This function is not available when thread support is disabled at
4535compile time.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004536\end{cfuncdesc}
4537
4538\begin{cfuncdesc}{void}{PyEval_ReleaseLock}{}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004539Release the global interpreter lock. The lock must have been created
4540earlier. This function is not available when thread support is
Fred Drakee058b4f1998-02-16 06:15:35 +00004541disabled at compile time.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004542\end{cfuncdesc}
4543
4544\begin{cfuncdesc}{void}{PyEval_AcquireThread}{PyThreadState *tstate}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004545Acquire the global interpreter lock and then set the current thread
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004546state to \var{tstate}, which should not be \NULL{}. The lock must
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004547have been created earlier. If this thread already has the lock,
4548deadlock ensues. This function is not available when thread support
Fred Drakee058b4f1998-02-16 06:15:35 +00004549is disabled at compile time.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004550\end{cfuncdesc}
4551
4552\begin{cfuncdesc}{void}{PyEval_ReleaseThread}{PyThreadState *tstate}
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004553Reset the current thread state to \NULL{} and release the global
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004554interpreter lock. The lock must have been created earlier and must be
4555held by the current thread. The \var{tstate} argument, which must not
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004556be \NULL{}, is only used to check that it represents the current
Fred Drakee058b4f1998-02-16 06:15:35 +00004557thread state --- if it isn't, a fatal error is reported. This
4558function is not available when thread support is disabled at compile
4559time.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004560\end{cfuncdesc}
4561
Fred Drakec6fa34e1998-04-02 06:47:24 +00004562\begin{cfuncdesc}{PyThreadState*}{PyEval_SaveThread}{}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004563Release the interpreter lock (if it has been created and thread
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004564support is enabled) and reset the thread state to \NULL{},
4565returning the previous thread state (which is not \NULL{}). If
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004566the lock has been created, the current thread must have acquired it.
4567(This function is available even when thread support is disabled at
4568compile time.)
Guido van Rossum4a944d71997-08-14 20:35:38 +00004569\end{cfuncdesc}
4570
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004571\begin{cfuncdesc}{void}{PyEval_RestoreThread}{PyThreadState *tstate}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004572Acquire the interpreter lock (if it has been created and thread
4573support is enabled) and set the thread state to \var{tstate}, which
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004574must not be \NULL{}. If the lock has been created, the current
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004575thread must not have acquired it, otherwise deadlock ensues. (This
4576function is available even when thread support is disabled at compile
4577time.)
Guido van Rossum4a944d71997-08-14 20:35:38 +00004578\end{cfuncdesc}
4579
Fred Drake659ebfa2000-04-03 15:42:13 +00004580The following macros are normally used without a trailing semicolon;
4581look for example usage in the Python source distribution.
4582
4583\begin{csimplemacrodesc}{Py_BEGIN_ALLOW_THREADS}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004584This macro expands to
Fred Drakee058b4f1998-02-16 06:15:35 +00004585\samp{\{ PyThreadState *_save; _save = PyEval_SaveThread();}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004586Note that it contains an opening brace; it must be matched with a
4587following \code{Py_END_ALLOW_THREADS} macro. See above for further
4588discussion of this macro. It is a no-op when thread support is
4589disabled at compile time.
Fred Drake659ebfa2000-04-03 15:42:13 +00004590\end{csimplemacrodesc}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004591
Fred Drake659ebfa2000-04-03 15:42:13 +00004592\begin{csimplemacrodesc}{Py_END_ALLOW_THREADS}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004593This macro expands to
Fred Drakee058b4f1998-02-16 06:15:35 +00004594\samp{PyEval_RestoreThread(_save); \}}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004595Note that it contains a closing brace; it must be matched with an
4596earlier \code{Py_BEGIN_ALLOW_THREADS} macro. See above for further
4597discussion of this macro. It is a no-op when thread support is
4598disabled at compile time.
Fred Drake659ebfa2000-04-03 15:42:13 +00004599\end{csimplemacrodesc}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004600
Fred Drake659ebfa2000-04-03 15:42:13 +00004601\begin{csimplemacrodesc}{Py_BEGIN_BLOCK_THREADS}
Fred Drakee058b4f1998-02-16 06:15:35 +00004602This macro expands to \samp{PyEval_RestoreThread(_save);} i.e. it
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004603is equivalent to \code{Py_END_ALLOW_THREADS} without the closing
4604brace. It is a no-op when thread support is disabled at compile
4605time.
Fred Drake659ebfa2000-04-03 15:42:13 +00004606\end{csimplemacrodesc}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004607
Fred Drake659ebfa2000-04-03 15:42:13 +00004608\begin{csimplemacrodesc}{Py_BEGIN_UNBLOCK_THREADS}
Fred Drakee058b4f1998-02-16 06:15:35 +00004609This macro expands to \samp{_save = PyEval_SaveThread();} i.e. it is
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004610equivalent to \code{Py_BEGIN_ALLOW_THREADS} without the opening brace
4611and variable declaration. It is a no-op when thread support is
4612disabled at compile time.
Fred Drake659ebfa2000-04-03 15:42:13 +00004613\end{csimplemacrodesc}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004614
4615All of the following functions are only available when thread support
4616is enabled at compile time, and must be called only when the
Fred Drake9d20ac31998-02-16 15:27:08 +00004617interpreter lock has been created.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004618
Fred Drakec6fa34e1998-04-02 06:47:24 +00004619\begin{cfuncdesc}{PyInterpreterState*}{PyInterpreterState_New}{}
Guido van Rossumed9dcc11998-08-07 18:28:03 +00004620Create a new interpreter state object. The interpreter lock need not
4621be held, but may be held if it is necessary to serialize calls to this
4622function.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004623\end{cfuncdesc}
4624
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004625\begin{cfuncdesc}{void}{PyInterpreterState_Clear}{PyInterpreterState *interp}
4626Reset all information in an interpreter state object. The interpreter
4627lock must be held.
Guido van Rossum4a944d71997-08-14 20:35:38 +00004628\end{cfuncdesc}
4629
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004630\begin{cfuncdesc}{void}{PyInterpreterState_Delete}{PyInterpreterState *interp}
4631Destroy an interpreter state object. The interpreter lock need not be
4632held. The interpreter state must have been reset with a previous
Fred Drakee058b4f1998-02-16 06:15:35 +00004633call to \cfunction{PyInterpreterState_Clear()}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004634\end{cfuncdesc}
4635
Fred Drakec6fa34e1998-04-02 06:47:24 +00004636\begin{cfuncdesc}{PyThreadState*}{PyThreadState_New}{PyInterpreterState *interp}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004637Create a new thread state object belonging to the given interpreter
Guido van Rossumed9dcc11998-08-07 18:28:03 +00004638object. The interpreter lock need not be held, but may be held if it
4639is necessary to serialize calls to this function.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004640\end{cfuncdesc}
4641
4642\begin{cfuncdesc}{void}{PyThreadState_Clear}{PyThreadState *tstate}
4643Reset all information in a thread state object. The interpreter lock
4644must be held.
4645\end{cfuncdesc}
4646
4647\begin{cfuncdesc}{void}{PyThreadState_Delete}{PyThreadState *tstate}
4648Destroy a thread state object. The interpreter lock need not be
4649held. The thread state must have been reset with a previous
Fred Drakee058b4f1998-02-16 06:15:35 +00004650call to \cfunction{PyThreadState_Clear()}.
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004651\end{cfuncdesc}
4652
Fred Drakec6fa34e1998-04-02 06:47:24 +00004653\begin{cfuncdesc}{PyThreadState*}{PyThreadState_Get}{}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004654Return the current thread state. The interpreter lock must be held.
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004655When the current thread state is \NULL{}, this issues a fatal
Guido van Rossum5b8a5231997-12-30 04:38:44 +00004656error (so that the caller needn't check for \NULL{}).
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004657\end{cfuncdesc}
4658
Fred Drakec6fa34e1998-04-02 06:47:24 +00004659\begin{cfuncdesc}{PyThreadState*}{PyThreadState_Swap}{PyThreadState *tstate}
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004660Swap the current thread state with the thread state given by the
Guido van Rossum580aa8d1997-11-25 15:34:51 +00004661argument \var{tstate}, which may be \NULL{}. The interpreter lock
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004662must be held.
4663\end{cfuncdesc}
4664
Fred Drake24e62192001-05-21 15:56:55 +00004665\begin{cfuncdesc}{PyObject*}{PyThreadState_GetDict}{}
4666Return a dictionary in which extensions can store thread-specific
4667state information. Each extension should use a unique key to use to
4668store state in the dictionary. If this function returns \NULL, an
4669exception has been raised and the caller should allow it to
4670propogate.
4671\end{cfuncdesc}
4672
Guido van Rossumc44d3d61997-10-06 05:10:47 +00004673
Fred Drake659ebfa2000-04-03 15:42:13 +00004674\chapter{Memory Management \label{memory}}
4675\sectionauthor{Vladimir Marangozov}{Vladimir.Marangozov@inrialpes.fr}
4676
4677
4678\section{Overview \label{memoryOverview}}
4679
4680Memory management in Python involves a private heap containing all
4681Python objects and data structures. The management of this private
4682heap is ensured internally by the \emph{Python memory manager}. The
4683Python memory manager has different components which deal with various
4684dynamic storage management aspects, like sharing, segmentation,
4685preallocation or caching.
4686
4687At the lowest level, a raw memory allocator ensures that there is
4688enough room in the private heap for storing all Python-related data
4689by interacting with the memory manager of the operating system. On top
4690of the raw memory allocator, several object-specific allocators
4691operate on the same heap and implement distinct memory management
4692policies adapted to the peculiarities of every object type. For
4693example, integer objects are managed differently within the heap than
4694strings, tuples or dictionaries because integers imply different
4695storage requirements and speed/space tradeoffs. The Python memory
4696manager thus delegates some of the work to the object-specific
4697allocators, but ensures that the latter operate within the bounds of
4698the private heap.
4699
4700It is important to understand that the management of the Python heap
4701is performed by the interpreter itself and that the user has no
4702control on it, even if she regularly manipulates object pointers to
4703memory blocks inside that heap. The allocation of heap space for
4704Python objects and other internal buffers is performed on demand by
4705the Python memory manager through the Python/C API functions listed in
4706this document.
4707
4708To avoid memory corruption, extension writers should never try to
4709operate on Python objects with the functions exported by the C
4710library: \cfunction{malloc()}\ttindex{malloc()},
4711\cfunction{calloc()}\ttindex{calloc()},
4712\cfunction{realloc()}\ttindex{realloc()} and
4713\cfunction{free()}\ttindex{free()}. This will result in
4714mixed calls between the C allocator and the Python memory manager
4715with fatal consequences, because they implement different algorithms
4716and operate on different heaps. However, one may safely allocate and
4717release memory blocks with the C library allocator for individual
4718purposes, as shown in the following example:
4719
4720\begin{verbatim}
4721 PyObject *res;
4722 char *buf = (char *) malloc(BUFSIZ); /* for I/O */
4723
4724 if (buf == NULL)
4725 return PyErr_NoMemory();
4726 ...Do some I/O operation involving buf...
4727 res = PyString_FromString(buf);
4728 free(buf); /* malloc'ed */
4729 return res;
4730\end{verbatim}
4731
4732In this example, the memory request for the I/O buffer is handled by
4733the C library allocator. The Python memory manager is involved only
4734in the allocation of the string object returned as a result.
4735
4736In most situations, however, it is recommended to allocate memory from
4737the Python heap specifically because the latter is under control of
4738the Python memory manager. For example, this is required when the
4739interpreter is extended with new object types written in C. Another
4740reason for using the Python heap is the desire to \emph{inform} the
4741Python memory manager about the memory needs of the extension module.
4742Even when the requested memory is used exclusively for internal,
4743highly-specific purposes, delegating all memory requests to the Python
4744memory manager causes the interpreter to have a more accurate image of
4745its memory footprint as a whole. Consequently, under certain
4746circumstances, the Python memory manager may or may not trigger
4747appropriate actions, like garbage collection, memory compaction or
4748other preventive procedures. Note that by using the C library
4749allocator as shown in the previous example, the allocated memory for
4750the I/O buffer escapes completely the Python memory manager.
4751
4752
4753\section{Memory Interface \label{memoryInterface}}
4754
4755The following function sets, modeled after the ANSI C standard, are
4756available for allocating and releasing memory from the Python heap:
4757
4758
Fred Drake7d45d342000-08-11 17:07:32 +00004759\begin{cfuncdesc}{void*}{PyMem_Malloc}{size_t n}
4760Allocates \var{n} bytes and returns a pointer of type \ctype{void*} to
Fred Drake659ebfa2000-04-03 15:42:13 +00004761the allocated memory, or \NULL{} if the request fails. Requesting zero
4762bytes returns a non-\NULL{} pointer.
4763\end{cfuncdesc}
4764
Fred Drake7d45d342000-08-11 17:07:32 +00004765\begin{cfuncdesc}{void*}{PyMem_Realloc}{void *p, size_t n}
Fred Drake659ebfa2000-04-03 15:42:13 +00004766Resizes the memory block pointed to by \var{p} to \var{n} bytes. The
4767contents will be unchanged to the minimum of the old and the new
4768sizes. If \var{p} is \NULL{}, the call is equivalent to
4769\cfunction{PyMem_Malloc(\var{n})}; if \var{n} is equal to zero, the memory block
4770is resized but is not freed, and the returned pointer is non-\NULL{}.
4771Unless \var{p} is \NULL{}, it must have been returned by a previous
4772call to \cfunction{PyMem_Malloc()} or \cfunction{PyMem_Realloc()}.
4773\end{cfuncdesc}
4774
Fred Drake7d45d342000-08-11 17:07:32 +00004775\begin{cfuncdesc}{void}{PyMem_Free}{void *p}
Fred Drake659ebfa2000-04-03 15:42:13 +00004776Frees the memory block pointed to by \var{p}, which must have been
4777returned by a previous call to \cfunction{PyMem_Malloc()} or
4778\cfunction{PyMem_Realloc()}. Otherwise, or if
4779\cfunction{PyMem_Free(p)} has been called before, undefined behaviour
4780occurs. If \var{p} is \NULL{}, no operation is performed.
4781\end{cfuncdesc}
4782
Fred Drake659ebfa2000-04-03 15:42:13 +00004783The following type-oriented macros are provided for convenience. Note
4784that \var{TYPE} refers to any C type.
4785
Fred Drakef913e542000-09-12 20:17:17 +00004786\begin{cfuncdesc}{\var{TYPE}*}{PyMem_New}{TYPE, size_t n}
Fred Drake659ebfa2000-04-03 15:42:13 +00004787Same as \cfunction{PyMem_Malloc()}, but allocates \code{(\var{n} *
4788sizeof(\var{TYPE}))} bytes of memory. Returns a pointer cast to
4789\ctype{\var{TYPE}*}.
4790\end{cfuncdesc}
4791
Fred Drakef913e542000-09-12 20:17:17 +00004792\begin{cfuncdesc}{\var{TYPE}*}{PyMem_Resize}{void *p, TYPE, size_t n}
Fred Drake659ebfa2000-04-03 15:42:13 +00004793Same as \cfunction{PyMem_Realloc()}, but the memory block is resized
4794to \code{(\var{n} * sizeof(\var{TYPE}))} bytes. Returns a pointer
4795cast to \ctype{\var{TYPE}*}.
4796\end{cfuncdesc}
4797
Fred Drakef913e542000-09-12 20:17:17 +00004798\begin{cfuncdesc}{void}{PyMem_Del}{void *p}
Fred Drake659ebfa2000-04-03 15:42:13 +00004799Same as \cfunction{PyMem_Free()}.
4800\end{cfuncdesc}
4801
Fred Drakef913e542000-09-12 20:17:17 +00004802In addition, the following macro sets are provided for calling the
4803Python memory allocator directly, without involving the C API functions
4804listed above. However, note that their use does not preserve binary
4805compatibility accross Python versions and is therefore deprecated in
4806extension modules.
4807
4808\cfunction{PyMem_MALLOC()}, \cfunction{PyMem_REALLOC()}, \cfunction{PyMem_FREE()}.
4809
4810\cfunction{PyMem_NEW()}, \cfunction{PyMem_RESIZE()}, \cfunction{PyMem_DEL()}.
4811
Fred Drake659ebfa2000-04-03 15:42:13 +00004812
4813\section{Examples \label{memoryExamples}}
4814
4815Here is the example from section \ref{memoryOverview}, rewritten so
4816that the I/O buffer is allocated from the Python heap by using the
4817first function set:
4818
4819\begin{verbatim}
4820 PyObject *res;
4821 char *buf = (char *) PyMem_Malloc(BUFSIZ); /* for I/O */
4822
4823 if (buf == NULL)
4824 return PyErr_NoMemory();
4825 /* ...Do some I/O operation involving buf... */
4826 res = PyString_FromString(buf);
4827 PyMem_Free(buf); /* allocated with PyMem_Malloc */
4828 return res;
4829\end{verbatim}
4830
Fred Drakef913e542000-09-12 20:17:17 +00004831The same code using the type-oriented function set:
Fred Drake659ebfa2000-04-03 15:42:13 +00004832
4833\begin{verbatim}
4834 PyObject *res;
Fred Drakef913e542000-09-12 20:17:17 +00004835 char *buf = PyMem_New(char, BUFSIZ); /* for I/O */
Fred Drake659ebfa2000-04-03 15:42:13 +00004836
4837 if (buf == NULL)
4838 return PyErr_NoMemory();
4839 /* ...Do some I/O operation involving buf... */
4840 res = PyString_FromString(buf);
Fred Drakef913e542000-09-12 20:17:17 +00004841 PyMem_Del(buf); /* allocated with PyMem_New */
Fred Drake659ebfa2000-04-03 15:42:13 +00004842 return res;
4843\end{verbatim}
4844
Fred Drakef913e542000-09-12 20:17:17 +00004845Note that in the two examples above, the buffer is always
4846manipulated via functions belonging to the same set. Indeed, it
Fred Drake659ebfa2000-04-03 15:42:13 +00004847is required to use the same memory API family for a given
4848memory block, so that the risk of mixing different allocators is
4849reduced to a minimum. The following code sequence contains two errors,
4850one of which is labeled as \emph{fatal} because it mixes two different
4851allocators operating on different heaps.
4852
4853\begin{verbatim}
Fred Drakef913e542000-09-12 20:17:17 +00004854char *buf1 = PyMem_New(char, BUFSIZ);
Fred Drake659ebfa2000-04-03 15:42:13 +00004855char *buf2 = (char *) malloc(BUFSIZ);
4856char *buf3 = (char *) PyMem_Malloc(BUFSIZ);
4857...
Fred Drakef913e542000-09-12 20:17:17 +00004858PyMem_Del(buf3); /* Wrong -- should be PyMem_Free() */
Fred Drake659ebfa2000-04-03 15:42:13 +00004859free(buf2); /* Right -- allocated via malloc() */
Fred Drakef913e542000-09-12 20:17:17 +00004860free(buf1); /* Fatal -- should be PyMem_Del() */
Fred Drake659ebfa2000-04-03 15:42:13 +00004861\end{verbatim}
4862
4863In addition to the functions aimed at handling raw memory blocks from
4864the Python heap, objects in Python are allocated and released with
Fred Drakef913e542000-09-12 20:17:17 +00004865\cfunction{PyObject_New()}, \cfunction{PyObject_NewVar()} and
4866\cfunction{PyObject_Del()}, or with their corresponding macros
4867\cfunction{PyObject_NEW()}, \cfunction{PyObject_NEW_VAR()} and
Fred Drakee06f0f92000-06-30 15:52:39 +00004868\cfunction{PyObject_DEL()}.
Fred Drake659ebfa2000-04-03 15:42:13 +00004869
Fred Drakee06f0f92000-06-30 15:52:39 +00004870These will be explained in the next chapter on defining and
4871implementing new object types in C.
Fred Drake659ebfa2000-04-03 15:42:13 +00004872
4873
Fred Drakeefd146c1999-02-15 15:30:45 +00004874\chapter{Defining New Object Types \label{newTypes}}
Guido van Rossum4a944d71997-08-14 20:35:38 +00004875
Fred Drakec6fa34e1998-04-02 06:47:24 +00004876\begin{cfuncdesc}{PyObject*}{_PyObject_New}{PyTypeObject *type}
Fred Drakee058b4f1998-02-16 06:15:35 +00004877\end{cfuncdesc}
4878
Fred Drakef913e542000-09-12 20:17:17 +00004879\begin{cfuncdesc}{PyVarObject*}{_PyObject_NewVar}{PyTypeObject *type, int size}
Fred Drakee058b4f1998-02-16 06:15:35 +00004880\end{cfuncdesc}
4881
Fred Drakef913e542000-09-12 20:17:17 +00004882\begin{cfuncdesc}{void}{_PyObject_Del}{PyObject *op}
Fred Drakee058b4f1998-02-16 06:15:35 +00004883\end{cfuncdesc}
4884
Fred Drakef913e542000-09-12 20:17:17 +00004885\begin{cfuncdesc}{PyObject*}{PyObject_Init}{PyObject *op,
Marc-André Lemburga544ea22001-01-17 18:04:31 +00004886 PyTypeObject *type}
Fred Drakef913e542000-09-12 20:17:17 +00004887\end{cfuncdesc}
4888
4889\begin{cfuncdesc}{PyVarObject*}{PyObject_InitVar}{PyVarObject *op,
Marc-André Lemburga544ea22001-01-17 18:04:31 +00004890 PyTypeObject *type, int size}
Fred Drakef913e542000-09-12 20:17:17 +00004891\end{cfuncdesc}
4892
4893\begin{cfuncdesc}{\var{TYPE}*}{PyObject_New}{TYPE, PyTypeObject *type}
4894\end{cfuncdesc}
4895
4896\begin{cfuncdesc}{\var{TYPE}*}{PyObject_NewVar}{TYPE, PyTypeObject *type,
4897 int size}
4898\end{cfuncdesc}
4899
4900\begin{cfuncdesc}{void}{PyObject_Del}{PyObject *op}
4901\end{cfuncdesc}
4902
4903\begin{cfuncdesc}{\var{TYPE}*}{PyObject_NEW}{TYPE, PyTypeObject *type}
4904\end{cfuncdesc}
4905
4906\begin{cfuncdesc}{\var{TYPE}*}{PyObject_NEW_VAR}{TYPE, PyTypeObject *type,
4907 int size}
4908\end{cfuncdesc}
4909
4910\begin{cfuncdesc}{void}{PyObject_DEL}{PyObject *op}
Fred Drakee058b4f1998-02-16 06:15:35 +00004911\end{cfuncdesc}
4912
Fred Drakeee814bf2000-11-28 22:34:32 +00004913\begin{cfuncdesc}{PyObject*}{Py_InitModule}{char *name,
4914 PyMethodDef *methods}
4915 Create a new module object based on a name and table of functions,
4916 returning the new module object.
4917\end{cfuncdesc}
4918
4919\begin{cfuncdesc}{PyObject*}{Py_InitModule3}{char *name,
4920 PyMethodDef *methods,
4921 char *doc}
4922 Create a new module object based on a name and table of functions,
4923 returning the new module object. If \var{doc} is non-\NULL, it will
4924 be used to define the docstring for the module.
4925\end{cfuncdesc}
4926
4927\begin{cfuncdesc}{PyObject*}{Py_InitModule4}{char *name,
4928 PyMethodDef *methods,
4929 char *doc, PyObject *self,
4930 int apiver}
4931 Create a new module object based on a name and table of functions,
4932 returning the new module object. If \var{doc} is non-\NULL, it will
4933 be used to define the docstring for the module. If \var{self} is
4934 non-\NULL, it will passed to the functions of the module as their
4935 (otherwise \NULL) first parameter. (This was added as an
4936 experimental feature, and there are no known uses in the current
4937 version of Python.) For \var{apiver}, the only value which should
4938 be passed is defined by the constant \constant{PYTHON_API_VERSION}.
4939
4940 \strong{Note:} Most uses of this function should probably be using
4941 the \cfunction{Py_InitModule3()} instead; only use this if you are
4942 sure you need it.
4943\end{cfuncdesc}
Guido van Rossum3c4378b1998-04-14 20:21:10 +00004944
4945PyArg_ParseTupleAndKeywords, PyArg_ParseTuple, PyArg_Parse
4946
4947Py_BuildValue
Guido van Rossumae110af1997-05-22 20:11:52 +00004948
Fred Drake659ebfa2000-04-03 15:42:13 +00004949DL_IMPORT
4950
Fred Drake659ebfa2000-04-03 15:42:13 +00004951_Py_NoneStruct
4952
4953
4954\section{Common Object Structures \label{common-structs}}
4955
Guido van Rossumae110af1997-05-22 20:11:52 +00004956PyObject, PyVarObject
4957
4958PyObject_HEAD, PyObject_HEAD_INIT, PyObject_VAR_HEAD
4959
4960Typedefs:
4961unaryfunc, binaryfunc, ternaryfunc, inquiry, coercion, intargfunc,
4962intintargfunc, intobjargproc, intintobjargproc, objobjargproc,
Guido van Rossumae110af1997-05-22 20:11:52 +00004963destructor, printfunc, getattrfunc, getattrofunc, setattrfunc,
4964setattrofunc, cmpfunc, reprfunc, hashfunc
4965
Fred Drakea8455ab2000-06-16 19:58:42 +00004966\begin{ctypedesc}{PyCFunction}
4967Type of the functions used to implement most Python callables in C.
4968\end{ctypedesc}
4969
4970\begin{ctypedesc}{PyMethodDef}
4971Structure used to describe a method of an extension type. This
4972structure has four fields:
4973
4974\begin{tableiii}{l|l|l}{member}{Field}{C Type}{Meaning}
4975 \lineiii{ml_name}{char *}{name of the method}
4976 \lineiii{ml_meth}{PyCFunction}{pointer to the C implementation}
4977 \lineiii{ml_flags}{int}{flag bits indicating how the call should be
4978 constructed}
4979 \lineiii{ml_doc}{char *}{points to the contents of the docstring}
4980\end{tableiii}
4981\end{ctypedesc}
4982
4983\begin{cfuncdesc}{PyObject*}{Py_FindMethod}{PyMethodDef[] table,
4984 PyObject *ob, char *name}
4985Return a bound method object for an extension type implemented in C.
4986This function also handles the special attribute \member{__methods__},
4987returning a list of all the method names defined in \var{table}.
4988\end{cfuncdesc}
4989
Fred Drake659ebfa2000-04-03 15:42:13 +00004990
4991\section{Mapping Object Structures \label{mapping-structs}}
4992
4993\begin{ctypedesc}{PyMappingMethods}
4994Structure used to hold pointers to the functions used to implement the
4995mapping protocol for an extension type.
4996\end{ctypedesc}
4997
4998
4999\section{Number Object Structures \label{number-structs}}
5000
5001\begin{ctypedesc}{PyNumberMethods}
5002Structure used to hold pointers to the functions an extension type
5003uses to implement the number protocol.
5004\end{ctypedesc}
5005
5006
5007\section{Sequence Object Structures \label{sequence-structs}}
5008
5009\begin{ctypedesc}{PySequenceMethods}
5010Structure used to hold pointers to the functions which an object uses
5011to implement the sequence protocol.
5012\end{ctypedesc}
5013
5014
5015\section{Buffer Object Structures \label{buffer-structs}}
5016\sectionauthor{Greg J. Stein}{greg@lyra.org}
5017
5018The buffer interface exports a model where an object can expose its
5019internal data as a set of chunks of data, where each chunk is
5020specified as a pointer/length pair. These chunks are called
5021\dfn{segments} and are presumed to be non-contiguous in memory.
5022
5023If an object does not export the buffer interface, then its
5024\member{tp_as_buffer} member in the \ctype{PyTypeObject} structure
5025should be \NULL{}. Otherwise, the \member{tp_as_buffer} will point to
5026a \ctype{PyBufferProcs} structure.
5027
5028\strong{Note:} It is very important that your
Fred Drakec392b572001-03-21 22:15:01 +00005029\ctype{PyTypeObject} structure uses \constant{Py_TPFLAGS_DEFAULT} for
5030the value of the \member{tp_flags} member rather than \code{0}. This
Fred Drake659ebfa2000-04-03 15:42:13 +00005031tells the Python runtime that your \ctype{PyBufferProcs} structure
5032contains the \member{bf_getcharbuffer} slot. Older versions of Python
5033did not have this member, so a new Python interpreter using an old
5034extension needs to be able to test for its presence before using it.
5035
5036\begin{ctypedesc}{PyBufferProcs}
5037Structure used to hold the function pointers which define an
5038implementation of the buffer protocol.
5039
5040The first slot is \member{bf_getreadbuffer}, of type
5041\ctype{getreadbufferproc}. If this slot is \NULL{}, then the object
5042does not support reading from the internal data. This is
5043non-sensical, so implementors should fill this in, but callers should
5044test that the slot contains a non-\NULL{} value.
5045
5046The next slot is \member{bf_getwritebuffer} having type
5047\ctype{getwritebufferproc}. This slot may be \NULL{} if the object
5048does not allow writing into its returned buffers.
5049
5050The third slot is \member{bf_getsegcount}, with type
5051\ctype{getsegcountproc}. This slot must not be \NULL{} and is used to
5052inform the caller how many segments the object contains. Simple
5053objects such as \ctype{PyString_Type} and
5054\ctype{PyBuffer_Type} objects contain a single segment.
5055
5056The last slot is \member{bf_getcharbuffer}, of type
5057\ctype{getcharbufferproc}. This slot will only be present if the
Fred Drakec392b572001-03-21 22:15:01 +00005058\constant{Py_TPFLAGS_HAVE_GETCHARBUFFER} flag is present in the
Fred Drake659ebfa2000-04-03 15:42:13 +00005059\member{tp_flags} field of the object's \ctype{PyTypeObject}. Before using
5060this slot, the caller should test whether it is present by using the
5061\cfunction{PyType_HasFeature()}\ttindex{PyType_HasFeature()} function.
5062If present, it may be \NULL, indicating that the object's contents
5063cannot be used as \emph{8-bit characters}.
5064The slot function may also raise an error if the object's contents
5065cannot be interpreted as 8-bit characters. For example, if the object
5066is an array which is configured to hold floating point values, an
5067exception may be raised if a caller attempts to use
5068\member{bf_getcharbuffer} to fetch a sequence of 8-bit characters.
5069This notion of exporting the internal buffers as ``text'' is used to
5070distinguish between objects that are binary in nature, and those which
5071have character-based content.
5072
5073\strong{Note:} The current policy seems to state that these characters
5074may be multi-byte characters. This implies that a buffer size of
5075\var{N} does not mean there are \var{N} characters present.
5076\end{ctypedesc}
5077
5078\begin{datadesc}{Py_TPFLAGS_HAVE_GETCHARBUFFER}
5079Flag bit set in the type structure to indicate that the
5080\member{bf_getcharbuffer} slot is known. This being set does not
5081indicate that the object supports the buffer interface or that the
5082\member{bf_getcharbuffer} slot is non-\NULL.
5083\end{datadesc}
5084
5085\begin{ctypedesc}[getreadbufferproc]{int (*getreadbufferproc)
5086 (PyObject *self, int segment, void **ptrptr)}
5087Return a pointer to a readable segment of the buffer. This function
5088is allowed to raise an exception, in which case it must return
5089\code{-1}. The \var{segment} which is passed must be zero or
5090positive, and strictly less than the number of segments returned by
Greg Stein4d4d0032001-04-07 16:14:49 +00005091the \member{bf_getsegcount} slot function. On success, it returns the
5092length of the buffer memory, and sets \code{*\var{ptrptr}} to a
5093pointer to that memory.
Fred Drake659ebfa2000-04-03 15:42:13 +00005094\end{ctypedesc}
5095
5096\begin{ctypedesc}[getwritebufferproc]{int (*getwritebufferproc)
5097 (PyObject *self, int segment, void **ptrptr)}
Greg Stein4d4d0032001-04-07 16:14:49 +00005098Return a pointer to a writable memory buffer in \code{*\var{ptrptr}},
5099and the length of that segment as the function return value.
5100The memory buffer must correspond to buffer segment \var{segment}.
Fred Drake58c5a2a1999-08-04 13:13:24 +00005101Must return \code{-1} and set an exception on error.
5102\exception{TypeError} should be raised if the object only supports
5103read-only buffers, and \exception{SystemError} should be raised when
5104\var{segment} specifies a segment that doesn't exist.
5105% Why doesn't it raise ValueError for this one?
Fred Drake659ebfa2000-04-03 15:42:13 +00005106% GJS: because you shouldn't be calling it with an invalid
5107% segment. That indicates a blatant programming error in the C
5108% code.
Fred Drake58c5a2a1999-08-04 13:13:24 +00005109\end{ctypedesc}
5110
Fred Drake659ebfa2000-04-03 15:42:13 +00005111\begin{ctypedesc}[getsegcountproc]{int (*getsegcountproc)
5112 (PyObject *self, int *lenp)}
5113Return the number of memory segments which comprise the buffer. If
5114\var{lenp} is not \NULL, the implementation must report the sum of the
5115sizes (in bytes) of all segments in \code{*\var{lenp}}.
5116The function cannot fail.
5117\end{ctypedesc}
Guido van Rossumae110af1997-05-22 20:11:52 +00005118
Fred Drake659ebfa2000-04-03 15:42:13 +00005119\begin{ctypedesc}[getcharbufferproc]{int (*getcharbufferproc)
5120 (PyObject *self, int segment, const char **ptrptr)}
5121\end{ctypedesc}
Guido van Rossumae110af1997-05-22 20:11:52 +00005122
Guido van Rossumae110af1997-05-22 20:11:52 +00005123
Fred Drakec392b572001-03-21 22:15:01 +00005124\section{Supporting Cyclic Garbarge Collection
5125 \label{supporting-cycle-detection}}
5126
5127Python's support for detecting and collecting garbage which involves
5128circular references requires support from object types which are
5129``containers'' for other objects which may also be containers. Types
5130which do not store references to other objects, or which only store
5131references to atomic types (such as numbers or strings), do not need
5132to provide any explicit support for garbage collection.
5133
5134To create a container type, the \member{tp_flags} field of the type
5135object must include the \constant{Py_TPFLAGS_GC} and provide an
Fred Drakee28d8ae2001-03-22 16:30:17 +00005136implementation of the \member{tp_traverse} handler. The computed
5137value of the \member{tp_basicsize} field must include
5138\constant{PyGC_HEAD_SIZE} as well. If instances of the type are
5139mutable, a \member{tp_clear} implementation must also be provided.
Fred Drakec392b572001-03-21 22:15:01 +00005140
5141\begin{datadesc}{Py_TPFLAGS_GC}
5142 Objects with a type with this flag set must conform with the rules
5143 documented here. For convenience these objects will be referred to
5144 as container objects.
5145\end{datadesc}
5146
5147\begin{datadesc}{PyGC_HEAD_SIZE}
5148 Extra memory needed for the garbage collector. Container objects
5149 must include this in the calculation of their tp_basicsize. If the
5150 collector is disabled at compile time then this is \code{0}.
5151\end{datadesc}
5152
Fred Drakee28d8ae2001-03-22 16:30:17 +00005153Constructors for container types must conform to two rules:
5154
5155\begin{enumerate}
5156\item The memory for the object must be allocated using
5157 \cfunction{PyObject_New()} or \cfunction{PyObject_VarNew()}.
5158
5159\item Once all the fields which may contain references to other
5160 containers are initialized, it must call
5161 \cfunction{PyObject_GC_Init()}.
5162\end{enumerate}
5163
Fred Drakec392b572001-03-21 22:15:01 +00005164\begin{cfuncdesc}{void}{PyObject_GC_Init}{PyObject *op}
5165 Adds the object \var{op} to the set of container objects tracked by
5166 the collector. The collector can run at unexpected times so objects
5167 must be valid while being tracked. This should be called once all
5168 the fields followed by the \member{tp_traverse} handler become valid,
5169 usually near the end of the constructor.
5170\end{cfuncdesc}
5171
Fred Drakee28d8ae2001-03-22 16:30:17 +00005172Similarly, the deallocator for the object must conform to a similar
5173pair of rules:
5174
5175\begin{enumerate}
5176\item Before fields which refer to other containers are invalidated,
5177 \cfunction{PyObject_GC_Fini()} must be called.
5178
5179\item The object's memory must be deallocated using
5180 \cfunction{PyObject_Del()}.
5181\end{enumerate}
5182
Fred Drakec392b572001-03-21 22:15:01 +00005183\begin{cfuncdesc}{void}{PyObject_GC_Fini}{PyObject *op}
5184 Remove the object \var{op} from the set of container objects tracked
5185 by the collector. Note that \cfunction{PyObject_GC_Init()} can be
5186 called again on this object to add it back to the set of tracked
5187 objects. The deallocator (\member{tp_dealloc} handler) should call
5188 this for the object before any of the fields used by the
5189 \member{tp_traverse} handler become invalid.
Fred Drake8f6df462001-03-23 17:42:09 +00005190
5191 \strong{Note:} Any container which may be referenced from another
5192 object reachable by the collector must itself be tracked by the
5193 collector, so it is generally not safe to call this function
5194 anywhere but in the object's deallocator.
Fred Drakec392b572001-03-21 22:15:01 +00005195\end{cfuncdesc}
5196
5197The \member{tp_traverse} handler accepts a function parameter of this
5198type:
5199
5200\begin{ctypedesc}[visitproc]{int (*visitproc)(PyObject *object, void *arg)}
5201 Type of the visitor function passed to the \member{tp_traverse}
5202 handler. The function should be called with an object to traverse
5203 as \var{object} and the third parameter to the \member{tp_traverse}
5204 handler as \var{arg}.
5205\end{ctypedesc}
5206
5207The \member{tp_traverse} handler must have the following type:
5208
5209\begin{ctypedesc}[traverseproc]{int (*traverseproc)(PyObject *self,
5210 visitproc visit, void *arg)}
5211 Traversal function for a container object. Implementations must
5212 call the \var{visit} function for each object directly contained by
5213 \var{self}, with the parameters to \var{visit} being the contained
5214 object and the \var{arg} value passed to the handler. If
5215 \var{visit} returns a non-zero value then an error has occurred and
5216 that value should be returned immediately.
5217\end{ctypedesc}
5218
5219The \member{tp_clear} handler must be of the \ctype{inquiry} type, or
5220\NULL{} if the object is immutable.
5221
5222\begin{ctypedesc}[inquiry]{int (*inquiry)(PyObject *self)}
5223 Drop references that may have created reference cycles. Immutable
5224 objects do not have to define this method since they can never
5225 directly create reference cycles. Note that the object must still
5226 be valid after calling this method (i.e., don't just call
5227 \cfunction{Py_DECREF()} on a reference). The collector will call
5228 this method if it detects that this object is involved in a
5229 reference cycle.
5230\end{ctypedesc}
5231
5232
Fred Drakee28d8ae2001-03-22 16:30:17 +00005233\subsection{Example Cycle Collector Support
5234 \label{example-cycle-support}}
5235
5236This example shows only enough of the implementation of an extension
5237type to show how the garbage collector support needs to be added. It
5238shows the definition of the object structure, the
5239\member{tp_traverse}, \member{tp_clear} and \member{tp_dealloc}
5240implementations, the type structure, and a constructor --- the module
5241initialization needed to export the constructor to Python is not shown
5242as there are no special considerations there for the collector. To
5243make this interesting, assume that the module exposes ways for the
5244\member{container} field of the object to be modified. Note that
5245since no checks are made on the type of the object used to initialize
5246\member{container}, we have to assume that it may be a container.
5247
5248\begin{verbatim}
5249#include "Python.h"
5250
5251typedef struct {
5252 PyObject_HEAD
5253 PyObject *container;
5254} MyObject;
5255
5256static int
5257my_traverse(MyObject *self, visitproc visit, void *arg)
5258{
5259 if (self->container != NULL)
5260 return visit(self->container, arg);
5261 else
5262 return 0;
5263}
5264
5265static int
5266my_clear(MyObject *self)
5267{
5268 Py_XDECREF(self->container);
5269 self->container = NULL;
5270
5271 return 0;
5272}
5273
5274static void
5275my_dealloc(MyObject *self)
5276{
5277 PyObject_GC_Fini((PyObject *) self);
5278 Py_XDECREF(self->container);
5279 PyObject_Del(self);
5280}
5281\end{verbatim}
5282
5283\begin{verbatim}
5284statichere PyTypeObject
5285MyObject_Type = {
5286 PyObject_HEAD_INIT(NULL)
5287 0,
5288 "MyObject",
5289 sizeof(MyObject) + PyGC_HEAD_SIZE,
5290 0,
5291 (destructor)my_dealloc, /* tp_dealloc */
5292 0, /* tp_print */
5293 0, /* tp_getattr */
5294 0, /* tp_setattr */
5295 0, /* tp_compare */
5296 0, /* tp_repr */
5297 0, /* tp_as_number */
5298 0, /* tp_as_sequence */
5299 0, /* tp_as_mapping */
5300 0, /* tp_hash */
5301 0, /* tp_call */
5302 0, /* tp_str */
5303 0, /* tp_getattro */
5304 0, /* tp_setattro */
5305 0, /* tp_as_buffer */
5306 Py_TPFLAGS_DEFAULT | Py_TPFLAGS_GC,
5307 0, /* tp_doc */
5308 (traverseproc)my_traverse, /* tp_traverse */
5309 (inquiry)my_clear, /* tp_clear */
5310 0, /* tp_richcompare */
5311 0, /* tp_weaklistoffset */
5312};
5313
5314/* This constructor should be made accessible from Python. */
5315static PyObject *
5316new_object(PyObject *unused, PyObject *args)
5317{
5318 PyObject *container = NULL;
5319 MyObject *result = NULL;
5320
5321 if (PyArg_ParseTuple(args, "|O:new_object", &container)) {
5322 result = PyObject_New(MyObject, &MyObject_Type);
5323 if (result != NULL) {
5324 result->container = container;
5325 PyObject_GC_Init();
5326 }
5327 }
5328 return (PyObject *) result;
5329}
5330\end{verbatim}
5331
5332
Fred Drake659ebfa2000-04-03 15:42:13 +00005333% \chapter{Debugging \label{debugging}}
5334%
5335% XXX Explain Py_DEBUG, Py_TRACE_REFS, Py_REF_DEBUG.
Guido van Rossum5b8a5231997-12-30 04:38:44 +00005336
5337
Fred Drakeed773ef2000-09-21 21:35:22 +00005338\appendix
5339\chapter{Reporting Bugs}
5340\input{reportingbugs}
5341
Fred Drake490d34d2001-06-20 21:39:12 +00005342\chapter{History and License}
5343\input{license}
5344
Marc-André Lemburga544ea22001-01-17 18:04:31 +00005345\input{api.ind} % Index -- must be last
Guido van Rossum9231c8f1997-05-15 21:43:21 +00005346
5347\end{document}