blob: 030d7eee29723e3e71b869edf36d15b612462bd6 [file] [log] [blame]
Tim Peters8b078f92002-04-28 04:11:46 +00001/* The PyObject_ memory family: high-level object memory interfaces.
2 See pymem.h for the low-level PyMem_ family.
3*/
Guido van Rossumf70e43a1991-02-19 12:39:46 +00004
Fred Drake3cf4d2b2000-07-09 00:55:06 +00005#ifndef Py_OBJIMPL_H
6#define Py_OBJIMPL_H
Peter Schneider-Kamp25f68942000-07-31 22:19:30 +00007
8#include "pymem.h"
9
Fred Drake3cf4d2b2000-07-09 00:55:06 +000010#ifdef __cplusplus
11extern "C" {
12#endif
13
Tim Peters8b078f92002-04-28 04:11:46 +000014/* BEWARE:
15
16 Each interface exports both functions and macros. Extension modules should
17 use the functions, to ensure binary compatibility across Python versions.
18 Because the Python implementation is free to change internal details, and
19 the macros may (or may not) expose details for speed, if you do use the
20 macros you must recompile your extensions with each Python release.
21
22 Never mix calls to PyObject_ memory functions with calls to the platform
23 malloc/realloc/ calloc/free, or with calls to PyMem_.
24*/
25
Guido van Rossum85a5fbb1990-10-14 12:07:46 +000026/*
Guido van Rossumb18618d2000-05-03 23:44:39 +000027Functions and macros for modules that implement new object types.
Guido van Rossum85a5fbb1990-10-14 12:07:46 +000028
Tim Peters8b078f92002-04-28 04:11:46 +000029 - PyObject_New(type, typeobj) allocates memory for a new object of the given
30 type, and initializes part of it. 'type' must be the C structure type used
31 to represent the object, and 'typeobj' the address of the corresponding
32 type object. Reference count and type pointer are filled in; the rest of
33 the bytes of the object are *undefined*! The resulting expression type is
34 'type *'. The size of the object is determined by the tp_basicsize field
35 of the type object.
Guido van Rossum85a5fbb1990-10-14 12:07:46 +000036
Tim Peters8b078f92002-04-28 04:11:46 +000037 - PyObject_NewVar(type, typeobj, n) is similar but allocates a variable-size
38 object with room for n items. In addition to the refcount and type pointer
39 fields, this also fills in the ob_size field.
Guido van Rossum85a5fbb1990-10-14 12:07:46 +000040
Tim Peters8b078f92002-04-28 04:11:46 +000041 - PyObject_Del(op) releases the memory allocated for an object. It does not
42 run a destructor -- it only frees the memory. PyObject_Free is identical.
Guido van Rossumb18618d2000-05-03 23:44:39 +000043
Tim Peters8b078f92002-04-28 04:11:46 +000044 - PyObject_Init(op, typeobj) and PyObject_InitVar(op, typeobj, n) don't
45 allocate memory. Instead of a 'type' parameter, they take a pointer to a
46 new object (allocated by an arbitrary allocator), and initialize its object
47 header fields.
Guido van Rossumb18618d2000-05-03 23:44:39 +000048
Tim Peters8b078f92002-04-28 04:11:46 +000049Note that objects created with PyObject_{New, NewVar} are allocated using the
50specialized Python allocator (implemented in obmalloc.c), if WITH_PYMALLOC is
51enabled. In addition, a special debugging allocator is used if PYMALLOC_DEBUG
52is also #defined.
Guido van Rossumb18618d2000-05-03 23:44:39 +000053
Tim Peters8b078f92002-04-28 04:11:46 +000054In case a specific form of memory management is needed (for example, if you
55must use the platform malloc heap(s), or shared memory, or C++ local storage or
56operator new), you must first allocate the object with your custom allocator,
57then pass its pointer to PyObject_{Init, InitVar} for filling in its Python-
58specific fields: reference count, type pointer, possibly others. You should
Alexey517da1e2018-02-07 02:07:30 +030059be aware that Python has no control over these objects because they don't
Tim Peters8b078f92002-04-28 04:11:46 +000060cooperate with the Python memory manager. Such objects may not be eligible
61for automatic garbage collection and you have to make sure that they are
62released accordingly whenever their destructor gets called (cf. the specific
Guido van Rossumb18618d2000-05-03 23:44:39 +000063form of memory management you're using).
64
Tim Peters8b078f92002-04-28 04:11:46 +000065Unless you have specific memory management requirements, use
66PyObject_{New, NewVar, Del}.
67*/
Guido van Rossumb18618d2000-05-03 23:44:39 +000068
Tim Peters6d483d32001-10-06 21:27:34 +000069/*
Guido van Rossumb18618d2000-05-03 23:44:39 +000070 * Raw object memory interface
71 * ===========================
72 */
73
Tim Peterse9e74522002-04-12 05:21:34 +000074/* Functions to call the same malloc/realloc/free as used by Python's
75 object allocator. If WITH_PYMALLOC is enabled, these may differ from
76 the platform malloc/realloc/free. The Python object allocator is
77 designed for fast, cache-conscious allocation of many "small" objects,
Tim Peters8b078f92002-04-28 04:11:46 +000078 and with low hidden memory overhead.
79
80 PyObject_Malloc(0) returns a unique non-NULL pointer if possible.
81
82 PyObject_Realloc(NULL, n) acts like PyObject_Malloc(n).
83 PyObject_Realloc(p != NULL, 0) does not return NULL, or free the memory
84 at p.
85
86 Returned pointers must be checked for NULL explicitly; no action is
87 performed on failure other than to return NULL (no warning it printed, no
88 exception is set, etc).
89
90 For allocating objects, use PyObject_{New, NewVar} instead whenever
91 possible. The PyObject_{Malloc, Realloc, Free} family is exposed
92 so that you can exploit Python's small-block allocator for non-object
93 uses. If you must use these routines to allocate object memory, make sure
94 the object gets initialized via PyObject_{Init, InitVar} after obtaining
95 the raw memory.
96*/
Victor Stinner0507bf52013-07-07 02:05:46 +020097PyAPI_FUNC(void *) PyObject_Malloc(size_t size);
Serhiy Storchaka34d0ac82016-12-27 14:57:39 +020098#if !defined(Py_LIMITED_API) || Py_LIMITED_API+0 >= 0x03050000
Victor Stinnerdb067af2014-05-02 22:31:14 +020099PyAPI_FUNC(void *) PyObject_Calloc(size_t nelem, size_t elsize);
Serhiy Storchaka34d0ac82016-12-27 14:57:39 +0200100#endif
Victor Stinner0507bf52013-07-07 02:05:46 +0200101PyAPI_FUNC(void *) PyObject_Realloc(void *ptr, size_t new_size);
102PyAPI_FUNC(void) PyObject_Free(void *ptr);
Guido van Rossumb18618d2000-05-03 23:44:39 +0000103
Neil Schemenauer3e7b8932002-04-12 02:38:45 +0000104
Victor Stinner0507bf52013-07-07 02:05:46 +0200105/* Macros */
Antoine Pitrouf95a1b32010-05-09 15:52:27 +0000106#define PyObject_MALLOC PyObject_Malloc
107#define PyObject_REALLOC PyObject_Realloc
108#define PyObject_FREE PyObject_Free
Antoine Pitrouf95a1b32010-05-09 15:52:27 +0000109#define PyObject_Del PyObject_Free
Victor Stinner0507bf52013-07-07 02:05:46 +0200110#define PyObject_DEL PyObject_Free
111
Neil Schemenauer3e7b8932002-04-12 02:38:45 +0000112
Guido van Rossumb18618d2000-05-03 23:44:39 +0000113/*
114 * Generic object allocator interface
115 * ==================================
116 */
117
118/* Functions */
Mark Hammond91a681d2002-08-12 07:21:58 +0000119PyAPI_FUNC(PyObject *) PyObject_Init(PyObject *, PyTypeObject *);
120PyAPI_FUNC(PyVarObject *) PyObject_InitVar(PyVarObject *,
Martin v. Löwis18e16552006-02-15 17:27:45 +0000121 PyTypeObject *, Py_ssize_t);
Mark Hammond91a681d2002-08-12 07:21:58 +0000122PyAPI_FUNC(PyObject *) _PyObject_New(PyTypeObject *);
Martin v. Löwis18e16552006-02-15 17:27:45 +0000123PyAPI_FUNC(PyVarObject *) _PyObject_NewVar(PyTypeObject *, Py_ssize_t);
Guido van Rossum85a5fbb1990-10-14 12:07:46 +0000124
Victor Stinner92055202020-04-08 00:38:15 +0200125#define PyObject_New(type, typeobj) ((type *)_PyObject_New(typeobj))
126
127// Alias to PyObject_New(). In Python 3.8, PyObject_NEW() called directly
128// PyObject_MALLOC() with _PyObject_SIZE().
129#define PyObject_NEW(type, typeobj) PyObject_New(type, typeobj)
130
Guido van Rossumb18618d2000-05-03 23:44:39 +0000131#define PyObject_NewVar(type, typeobj, n) \
Antoine Pitrouf95a1b32010-05-09 15:52:27 +0000132 ( (type *) _PyObject_NewVar((typeobj), (n)) )
Guido van Rossuma3309961993-07-28 09:05:47 +0000133
Victor Stinner92055202020-04-08 00:38:15 +0200134// Alias to PyObject_New(). In Python 3.8, PyObject_NEW() called directly
135// PyObject_MALLOC() with _PyObject_VAR_SIZE().
136#define PyObject_NEW_VAR(type, typeobj, n) PyObject_NewVar(type, typeobj, n)
Tim Peters6d483d32001-10-06 21:27:34 +0000137
Victor Stinnerf58bd7c2020-02-05 13:12:19 +0100138
139#ifdef Py_LIMITED_API
140/* Define PyObject_INIT() and PyObject_INIT_VAR() as aliases to PyObject_Init()
141 and PyObject_InitVar() in the limited C API for compatibility with the
142 CPython C API. */
143# define PyObject_INIT(op, typeobj) \
144 PyObject_Init(_PyObject_CAST(op), (typeobj))
145# define PyObject_INIT_VAR(op, typeobj, size) \
146 PyObject_InitVar(_PyVarObject_CAST(op), (typeobj), (size))
147#else
148/* PyObject_INIT() and PyObject_INIT_VAR() are defined in cpython/objimpl.h */
149#endif
150
151
Jeremy Hyltonc5007aa2000-06-30 05:02:53 +0000152/*
153 * Garbage Collection Support
154 * ==========================
155 */
Jeremy Hyltond08b4c42000-06-23 19:37:02 +0000156
Łukasz Langafef7e942016-09-09 21:47:46 -0700157/* C equivalent of gc.collect() which ignores the state of gc.enabled. */
Neal Norwitz7b216c52006-03-04 20:01:53 +0000158PyAPI_FUNC(Py_ssize_t) PyGC_Collect(void);
Guido van Rossume13ddc92003-04-17 17:29:22 +0000159
Neil Schemenauer74b5ade2001-08-29 23:49:28 +0000160/* Test if a type has a GC head */
161#define PyType_IS_GC(t) PyType_HasFeature((t), Py_TPFLAGS_HAVE_GC)
Jeremy Hyltond08b4c42000-06-23 19:37:02 +0000162
Martin v. Löwis41290682006-02-16 14:56:14 +0000163PyAPI_FUNC(PyVarObject *) _PyObject_GC_Resize(PyVarObject *, Py_ssize_t);
Neil Schemenauer74b5ade2001-08-29 23:49:28 +0000164#define PyObject_GC_Resize(type, op, n) \
Victor Stinner2ff8fb72018-11-22 02:57:29 +0100165 ( (type *) _PyObject_GC_Resize(_PyVarObject_CAST(op), (n)) )
Neil Schemenauer74b5ade2001-08-29 23:49:28 +0000166
Victor Stinner1a6be912018-11-13 12:52:18 +0100167
Victor Stinner1a6be912018-11-13 12:52:18 +0100168
Mark Hammond91a681d2002-08-12 07:21:58 +0000169PyAPI_FUNC(PyObject *) _PyObject_GC_New(PyTypeObject *);
Martin v. Löwis18e16552006-02-15 17:27:45 +0000170PyAPI_FUNC(PyVarObject *) _PyObject_GC_NewVar(PyTypeObject *, Py_ssize_t);
Victor Stinner1a6be912018-11-13 12:52:18 +0100171
172/* Tell the GC to track this object.
173 *
174 * See also private _PyObject_GC_TRACK() macro. */
Mark Hammond91a681d2002-08-12 07:21:58 +0000175PyAPI_FUNC(void) PyObject_GC_Track(void *);
Victor Stinner1a6be912018-11-13 12:52:18 +0100176
177/* Tell the GC to stop tracking this object.
178 *
179 * See also private _PyObject_GC_UNTRACK() macro. */
Mark Hammond91a681d2002-08-12 07:21:58 +0000180PyAPI_FUNC(void) PyObject_GC_UnTrack(void *);
Victor Stinner1a6be912018-11-13 12:52:18 +0100181
Mark Hammond91a681d2002-08-12 07:21:58 +0000182PyAPI_FUNC(void) PyObject_GC_Del(void *);
Neil Schemenauer74b5ade2001-08-29 23:49:28 +0000183
184#define PyObject_GC_New(type, typeobj) \
Antoine Pitrouf95a1b32010-05-09 15:52:27 +0000185 ( (type *) _PyObject_GC_New(typeobj) )
Neil Schemenauer74b5ade2001-08-29 23:49:28 +0000186#define PyObject_GC_NewVar(type, typeobj, n) \
Antoine Pitrouf95a1b32010-05-09 15:52:27 +0000187 ( (type *) _PyObject_GC_NewVar((typeobj), (n)) )
Neil Schemenauer3e7b8932002-04-12 02:38:45 +0000188
Pablo Galindof13072b2020-04-11 01:21:54 +0100189PyAPI_FUNC(int) PyObject_GC_IsTracked(PyObject *);
190PyAPI_FUNC(int) PyObject_GC_IsFinalized(PyObject *);
Neil Schemenauer74b5ade2001-08-29 23:49:28 +0000191
Tim Peterseda29302004-07-15 04:05:59 +0000192/* Utility macro to help write tp_traverse functions.
193 * To use this macro, the tp_traverse function must name its arguments
194 * "visit" and "arg". This is intended to keep tp_traverse functions
195 * looking as much alike as possible.
196 */
Antoine Pitrouf95a1b32010-05-09 15:52:27 +0000197#define Py_VISIT(op) \
198 do { \
199 if (op) { \
Victor Stinner2ff8fb72018-11-22 02:57:29 +0100200 int vret = visit(_PyObject_CAST(op), arg); \
Antoine Pitrouf95a1b32010-05-09 15:52:27 +0000201 if (vret) \
202 return vret; \
203 } \
204 } while (0)
Jim Fultonaa6389e2004-07-14 19:08:17 +0000205
Christian Tismerea62ce72018-06-09 20:32:25 +0200206#ifndef Py_LIMITED_API
Victor Stinnere4211062018-11-23 17:00:00 +0100207# define Py_CPYTHON_OBJIMPL_H
208# include "cpython/objimpl.h"
209# undef Py_CPYTHON_OBJIMPL_H
Christian Tismerea62ce72018-06-09 20:32:25 +0200210#endif
Fred Drake41deb1e2001-02-01 05:27:45 +0000211
Guido van Rossuma3309961993-07-28 09:05:47 +0000212#ifdef __cplusplus
213}
214#endif
215#endif /* !Py_OBJIMPL_H */