blob: ae5907deed8a78d1a13c78c24959c0852a2662f2 [file] [log] [blame]
Dean Moldovan67b52d82016-10-16 19:12:43 +02001Classes
2#######
3
4This section presents advanced binding code for classes and it is assumed
5that you are already familiar with the basics from :doc:`/classes`.
6
7.. _overriding_virtuals:
8
9Overriding virtual functions in Python
10======================================
11
12Suppose that a C++ class or interface has a virtual function that we'd like to
13to override from within Python (we'll focus on the class ``Animal``; ``Dog`` is
14given as a specific example of how one would do this with traditional C++
15code).
16
17.. code-block:: cpp
18
19 class Animal {
20 public:
21 virtual ~Animal() { }
22 virtual std::string go(int n_times) = 0;
23 };
24
25 class Dog : public Animal {
26 public:
27 std::string go(int n_times) override {
28 std::string result;
29 for (int i=0; i<n_times; ++i)
30 result += "woof! ";
31 return result;
32 }
33 };
34
35Let's also suppose that we are given a plain function which calls the
36function ``go()`` on an arbitrary ``Animal`` instance.
37
38.. code-block:: cpp
39
40 std::string call_go(Animal *animal) {
41 return animal->go(3);
42 }
43
44Normally, the binding code for these classes would look as follows:
45
46.. code-block:: cpp
47
Dean Moldovan443ab592017-04-24 01:51:44 +020048 PYBIND11_MODULE(example, m) {
François Beckerce9d6e22018-05-07 15:18:08 +020049 py::class_<Animal>(m, "Animal")
Dean Moldovan67b52d82016-10-16 19:12:43 +020050 .def("go", &Animal::go);
51
Tom de Geusa7ff6162018-05-04 17:04:45 +020052 py::class_<Dog, Animal>(m, "Dog")
Dean Moldovan67b52d82016-10-16 19:12:43 +020053 .def(py::init<>());
54
55 m.def("call_go", &call_go);
Dean Moldovan67b52d82016-10-16 19:12:43 +020056 }
57
58However, these bindings are impossible to extend: ``Animal`` is not
59constructible, and we clearly require some kind of "trampoline" that
60redirects virtual calls back to Python.
61
62Defining a new type of ``Animal`` from within Python is possible but requires a
63helper class that is defined as follows:
64
65.. code-block:: cpp
66
67 class PyAnimal : public Animal {
68 public:
69 /* Inherit the constructors */
70 using Animal::Animal;
71
72 /* Trampoline (need one for each virtual function) */
73 std::string go(int n_times) override {
74 PYBIND11_OVERLOAD_PURE(
75 std::string, /* Return type */
76 Animal, /* Parent class */
jbarlow837830e852017-01-13 02:17:29 -080077 go, /* Name of function in C++ (must match Python name) */
Dean Moldovan67b52d82016-10-16 19:12:43 +020078 n_times /* Argument(s) */
79 );
80 }
81 };
82
Ivor Wanders2b045752019-06-10 16:12:28 -040083The macro :c:macro:`PYBIND11_OVERLOAD_PURE` should be used for pure virtual
84functions, and :c:macro:`PYBIND11_OVERLOAD` should be used for functions which have
85a default implementation. There are also two alternate macros
86:c:macro:`PYBIND11_OVERLOAD_PURE_NAME` and :c:macro:`PYBIND11_OVERLOAD_NAME` which
Dean Moldovan67b52d82016-10-16 19:12:43 +020087take a string-valued name argument between the *Parent class* and *Name of the
Dean Moldovan234f7c32017-08-17 17:03:46 +020088function* slots, which defines the name of function in Python. This is required
jbarlow837830e852017-01-13 02:17:29 -080089when the C++ and Python versions of the
Dean Moldovan67b52d82016-10-16 19:12:43 +020090function have different names, e.g. ``operator()`` vs ``__call__``.
91
92The binding code also needs a few minor adaptations (highlighted):
93
94.. code-block:: cpp
Tom de Geusa7ff6162018-05-04 17:04:45 +020095 :emphasize-lines: 2,3
Dean Moldovan67b52d82016-10-16 19:12:43 +020096
Dean Moldovan443ab592017-04-24 01:51:44 +020097 PYBIND11_MODULE(example, m) {
François Beckerce9d6e22018-05-07 15:18:08 +020098 py::class_<Animal, PyAnimal /* <--- trampoline*/>(m, "Animal")
Dean Moldovan67b52d82016-10-16 19:12:43 +020099 .def(py::init<>())
100 .def("go", &Animal::go);
101
Tom de Geusa7ff6162018-05-04 17:04:45 +0200102 py::class_<Dog, Animal>(m, "Dog")
Dean Moldovan67b52d82016-10-16 19:12:43 +0200103 .def(py::init<>());
104
105 m.def("call_go", &call_go);
Dean Moldovan67b52d82016-10-16 19:12:43 +0200106 }
107
108Importantly, pybind11 is made aware of the trampoline helper class by
jbarlow837830e852017-01-13 02:17:29 -0800109specifying it as an extra template argument to :class:`class_`. (This can also
Dean Moldovan67b52d82016-10-16 19:12:43 +0200110be combined with other template arguments such as a custom holder type; the
111order of template types does not matter). Following this, we are able to
112define a constructor as usual.
113
jbarlow837830e852017-01-13 02:17:29 -0800114Bindings should be made against the actual class, not the trampoline helper class.
115
116.. code-block:: cpp
Tom de Geusa7ff6162018-05-04 17:04:45 +0200117 :emphasize-lines: 3
jbarlow837830e852017-01-13 02:17:29 -0800118
Tom de Geusa7ff6162018-05-04 17:04:45 +0200119 py::class_<Animal, PyAnimal /* <--- trampoline*/>(m, "Animal");
120 .def(py::init<>())
121 .def("go", &PyAnimal::go); /* <--- THIS IS WRONG, use &Animal::go */
jbarlow837830e852017-01-13 02:17:29 -0800122
Dean Moldovan67b52d82016-10-16 19:12:43 +0200123Note, however, that the above is sufficient for allowing python classes to
EricCousineau-TRIe06077b2017-08-07 18:37:42 -0400124extend ``Animal``, but not ``Dog``: see :ref:`virtual_and_inheritance` for the
Dean Moldovan67b52d82016-10-16 19:12:43 +0200125necessary steps required to providing proper overload support for inherited
126classes.
127
128The Python session below shows how to override ``Animal::go`` and invoke it via
129a virtual method call.
130
131.. code-block:: pycon
132
133 >>> from example import *
134 >>> d = Dog()
135 >>> call_go(d)
136 u'woof! woof! woof! '
137 >>> class Cat(Animal):
138 ... def go(self, n_times):
139 ... return "meow! " * n_times
140 ...
141 >>> c = Cat()
142 >>> call_go(c)
143 u'meow! meow! meow! '
144
EricCousineau-TRIe06077b2017-08-07 18:37:42 -0400145If you are defining a custom constructor in a derived Python class, you *must*
146ensure that you explicitly call the bound C++ constructor using ``__init__``,
147*regardless* of whether it is a default constructor or not. Otherwise, the
148memory for the C++ portion of the instance will be left uninitialized, which
149will generally leave the C++ instance in an invalid state and cause undefined
150behavior if the C++ instance is subsequently used.
151
152Here is an example:
153
154.. code-block:: python
155
Manuel Schneider492da592019-06-10 22:02:58 +0200156 class Dachshund(Dog):
EricCousineau-TRIe06077b2017-08-07 18:37:42 -0400157 def __init__(self, name):
Tom de Geusa7ff6162018-05-04 17:04:45 +0200158 Dog.__init__(self) # Without this, undefined behavior may occur if the C++ portions are referenced.
EricCousineau-TRIe06077b2017-08-07 18:37:42 -0400159 self.name = name
160 def bark(self):
161 return "yap!"
162
163Note that a direct ``__init__`` constructor *should be called*, and ``super()``
164should not be used. For simple cases of linear inheritance, ``super()``
165may work, but once you begin mixing Python and C++ multiple inheritance,
166things will fall apart due to differences between Python's MRO and C++'s
167mechanisms.
168
Dean Moldovan67b52d82016-10-16 19:12:43 +0200169Please take a look at the :ref:`macro_notes` before using this feature.
170
171.. note::
172
173 When the overridden type returns a reference or pointer to a type that
174 pybind11 converts from Python (for example, numeric values, std::string,
175 and other built-in value-converting types), there are some limitations to
176 be aware of:
177
178 - because in these cases there is no C++ variable to reference (the value
179 is stored in the referenced Python variable), pybind11 provides one in
180 the PYBIND11_OVERLOAD macros (when needed) with static storage duration.
181 Note that this means that invoking the overloaded method on *any*
182 instance will change the referenced value stored in *all* instances of
183 that type.
184
185 - Attempts to modify a non-const reference will not have the desired
186 effect: it will change only the static cache variable, but this change
187 will not propagate to underlying Python instance, and the change will be
188 replaced the next time the overload is invoked.
189
190.. seealso::
191
192 The file :file:`tests/test_virtual_functions.cpp` contains a complete
193 example that demonstrates how to override virtual functions using pybind11
194 in more detail.
195
196.. _virtual_and_inheritance:
197
198Combining virtual functions and inheritance
199===========================================
200
201When combining virtual methods with inheritance, you need to be sure to provide
202an override for each method for which you want to allow overrides from derived
203python classes. For example, suppose we extend the above ``Animal``/``Dog``
204example as follows:
205
206.. code-block:: cpp
207
208 class Animal {
209 public:
210 virtual std::string go(int n_times) = 0;
211 virtual std::string name() { return "unknown"; }
212 };
myd73499b815ad2017-01-13 18:15:52 +0800213 class Dog : public Animal {
Dean Moldovan67b52d82016-10-16 19:12:43 +0200214 public:
215 std::string go(int n_times) override {
216 std::string result;
217 for (int i=0; i<n_times; ++i)
218 result += bark() + " ";
219 return result;
220 }
221 virtual std::string bark() { return "woof!"; }
222 };
223
224then the trampoline class for ``Animal`` must, as described in the previous
225section, override ``go()`` and ``name()``, but in order to allow python code to
226inherit properly from ``Dog``, we also need a trampoline class for ``Dog`` that
227overrides both the added ``bark()`` method *and* the ``go()`` and ``name()``
228methods inherited from ``Animal`` (even though ``Dog`` doesn't directly
229override the ``name()`` method):
230
231.. code-block:: cpp
232
233 class PyAnimal : public Animal {
234 public:
235 using Animal::Animal; // Inherit constructors
236 std::string go(int n_times) override { PYBIND11_OVERLOAD_PURE(std::string, Animal, go, n_times); }
237 std::string name() override { PYBIND11_OVERLOAD(std::string, Animal, name, ); }
238 };
239 class PyDog : public Dog {
240 public:
241 using Dog::Dog; // Inherit constructors
Omar Awileac6cb912019-06-10 21:56:17 +0200242 std::string go(int n_times) override { PYBIND11_OVERLOAD(std::string, Dog, go, n_times); }
Dean Moldovan67b52d82016-10-16 19:12:43 +0200243 std::string name() override { PYBIND11_OVERLOAD(std::string, Dog, name, ); }
244 std::string bark() override { PYBIND11_OVERLOAD(std::string, Dog, bark, ); }
245 };
246
Wenzel Jakobab262592017-03-22 21:39:19 +0100247.. note::
248
249 Note the trailing commas in the ``PYBIND11_OVERLOAD`` calls to ``name()``
250 and ``bark()``. These are needed to portably implement a trampoline for a
251 function that does not take any arguments. For functions that take
252 a nonzero number of arguments, the trailing comma must be omitted.
253
Dean Moldovan67b52d82016-10-16 19:12:43 +0200254A registered class derived from a pybind11-registered class with virtual
255methods requires a similar trampoline class, *even if* it doesn't explicitly
256declare or override any virtual methods itself:
257
258.. code-block:: cpp
259
260 class Husky : public Dog {};
261 class PyHusky : public Husky {
myd73499b815ad2017-01-13 18:15:52 +0800262 public:
263 using Husky::Husky; // Inherit constructors
Dean Moldovan67b52d82016-10-16 19:12:43 +0200264 std::string go(int n_times) override { PYBIND11_OVERLOAD_PURE(std::string, Husky, go, n_times); }
265 std::string name() override { PYBIND11_OVERLOAD(std::string, Husky, name, ); }
266 std::string bark() override { PYBIND11_OVERLOAD(std::string, Husky, bark, ); }
267 };
268
269There is, however, a technique that can be used to avoid this duplication
270(which can be especially helpful for a base class with several virtual
271methods). The technique involves using template trampoline classes, as
272follows:
273
274.. code-block:: cpp
275
276 template <class AnimalBase = Animal> class PyAnimal : public AnimalBase {
myd73499b815ad2017-01-13 18:15:52 +0800277 public:
Dean Moldovan67b52d82016-10-16 19:12:43 +0200278 using AnimalBase::AnimalBase; // Inherit constructors
279 std::string go(int n_times) override { PYBIND11_OVERLOAD_PURE(std::string, AnimalBase, go, n_times); }
280 std::string name() override { PYBIND11_OVERLOAD(std::string, AnimalBase, name, ); }
281 };
282 template <class DogBase = Dog> class PyDog : public PyAnimal<DogBase> {
myd73499b815ad2017-01-13 18:15:52 +0800283 public:
Dean Moldovan67b52d82016-10-16 19:12:43 +0200284 using PyAnimal<DogBase>::PyAnimal; // Inherit constructors
285 // Override PyAnimal's pure virtual go() with a non-pure one:
286 std::string go(int n_times) override { PYBIND11_OVERLOAD(std::string, DogBase, go, n_times); }
287 std::string bark() override { PYBIND11_OVERLOAD(std::string, DogBase, bark, ); }
288 };
289
290This technique has the advantage of requiring just one trampoline method to be
291declared per virtual method and pure virtual method override. It does,
292however, require the compiler to generate at least as many methods (and
293possibly more, if both pure virtual and overridden pure virtual methods are
294exposed, as above).
295
296The classes are then registered with pybind11 using:
297
298.. code-block:: cpp
299
300 py::class_<Animal, PyAnimal<>> animal(m, "Animal");
301 py::class_<Dog, PyDog<>> dog(m, "Dog");
302 py::class_<Husky, PyDog<Husky>> husky(m, "Husky");
303 // ... add animal, dog, husky definitions
304
305Note that ``Husky`` did not require a dedicated trampoline template class at
306all, since it neither declares any new virtual methods nor provides any pure
307virtual method implementations.
308
309With either the repeated-virtuals or templated trampoline methods in place, you
310can now create a python class that inherits from ``Dog``:
311
312.. code-block:: python
313
314 class ShihTzu(Dog):
315 def bark(self):
316 return "yip!"
317
318.. seealso::
319
320 See the file :file:`tests/test_virtual_functions.cpp` for complete examples
321 using both the duplication and templated trampoline approaches.
322
Jason Rhinelander464d9892017-06-12 21:52:48 -0400323.. _extended_aliases:
324
Dean Moldovan67b52d82016-10-16 19:12:43 +0200325Extended trampoline class functionality
326=======================================
327
Roland Dreier7a24bcf2019-06-11 01:57:49 -0700328.. _extended_class_functionality_forced_trampoline:
Ivor Wanders2b045752019-06-10 16:12:28 -0400329
330Forced trampoline class initialisation
331--------------------------------------
Dean Moldovan67b52d82016-10-16 19:12:43 +0200332The trampoline classes described in the previous sections are, by default, only
333initialized when needed. More specifically, they are initialized when a python
334class actually inherits from a registered type (instead of merely creating an
335instance of the registered type), or when a registered constructor is only
336valid for the trampoline class but not the registered class. This is primarily
337for performance reasons: when the trampoline class is not needed for anything
338except virtual method dispatching, not initializing the trampoline class
339improves performance by avoiding needing to do a run-time check to see if the
340inheriting python instance has an overloaded method.
341
342Sometimes, however, it is useful to always initialize a trampoline class as an
343intermediate class that does more than just handle virtual method dispatching.
344For example, such a class might perform extra class initialization, extra
345destruction operations, and might define new members and methods to enable a
346more python-like interface to a class.
347
348In order to tell pybind11 that it should *always* initialize the trampoline
349class when creating new instances of a type, the class constructors should be
350declared using ``py::init_alias<Args, ...>()`` instead of the usual
351``py::init<Args, ...>()``. This forces construction via the trampoline class,
352ensuring member initialization and (eventual) destruction.
353
354.. seealso::
355
Dean Moldovan0bc272b2017-06-22 23:42:11 +0200356 See the file :file:`tests/test_virtual_functions.cpp` for complete examples
Dean Moldovan67b52d82016-10-16 19:12:43 +0200357 showing both normal and forced trampoline instantiation.
358
Ivor Wanders2b045752019-06-10 16:12:28 -0400359Different method signatures
360---------------------------
361The macro's introduced in :ref:`overriding_virtuals` cover most of the standard
362use cases when exposing C++ classes to Python. Sometimes it is hard or unwieldy
363to create a direct one-on-one mapping between the arguments and method return
364type.
365
366An example would be when the C++ signature contains output arguments using
367references (See also :ref:`faq_reference_arguments`). Another way of solving
368this is to use the method body of the trampoline class to do conversions to the
369input and return of the Python method.
370
371The main building block to do so is the :func:`get_overload`, this function
372allows retrieving a method implemented in Python from within the trampoline's
373methods. Consider for example a C++ method which has the signature
374``bool myMethod(int32_t& value)``, where the return indicates whether
375something should be done with the ``value``. This can be made convenient on the
376Python side by allowing the Python function to return ``None`` or an ``int``:
377
378.. code-block:: cpp
379
380 bool MyClass::myMethod(int32_t& value)
381 {
382 pybind11::gil_scoped_acquire gil; // Acquire the GIL while in this scope.
383 // Try to look up the overloaded method on the Python side.
384 pybind11::function overload = pybind11::get_overload(this, "myMethod");
385 if (overload) { // method is found
386 auto obj = overload(value); // Call the Python function.
387 if (py::isinstance<py::int_>(obj)) { // check if it returned a Python integer type
388 value = obj.cast<int32_t>(); // Cast it and assign it to the value.
389 return true; // Return true; value should be used.
390 } else {
391 return false; // Python returned none, return false.
392 }
393 }
394 return false; // Alternatively return MyClass::myMethod(value);
395 }
396
397
Dean Moldovan67b52d82016-10-16 19:12:43 +0200398.. _custom_constructors:
399
400Custom constructors
401===================
402
403The syntax for binding constructors was previously introduced, but it only
Jason Rhinelander464d9892017-06-12 21:52:48 -0400404works when a constructor of the appropriate arguments actually exists on the
Dean Moldovan0991d7f2017-09-05 16:49:33 +0200405C++ side. To extend this to more general cases, pybind11 makes it possible
406to bind factory functions as constructors. For example, suppose you have a
Jason Rhinelander464d9892017-06-12 21:52:48 -0400407class like this:
408
409.. code-block:: cpp
410
411 class Example {
412 private:
413 Example(int); // private constructor
414 public:
415 // Factory function:
416 static Example create(int a) { return Example(a); }
417 };
418
Dean Moldovan0991d7f2017-09-05 16:49:33 +0200419 py::class_<Example>(m, "Example")
420 .def(py::init(&Example::create));
421
Wenzel Jakobfb276c62017-08-22 00:55:53 +0200422While it is possible to create a straightforward binding of the static
423``create`` method, it may sometimes be preferable to expose it as a constructor
424on the Python side. This can be accomplished by calling ``.def(py::init(...))``
425with the function reference returning the new instance passed as an argument.
426It is also possible to use this approach to bind a function returning a new
427instance by raw pointer or by the holder (e.g. ``std::unique_ptr``).
Jason Rhinelander464d9892017-06-12 21:52:48 -0400428
429The following example shows the different approaches:
430
431.. code-block:: cpp
432
433 class Example {
434 private:
435 Example(int); // private constructor
436 public:
437 // Factory function - returned by value:
438 static Example create(int a) { return Example(a); }
439
440 // These constructors are publicly callable:
441 Example(double);
442 Example(int, int);
443 Example(std::string);
444 };
445
446 py::class_<Example>(m, "Example")
447 // Bind the factory function as a constructor:
448 .def(py::init(&Example::create))
449 // Bind a lambda function returning a pointer wrapped in a holder:
450 .def(py::init([](std::string arg) {
451 return std::unique_ptr<Example>(new Example(arg));
452 }))
453 // Return a raw pointer:
454 .def(py::init([](int a, int b) { return new Example(a, b); }))
455 // You can mix the above with regular C++ constructor bindings as well:
456 .def(py::init<double>())
457 ;
458
459When the constructor is invoked from Python, pybind11 will call the factory
460function and store the resulting C++ instance in the Python instance.
461
Wenzel Jakobfb276c62017-08-22 00:55:53 +0200462When combining factory functions constructors with :ref:`virtual function
463trampolines <overriding_virtuals>` there are two approaches. The first is to
464add a constructor to the alias class that takes a base value by
465rvalue-reference. If such a constructor is available, it will be used to
466construct an alias instance from the value returned by the factory function.
467The second option is to provide two factory functions to ``py::init()``: the
468first will be invoked when no alias class is required (i.e. when the class is
469being used but not inherited from in Python), and the second will be invoked
470when an alias is required.
Jason Rhinelander464d9892017-06-12 21:52:48 -0400471
472You can also specify a single factory function that always returns an alias
473instance: this will result in behaviour similar to ``py::init_alias<...>()``,
Wenzel Jakobfb276c62017-08-22 00:55:53 +0200474as described in the :ref:`extended trampoline class documentation
475<extended_aliases>`.
Jason Rhinelander464d9892017-06-12 21:52:48 -0400476
477The following example shows the different factory approaches for a class with
478an alias:
479
480.. code-block:: cpp
481
482 #include <pybind11/factory.h>
483 class Example {
484 public:
485 // ...
486 virtual ~Example() = default;
487 };
488 class PyExample : public Example {
489 public:
490 using Example::Example;
491 PyExample(Example &&base) : Example(std::move(base)) {}
492 };
493 py::class_<Example, PyExample>(m, "Example")
494 // Returns an Example pointer. If a PyExample is needed, the Example
495 // instance will be moved via the extra constructor in PyExample, above.
496 .def(py::init([]() { return new Example(); }))
497 // Two callbacks:
498 .def(py::init([]() { return new Example(); } /* no alias needed */,
499 []() { return new PyExample(); } /* alias needed */))
500 // *Always* returns an alias instance (like py::init_alias<>())
501 .def(py::init([]() { return new PyExample(); }))
502 ;
503
Wenzel Jakob4336a7d2017-08-21 22:48:28 +0200504Brace initialization
505--------------------
506
507``pybind11::init<>`` internally uses C++11 brace initialization to call the
508constructor of the target class. This means that it can be used to bind
509*implicit* constructors as well:
510
511.. code-block:: cpp
512
513 struct Aggregate {
514 int a;
515 std::string b;
516 };
517
518 py::class_<Aggregate>(m, "Aggregate")
519 .def(py::init<int, const std::string &>());
520
521.. note::
522
523 Note that brace initialization preferentially invokes constructor overloads
524 taking a ``std::initializer_list``. In the rare event that this causes an
525 issue, you can work around it by using ``py::init(...)`` with a lambda
526 function that constructs the new object as desired.
527
Dean Moldovan67b52d82016-10-16 19:12:43 +0200528.. _classes_with_non_public_destructors:
529
530Non-public destructors
531======================
532
533If a class has a private or protected destructor (as might e.g. be the case in
534a singleton pattern), a compile error will occur when creating bindings via
535pybind11. The underlying issue is that the ``std::unique_ptr`` holder type that
536is responsible for managing the lifetime of instances will reference the
537destructor even if no deallocations ever take place. In order to expose classes
538with private or protected destructors, it is possible to override the holder
539type via a holder type argument to ``class_``. Pybind11 provides a helper class
540``py::nodelete`` that disables any destructor invocations. In this case, it is
541crucial that instances are deallocated on the C++ side to avoid memory leaks.
542
543.. code-block:: cpp
544
545 /* ... definition ... */
546
547 class MyClass {
548 private:
549 ~MyClass() { }
550 };
551
552 /* ... binding code ... */
553
554 py::class_<MyClass, std::unique_ptr<MyClass, py::nodelete>>(m, "MyClass")
myd73499b815ad2017-01-13 18:15:52 +0800555 .def(py::init<>())
Dean Moldovan67b52d82016-10-16 19:12:43 +0200556
Jason Rhinelanderabc29ca2017-01-23 03:50:00 -0500557.. _implicit_conversions:
558
Dean Moldovan67b52d82016-10-16 19:12:43 +0200559Implicit conversions
560====================
561
562Suppose that instances of two types ``A`` and ``B`` are used in a project, and
563that an ``A`` can easily be converted into an instance of type ``B`` (examples of this
564could be a fixed and an arbitrary precision number type).
565
566.. code-block:: cpp
567
568 py::class_<A>(m, "A")
569 /// ... members ...
570
571 py::class_<B>(m, "B")
572 .def(py::init<A>())
573 /// ... members ...
574
575 m.def("func",
576 [](const B &) { /* .... */ }
577 );
578
579To invoke the function ``func`` using a variable ``a`` containing an ``A``
580instance, we'd have to write ``func(B(a))`` in Python. On the other hand, C++
581will automatically apply an implicit type conversion, which makes it possible
582to directly write ``func(a)``.
583
584In this situation (i.e. where ``B`` has a constructor that converts from
585``A``), the following statement enables similar implicit conversions on the
586Python side:
587
588.. code-block:: cpp
589
590 py::implicitly_convertible<A, B>();
591
592.. note::
593
594 Implicit conversions from ``A`` to ``B`` only work when ``B`` is a custom
595 data type that is exposed to Python via pybind11.
596
Wenzel Jakob8ed5b8a2017-08-28 16:34:06 +0200597 To prevent runaway recursion, implicit conversions are non-reentrant: an
598 implicit conversion invoked as part of another implicit conversion of the
599 same type (i.e. from ``A`` to ``B``) will fail.
600
Dean Moldovan67b52d82016-10-16 19:12:43 +0200601.. _static_properties:
602
603Static properties
604=================
605
606The section on :ref:`properties` discussed the creation of instance properties
607that are implemented in terms of C++ getters and setters.
608
609Static properties can also be created in a similar way to expose getters and
Dean Moldovandd016652017-02-16 23:02:56 +0100610setters of static class attributes. Note that the implicit ``self`` argument
611also exists in this case and is used to pass the Python ``type`` subclass
612instance. This parameter will often not be needed by the C++ side, and the
613following example illustrates how to instantiate a lambda getter function
614that ignores it:
Dean Moldovan67b52d82016-10-16 19:12:43 +0200615
616.. code-block:: cpp
617
Dean Moldovandd016652017-02-16 23:02:56 +0100618 py::class_<Foo>(m, "Foo")
Dean Moldovan67b52d82016-10-16 19:12:43 +0200619 .def_property_readonly_static("foo", [](py::object /* self */) { return Foo(); });
620
621Operator overloading
622====================
623
624Suppose that we're given the following ``Vector2`` class with a vector addition
625and scalar multiplication operation, all implemented using overloaded operators
626in C++.
627
628.. code-block:: cpp
629
630 class Vector2 {
631 public:
632 Vector2(float x, float y) : x(x), y(y) { }
633
634 Vector2 operator+(const Vector2 &v) const { return Vector2(x + v.x, y + v.y); }
635 Vector2 operator*(float value) const { return Vector2(x * value, y * value); }
636 Vector2& operator+=(const Vector2 &v) { x += v.x; y += v.y; return *this; }
637 Vector2& operator*=(float v) { x *= v; y *= v; return *this; }
638
639 friend Vector2 operator*(float f, const Vector2 &v) {
640 return Vector2(f * v.x, f * v.y);
641 }
642
643 std::string toString() const {
644 return "[" + std::to_string(x) + ", " + std::to_string(y) + "]";
645 }
646 private:
647 float x, y;
648 };
649
650The following snippet shows how the above operators can be conveniently exposed
651to Python.
652
653.. code-block:: cpp
654
655 #include <pybind11/operators.h>
656
Dean Moldovan443ab592017-04-24 01:51:44 +0200657 PYBIND11_MODULE(example, m) {
Dean Moldovan67b52d82016-10-16 19:12:43 +0200658 py::class_<Vector2>(m, "Vector2")
659 .def(py::init<float, float>())
660 .def(py::self + py::self)
661 .def(py::self += py::self)
662 .def(py::self *= float())
663 .def(float() * py::self)
myd73499b815ad2017-01-13 18:15:52 +0800664 .def(py::self * float())
Ian Bell502ffe52019-06-22 04:07:41 -0600665 .def(-py::self)
Dean Moldovan67b52d82016-10-16 19:12:43 +0200666 .def("__repr__", &Vector2::toString);
Dean Moldovan67b52d82016-10-16 19:12:43 +0200667 }
668
669Note that a line like
670
671.. code-block:: cpp
672
673 .def(py::self * float())
674
675is really just short hand notation for
676
677.. code-block:: cpp
678
679 .def("__mul__", [](const Vector2 &a, float b) {
680 return a * b;
681 }, py::is_operator())
682
683This can be useful for exposing additional operators that don't exist on the
684C++ side, or to perform other types of customization. The ``py::is_operator``
685flag marker is needed to inform pybind11 that this is an operator, which
686returns ``NotImplemented`` when invoked with incompatible arguments rather than
687throwing a type error.
688
689.. note::
690
691 To use the more convenient ``py::self`` notation, the additional
692 header file :file:`pybind11/operators.h` must be included.
693
694.. seealso::
695
696 The file :file:`tests/test_operator_overloading.cpp` contains a
697 complete example that demonstrates how to work with overloaded operators in
698 more detail.
699
Dean Moldovan1e5a7da2017-08-24 01:53:15 +0200700.. _pickling:
701
Dean Moldovan67b52d82016-10-16 19:12:43 +0200702Pickling support
703================
704
705Python's ``pickle`` module provides a powerful facility to serialize and
706de-serialize a Python object graph into a binary data stream. To pickle and
Dean Moldovan1e5a7da2017-08-24 01:53:15 +0200707unpickle C++ classes using pybind11, a ``py::pickle()`` definition must be
708provided. Suppose the class in question has the following signature:
Dean Moldovan67b52d82016-10-16 19:12:43 +0200709
710.. code-block:: cpp
711
712 class Pickleable {
713 public:
714 Pickleable(const std::string &value) : m_value(value) { }
715 const std::string &value() const { return m_value; }
716
717 void setExtra(int extra) { m_extra = extra; }
718 int extra() const { return m_extra; }
719 private:
720 std::string m_value;
721 int m_extra = 0;
722 };
723
Patrik Huber1ad22272017-09-04 22:00:19 +0100724Pickling support in Python is enabled by defining the ``__setstate__`` and
Dean Moldovan1e5a7da2017-08-24 01:53:15 +0200725``__getstate__`` methods [#f3]_. For pybind11 classes, use ``py::pickle()``
726to bind these two functions:
Dean Moldovan67b52d82016-10-16 19:12:43 +0200727
728.. code-block:: cpp
729
730 py::class_<Pickleable>(m, "Pickleable")
731 .def(py::init<std::string>())
732 .def("value", &Pickleable::value)
733 .def("extra", &Pickleable::extra)
734 .def("setExtra", &Pickleable::setExtra)
Dean Moldovan1e5a7da2017-08-24 01:53:15 +0200735 .def(py::pickle(
736 [](const Pickleable &p) { // __getstate__
737 /* Return a tuple that fully encodes the state of the object */
738 return py::make_tuple(p.value(), p.extra());
739 },
740 [](py::tuple t) { // __setstate__
741 if (t.size() != 2)
742 throw std::runtime_error("Invalid state!");
Dean Moldovan67b52d82016-10-16 19:12:43 +0200743
Dean Moldovan1e5a7da2017-08-24 01:53:15 +0200744 /* Create a new C++ instance */
745 Pickleable p(t[0].cast<std::string>());
Dean Moldovan67b52d82016-10-16 19:12:43 +0200746
Dean Moldovan1e5a7da2017-08-24 01:53:15 +0200747 /* Assign any additional state */
748 p.setExtra(t[1].cast<int>());
749
750 return p;
751 }
752 ));
753
754The ``__setstate__`` part of the ``py::picke()`` definition follows the same
755rules as the single-argument version of ``py::init()``. The return type can be
756a value, pointer or holder type. See :ref:`custom_constructors` for details.
Dean Moldovan67b52d82016-10-16 19:12:43 +0200757
758An instance can now be pickled as follows:
759
760.. code-block:: python
761
762 try:
763 import cPickle as pickle # Use cPickle on Python 2.7
764 except ImportError:
765 import pickle
766
767 p = Pickleable("test_value")
768 p.setExtra(15)
769 data = pickle.dumps(p, 2)
770
771Note that only the cPickle module is supported on Python 2.7. The second
772argument to ``dumps`` is also crucial: it selects the pickle protocol version
7732, since the older version 1 is not supported. Newer versions are also fine—for
774instance, specify ``-1`` to always use the latest available version. Beware:
775failure to follow these instructions will cause important pybind11 memory
776allocation routines to be skipped during unpickling, which will likely lead to
777memory corruption and/or segmentation faults.
778
779.. seealso::
780
781 The file :file:`tests/test_pickling.cpp` contains a complete example
782 that demonstrates how to pickle and unpickle types using pybind11 in more
783 detail.
784
785.. [#f3] http://docs.python.org/3/library/pickle.html#pickling-class-instances
786
787Multiple Inheritance
788====================
789
790pybind11 can create bindings for types that derive from multiple base types
791(aka. *multiple inheritance*). To do so, specify all bases in the template
792arguments of the ``class_`` declaration:
793
794.. code-block:: cpp
795
796 py::class_<MyType, BaseType1, BaseType2, BaseType3>(m, "MyType")
797 ...
798
799The base types can be specified in arbitrary order, and they can even be
800interspersed with alias types and holder types (discussed earlier in this
801document)---pybind11 will automatically find out which is which. The only
802requirement is that the first template argument is the type to be declared.
803
Jason Rhinelandere45c2112017-02-22 21:36:09 -0500804It is also permitted to inherit multiply from exported C++ classes in Python,
Tom de Geusa7ff6162018-05-04 17:04:45 +0200805as well as inheriting from multiple Python and/or pybind11-exported classes.
Dean Moldovan67b52d82016-10-16 19:12:43 +0200806
Jason Rhinelandere45c2112017-02-22 21:36:09 -0500807There is one caveat regarding the implementation of this feature:
Dean Moldovan67b52d82016-10-16 19:12:43 +0200808
Jason Rhinelandere45c2112017-02-22 21:36:09 -0500809When only one base type is specified for a C++ type that actually has multiple
810bases, pybind11 will assume that it does not participate in multiple
811inheritance, which can lead to undefined behavior. In such cases, add the tag
812``multiple_inheritance`` to the class constructor:
Dean Moldovan67b52d82016-10-16 19:12:43 +0200813
Jason Rhinelandere45c2112017-02-22 21:36:09 -0500814.. code-block:: cpp
Dean Moldovan67b52d82016-10-16 19:12:43 +0200815
Jason Rhinelandere45c2112017-02-22 21:36:09 -0500816 py::class_<MyType, BaseType2>(m, "MyType", py::multiple_inheritance());
Dean Moldovan67b52d82016-10-16 19:12:43 +0200817
Jason Rhinelandere45c2112017-02-22 21:36:09 -0500818The tag is redundant and does not need to be specified when multiple base types
819are listed.
Jason Rhinelander7437c692017-07-28 22:03:44 -0400820
821.. _module_local:
822
823Module-local class bindings
824===========================
825
Tom de Geusa7ff6162018-05-04 17:04:45 +0200826When creating a binding for a class, pybind11 by default makes that binding
Jason Rhinelander7437c692017-07-28 22:03:44 -0400827"global" across modules. What this means is that a type defined in one module
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400828can be returned from any module resulting in the same Python type. For
Jason Rhinelander7437c692017-07-28 22:03:44 -0400829example, this allows the following:
830
831.. code-block:: cpp
832
833 // In the module1.cpp binding code for module1:
834 py::class_<Pet>(m, "Pet")
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400835 .def(py::init<std::string>())
836 .def_readonly("name", &Pet::name);
Jason Rhinelander7437c692017-07-28 22:03:44 -0400837
838.. code-block:: cpp
839
840 // In the module2.cpp binding code for module2:
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400841 m.def("create_pet", [](std::string name) { return new Pet(name); });
Jason Rhinelander7437c692017-07-28 22:03:44 -0400842
843.. code-block:: pycon
844
845 >>> from module1 import Pet
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400846 >>> from module2 import create_pet
847 >>> pet1 = Pet("Kitty")
848 >>> pet2 = create_pet("Doggy")
849 >>> pet2.name()
850 'Doggy'
Jason Rhinelander7437c692017-07-28 22:03:44 -0400851
852When writing binding code for a library, this is usually desirable: this
853allows, for example, splitting up a complex library into multiple Python
854modules.
855
856In some cases, however, this can cause conflicts. For example, suppose two
857unrelated modules make use of an external C++ library and each provide custom
858bindings for one of that library's classes. This will result in an error when
859a Python program attempts to import both modules (directly or indirectly)
860because of conflicting definitions on the external type:
861
862.. code-block:: cpp
863
864 // dogs.cpp
865
866 // Binding for external library class:
867 py::class<pets::Pet>(m, "Pet")
868 .def("name", &pets::Pet::name);
869
870 // Binding for local extension class:
871 py::class<Dog, pets::Pet>(m, "Dog")
872 .def(py::init<std::string>());
873
874.. code-block:: cpp
875
876 // cats.cpp, in a completely separate project from the above dogs.cpp.
877
878 // Binding for external library class:
879 py::class<pets::Pet>(m, "Pet")
880 .def("get_name", &pets::Pet::name);
881
882 // Binding for local extending class:
883 py::class<Cat, pets::Pet>(m, "Cat")
884 .def(py::init<std::string>());
885
886.. code-block:: pycon
887
888 >>> import cats
889 >>> import dogs
890 Traceback (most recent call last):
891 File "<stdin>", line 1, in <module>
892 ImportError: generic_type: type "Pet" is already registered!
893
894To get around this, you can tell pybind11 to keep the external class binding
895localized to the module by passing the ``py::module_local()`` attribute into
896the ``py::class_`` constructor:
897
898.. code-block:: cpp
899
900 // Pet binding in dogs.cpp:
901 py::class<pets::Pet>(m, "Pet", py::module_local())
902 .def("name", &pets::Pet::name);
903
904.. code-block:: cpp
905
906 // Pet binding in cats.cpp:
907 py::class<pets::Pet>(m, "Pet", py::module_local())
908 .def("get_name", &pets::Pet::name);
909
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400910This makes the Python-side ``dogs.Pet`` and ``cats.Pet`` into distinct classes,
911avoiding the conflict and allowing both modules to be loaded. C++ code in the
912``dogs`` module that casts or returns a ``Pet`` instance will result in a
913``dogs.Pet`` Python instance, while C++ code in the ``cats`` module will result
914in a ``cats.Pet`` Python instance.
Jason Rhinelander7437c692017-07-28 22:03:44 -0400915
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400916This does come with two caveats, however: First, external modules cannot return
917or cast a ``Pet`` instance to Python (unless they also provide their own local
918bindings). Second, from the Python point of view they are two distinct classes.
919
920Note that the locality only applies in the C++ -> Python direction. When
921passing such a ``py::module_local`` type into a C++ function, the module-local
922classes are still considered. This means that if the following function is
923added to any module (including but not limited to the ``cats`` and ``dogs``
924modules above) it will be callable with either a ``dogs.Pet`` or ``cats.Pet``
925argument:
Jason Rhinelander7437c692017-07-28 22:03:44 -0400926
927.. code-block:: cpp
928
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400929 m.def("pet_name", [](const pets::Pet &pet) { return pet.name(); });
Jason Rhinelander7437c692017-07-28 22:03:44 -0400930
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400931For example, suppose the above function is added to each of ``cats.cpp``,
932``dogs.cpp`` and ``frogs.cpp`` (where ``frogs.cpp`` is some other module that
933does *not* bind ``Pets`` at all).
Jason Rhinelander7437c692017-07-28 22:03:44 -0400934
935.. code-block:: pycon
936
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400937 >>> import cats, dogs, frogs # No error because of the added py::module_local()
Jason Rhinelander7437c692017-07-28 22:03:44 -0400938 >>> mycat, mydog = cats.Cat("Fluffy"), dogs.Dog("Rover")
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400939 >>> (cats.pet_name(mycat), dogs.pet_name(mydog))
Jason Rhinelander7437c692017-07-28 22:03:44 -0400940 ('Fluffy', 'Rover')
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400941 >>> (cats.pet_name(mydog), dogs.pet_name(mycat), frogs.pet_name(mycat))
942 ('Rover', 'Fluffy', 'Fluffy')
Jason Rhinelander7437c692017-07-28 22:03:44 -0400943
Jason Rhinelander5e14aa62017-08-17 11:38:05 -0400944It is possible to use ``py::module_local()`` registrations in one module even
945if another module registers the same type globally: within the module with the
946module-local definition, all C++ instances will be cast to the associated bound
947Python type. In other modules any such values are converted to the global
948Python type created elsewhere.
Jason Rhinelander4b159232017-08-04 13:05:12 -0400949
Jason Rhinelander7437c692017-07-28 22:03:44 -0400950.. note::
951
952 STL bindings (as provided via the optional :file:`pybind11/stl_bind.h`
953 header) apply ``py::module_local`` by default when the bound type might
954 conflict with other modules; see :ref:`stl_bind` for details.
955
956.. note::
957
958 The localization of the bound types is actually tied to the shared object
959 or binary generated by the compiler/linker. For typical modules created
960 with ``PYBIND11_MODULE()``, this distinction is not significant. It is
961 possible, however, when :ref:`embedding` to embed multiple modules in the
962 same binary (see :ref:`embedding_modules`). In such a case, the
963 localization will apply across all embedded modules within the same binary.
964
965.. seealso::
966
967 The file :file:`tests/test_local_bindings.cpp` contains additional examples
968 that demonstrate how ``py::module_local()`` works.
Dean Moldovan234f7c32017-08-17 17:03:46 +0200969
970Binding protected member functions
971==================================
972
973It's normally not possible to expose ``protected`` member functions to Python:
974
975.. code-block:: cpp
976
977 class A {
978 protected:
979 int foo() const { return 42; }
980 };
981
982 py::class_<A>(m, "A")
983 .def("foo", &A::foo); // error: 'foo' is a protected member of 'A'
984
985On one hand, this is good because non-``public`` members aren't meant to be
986accessed from the outside. But we may want to make use of ``protected``
987functions in derived Python classes.
988
989The following pattern makes this possible:
990
991.. code-block:: cpp
992
993 class A {
994 protected:
995 int foo() const { return 42; }
996 };
997
998 class Publicist : public A { // helper type for exposing protected functions
999 public:
1000 using A::foo; // inherited with different access modifier
1001 };
1002
1003 py::class_<A>(m, "A") // bind the primary class
1004 .def("foo", &Publicist::foo); // expose protected methods via the publicist
1005
1006This works because ``&Publicist::foo`` is exactly the same function as
1007``&A::foo`` (same signature and address), just with a different access
1008modifier. The only purpose of the ``Publicist`` helper class is to make
1009the function name ``public``.
1010
1011If the intent is to expose ``protected`` ``virtual`` functions which can be
1012overridden in Python, the publicist pattern can be combined with the previously
1013described trampoline:
1014
1015.. code-block:: cpp
1016
1017 class A {
1018 public:
1019 virtual ~A() = default;
1020
1021 protected:
1022 virtual int foo() const { return 42; }
1023 };
1024
1025 class Trampoline : public A {
1026 public:
1027 int foo() const override { PYBIND11_OVERLOAD(int, A, foo, ); }
1028 };
1029
1030 class Publicist : public A {
1031 public:
1032 using A::foo;
1033 };
1034
1035 py::class_<A, Trampoline>(m, "A") // <-- `Trampoline` here
1036 .def("foo", &Publicist::foo); // <-- `Publicist` here, not `Trampoline`!
1037
1038.. note::
1039
1040 MSVC 2015 has a compiler bug (fixed in version 2017) which
1041 requires a more explicit function binding in the form of
1042 ``.def("foo", static_cast<int (A::*)() const>(&Publicist::foo));``
1043 where ``int (A::*)() const`` is the type of ``A::foo``.
oremanjfd9bc8f2018-04-13 20:13:10 -04001044
1045Custom automatic downcasters
1046============================
1047
1048As explained in :ref:`inheritance`, pybind11 comes with built-in
1049understanding of the dynamic type of polymorphic objects in C++; that
1050is, returning a Pet to Python produces a Python object that knows it's
1051wrapping a Dog, if Pet has virtual methods and pybind11 knows about
1052Dog and this Pet is in fact a Dog. Sometimes, you might want to
1053provide this automatic downcasting behavior when creating bindings for
1054a class hierarchy that does not use standard C++ polymorphism, such as
1055LLVM [#f4]_. As long as there's some way to determine at runtime
1056whether a downcast is safe, you can proceed by specializing the
1057``pybind11::polymorphic_type_hook`` template:
1058
1059.. code-block:: cpp
1060
1061 enum class PetKind { Cat, Dog, Zebra };
1062 struct Pet { // Not polymorphic: has no virtual methods
1063 const PetKind kind;
1064 int age = 0;
1065 protected:
1066 Pet(PetKind _kind) : kind(_kind) {}
1067 };
1068 struct Dog : Pet {
1069 Dog() : Pet(PetKind::Dog) {}
1070 std::string sound = "woof!";
1071 std::string bark() const { return sound; }
1072 };
1073
1074 namespace pybind11 {
1075 template<> struct polymorphic_type_hook<Pet> {
1076 static const void *get(const Pet *src, const std::type_info*& type) {
1077 // note that src may be nullptr
1078 if (src && src->kind == PetKind::Dog) {
1079 type = &typeid(Dog);
1080 return static_cast<const Dog*>(src);
1081 }
1082 return src;
1083 }
1084 };
1085 } // namespace pybind11
1086
1087When pybind11 wants to convert a C++ pointer of type ``Base*`` to a
1088Python object, it calls ``polymorphic_type_hook<Base>::get()`` to
1089determine if a downcast is possible. The ``get()`` function should use
1090whatever runtime information is available to determine if its ``src``
1091parameter is in fact an instance of some class ``Derived`` that
1092inherits from ``Base``. If it finds such a ``Derived``, it sets ``type
1093= &typeid(Derived)`` and returns a pointer to the ``Derived`` object
1094that contains ``src``. Otherwise, it just returns ``src``, leaving
1095``type`` at its default value of nullptr. If you set ``type`` to a
1096type that pybind11 doesn't know about, no downcasting will occur, and
1097the original ``src`` pointer will be used with its static type
1098``Base*``.
1099
1100It is critical that the returned pointer and ``type`` argument of
1101``get()`` agree with each other: if ``type`` is set to something
1102non-null, the returned pointer must point to the start of an object
1103whose type is ``type``. If the hierarchy being exposed uses only
1104single inheritance, a simple ``return src;`` will achieve this just
1105fine, but in the general case, you must cast ``src`` to the
1106appropriate derived-class pointer (e.g. using
1107``static_cast<Derived>(src)``) before allowing it to be returned as a
1108``void*``.
1109
1110.. [#f4] https://llvm.org/docs/HowToSetUpLLVMStyleRTTI.html
1111
1112.. note::
1113
1114 pybind11's standard support for downcasting objects whose types
1115 have virtual methods is implemented using
1116 ``polymorphic_type_hook`` too, using the standard C++ ability to
1117 determine the most-derived type of a polymorphic object using
1118 ``typeid()`` and to cast a base pointer to that most-derived type
1119 (even if you don't know what it is) using ``dynamic_cast<void*>``.
1120
1121.. seealso::
1122
1123 The file :file:`tests/test_tagbased_polymorphic.cpp` contains a
1124 more complete example, including a demonstration of how to provide
1125 automatic downcasting for an entire class hierarchy without
1126 writing one get() function for each class.