blob: 5a4af1b4f8809feef8e0d06f452f4bf904c67230 [file] [log] [blame] [view]
David Tolnay7db73692019-10-20 14:51:12 -04001CXX — safe FFI between Rust and C++
2=========================================
3
David Tolnaydd3af092020-05-12 21:47:06 -07004[<img alt="github" src="https://img.shields.io/badge/github-dtolnay/cxx-8da0cb?style=for-the-badge&labelColor=555555&logo=github" height="20">](https://github.com/dtolnay/cxx)
5[<img alt="crates.io" src="https://img.shields.io/crates/v/cxx.svg?style=for-the-badge&color=fc8d62&logo=rust" height="20">](https://crates.io/crates/cxx)
6[<img alt="docs.rs" src="https://img.shields.io/badge/docs.rs-cxx-66c2a5?style=for-the-badge&labelColor=555555&logoColor=white&logo=data:image/svg+xml;base64,PHN2ZyByb2xlPSJpbWciIHhtbG5zPSJodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2ZyIgdmlld0JveD0iMCAwIDUxMiA1MTIiPjxwYXRoIGZpbGw9IiNmNWY1ZjUiIGQ9Ik00ODguNiAyNTAuMkwzOTIgMjE0VjEwNS41YzAtMTUtOS4zLTI4LjQtMjMuNC0zMy43bC0xMDAtMzcuNWMtOC4xLTMuMS0xNy4xLTMuMS0yNS4zIDBsLTEwMCAzNy41Yy0xNC4xIDUuMy0yMy40IDE4LjctMjMuNCAzMy43VjIxNGwtOTYuNiAzNi4yQzkuMyAyNTUuNSAwIDI2OC45IDAgMjgzLjlWMzk0YzAgMTMuNiA3LjcgMjYuMSAxOS45IDMyLjJsMTAwIDUwYzEwLjEgNS4xIDIyLjEgNS4xIDMyLjIgMGwxMDMuOS01MiAxMDMuOSA1MmMxMC4xIDUuMSAyMi4xIDUuMSAzMi4yIDBsMTAwLTUwYzEyLjItNi4xIDE5LjktMTguNiAxOS45LTMyLjJWMjgzLjljMC0xNS05LjMtMjguNC0yMy40LTMzLjd6TTM1OCAyMTQuOGwtODUgMzEuOXYtNjguMmw4NS0zN3Y3My4zek0xNTQgMTA0LjFsMTAyLTM4LjIgMTAyIDM4LjJ2LjZsLTEwMiA0MS40LTEwMi00MS40di0uNnptODQgMjkxLjFsLTg1IDQyLjV2LTc5LjFsODUtMzguOHY3NS40em0wLTExMmwtMTAyIDQxLjQtMTAyLTQxLjR2LS42bDEwMi0zOC4yIDEwMiAzOC4ydi42em0yNDAgMTEybC04NSA0Mi41di03OS4xbDg1LTM4Ljh2NzUuNHptMC0xMTJsLTEwMiA0MS40LTEwMi00MS40di0uNmwxMDItMzguMiAxMDIgMzguMnYuNnoiPjwvcGF0aD48L3N2Zz4K" height="20">](https://docs.rs/cxx)
7[<img alt="build status" src="https://img.shields.io/github/workflow/status/dtolnay/cxx/CI/master?style=for-the-badge" height="20">](https://github.com/dtolnay/cxx/actions?query=branch%3Amaster)
David Tolnay7db73692019-10-20 14:51:12 -04008
9This library provides a **safe** mechanism for calling C++ code from Rust and
10Rust code from C++, not subject to the many ways that things can go wrong when
11using bindgen or cbindgen to generate unsafe C-style bindings.
12
David Tolnayccd39752020-01-08 09:33:51 -080013This doesn't change the fact that 100% of C++ code is unsafe. When auditing a
14project, you would be on the hook for auditing all the unsafe Rust code and
15*all* the C++ code. The core safety claim under this new model is that auditing
16just the C++ side would be sufficient to catch all problems, i.e. the Rust side
17can be 100% safe.
18
David Tolnay7db73692019-10-20 14:51:12 -040019```toml
20[dependencies]
David Tolnay5f3fb892020-09-01 23:02:57 -070021cxx = "0.4"
David Tolnay7db73692019-10-20 14:51:12 -040022```
23
David Tolnaycf223852020-05-11 20:50:59 -070024*Compiler support: requires rustc 1.42+ and c++11 or newer*<br>
David Tolnay5d08baa2020-04-27 18:12:08 -070025*[Release notes](https://github.com/dtolnay/cxx/releases)*
David Tolnay7db73692019-10-20 14:51:12 -040026
27<br>
28
29## Overview
30
31The idea is that we define the signatures of both sides of our FFI boundary
32embedded together in one Rust module (the next section shows an example). From
33this, CXX receives a complete picture of the boundary to perform static analyses
34against the types and function signatures to uphold both Rust's and C++'s
35invariants and requirements.
36
37If everything checks out statically, then CXX uses a pair of code generators to
38emit the relevant `extern "C"` signatures on both sides together with any
39necessary static assertions for later in the build process to verify
40correctness. On the Rust side this code generator is simply an attribute
41procedural macro. On the C++ side it can be a small Cargo build script if your
42build is managed by Cargo, or for other build systems like Bazel or Buck we
43provide a command line tool which generates the header and source file and
44should be easy to integrate.
45
46The resulting FFI bridge operates at zero or negligible overhead, i.e. no
47copying, no serialization, no memory allocation, no runtime checks needed.
48
49The FFI signatures are able to use native types from whichever side they please,
50such as Rust's `String` or C++'s `std::string`, Rust's `Box` or C++'s
51`std::unique_ptr`, Rust's `Vec` or C++'s `std::vector`, etc in any combination.
52CXX guarantees an ABI-compatible signature that both sides understand, based on
53builtin bindings for key standard library types to expose an idiomatic API on
54those types to the other language. For example when manipulating a C++ string
55from Rust, its `len()` method becomes a call of the `size()` member function
Christopher Durhamb8d211d2020-05-24 11:56:32 -040056defined by C++; when manipulating a Rust string from C++, its `size()` member
David Tolnay7db73692019-10-20 14:51:12 -040057function calls Rust's `len()`.
58
59<br>
60
61## Example
62
David Tolnay278f6fc2020-09-01 16:16:57 -070063A runnable version of this example is provided under the *demo* directory of
64this repo. To try it out, run `cargo run` from that directory.
David Tolnay7db73692019-10-20 14:51:12 -040065
66```rust
67#[cxx::bridge]
68mod ffi {
69 // Any shared structs, whose fields will be visible to both languages.
70 struct SharedThing {
71 z: i32,
72 y: Box<ThingR>,
73 x: UniquePtr<ThingC>,
74 }
75
76 extern "C" {
77 // One or more headers with the matching C++ declarations. Our code
78 // generators don't read it but it gets #include'd and used in static
79 // assertions to ensure our picture of the FFI boundary is accurate.
David Tolnay278f6fc2020-09-01 16:16:57 -070080 include!("demo/include/demo.h");
David Tolnay7db73692019-10-20 14:51:12 -040081
82 // Zero or more opaque types which both languages can pass around but
83 // only C++ can see the fields.
84 type ThingC;
85
86 // Functions implemented in C++.
87 fn make_demo(appname: &str) -> UniquePtr<ThingC>;
David Tolnayb6a5f672020-04-17 15:04:56 -070088 fn get_name(thing: &ThingC) -> &CxxString;
David Tolnay7db73692019-10-20 14:51:12 -040089 fn do_thing(state: SharedThing);
90 }
91
92 extern "Rust" {
93 // Zero or more opaque types which both languages can pass around but
94 // only Rust can see the fields.
95 type ThingR;
96
97 // Functions implemented in Rust.
98 fn print_r(r: &ThingR);
99 }
100}
101```
102
103Now we simply provide C++ definitions of all the things in the `extern "C"`
104block and Rust definitions of all the things in the `extern "Rust"` block, and
105get to call back and forth safely.
106
107Here are links to the complete set of source files involved in the demo:
108
David Tolnay278f6fc2020-09-01 16:16:57 -0700109- [demo/src/main.rs](demo/src/main.rs)
110- [demo/build.rs](demo/build.rs)
111- [demo/include/demo.h](demo/include/demo.h)
112- [demo/src/demo.cc](demo/src/demo.cc)
David Tolnay7db73692019-10-20 14:51:12 -0400113
114To look at the code generated in both languages for the example by the CXX code
115generators:
116
117```console
118 # run Rust code generator and print to stdout
119 # (requires https://github.com/dtolnay/cargo-expand)
David Tolnay278f6fc2020-09-01 16:16:57 -0700120$ cargo expand --manifest-path demo/Cargo.toml
David Tolnay7db73692019-10-20 14:51:12 -0400121
122 # run C++ code generator and print to stdout
David Tolnay278f6fc2020-09-01 16:16:57 -0700123$ cargo run --manifest-path gen/cmd/Cargo.toml -- demo/src/main.rs
David Tolnay7db73692019-10-20 14:51:12 -0400124```
125
126<br>
127
128## Details
129
130As seen in the example, the language of the FFI boundary involves 3 kinds of
131items:
132
133- **Shared structs** &mdash; their fields are made visible to both languages.
134 The definition written within cxx::bridge is the single source of truth.
135
136- **Opaque types** &mdash; their fields are secret from the other language.
137 These cannot be passed across the FFI by value but only behind an indirection,
138 such as a reference `&`, a Rust `Box`, or a `UniquePtr`. Can be a type alias
139 for an arbitrarily complicated generic language-specific type depending on
140 your use case.
141
142- **Functions** &mdash; implemented in either language, callable from the other
143 language.
144
145Within the `extern "C"` part of the CXX bridge we list the types and functions
146for which C++ is the source of truth, as well as the header(s) that declare
147those APIs. In the future it's possible that this section could be generated
148bindgen-style from the headers but for now we need the signatures written out;
149static assertions will verify that they are accurate.
150
151Within the `extern "Rust"` part, we list types and functions for which Rust is
152the source of truth. These all implicitly refer to the `super` module, the
153parent module of the CXX bridge. You can think of the two items listed in the
154example above as being like `use super::ThingR` and `use super::print_r` except
155re-exported to C++. The parent module will either contain the definitions
156directly for simple things, or contain the relevant `use` statements to bring
157them into scope from elsewhere.
158
159Your function implementations themselves, whether in C++ or Rust, *do not* need
160to be defined as `extern "C"` ABI or no\_mangle. CXX will put in the right shims
161where necessary to make it all work.
162
163<br>
164
165## Comparison vs bindgen and cbindgen
166
167Notice that with CXX there is repetition of all the function signatures: they
168are typed out once where the implementation is defined (in C++ or Rust) and
169again inside the cxx::bridge module, though compile-time assertions guarantee
170these are kept in sync. This is different from [bindgen] and [cbindgen] where
171function signatures are typed by a human once and the tool consumes them in one
172language and emits them in the other language.
173
174[bindgen]: https://github.com/rust-lang/rust-bindgen
175[cbindgen]: https://github.com/eqrion/cbindgen/
176
177This is because CXX fills a somewhat different role. It is a lower level tool
178than bindgen or cbindgen in a sense; you can think of it as being a replacement
179for the concept of `extern "C"` signatures as we know them, rather than a
180replacement for a bindgen. It would be reasonable to build a higher level
181bindgen-like tool on top of CXX which consumes a C++ header and/or Rust module
182(and/or IDL like Thrift) as source of truth and generates the cxx::bridge,
183eliminating the repetition while leveraging the static analysis safety
184guarantees of CXX.
185
186But note in other ways CXX is higher level than the bindgens, with rich support
187for common standard library types. Frequently with bindgen when we are dealing
188with an idiomatic C++ API we would end up manually wrapping that API in C-style
189raw pointer functions, applying bindgen to get unsafe raw pointer Rust
190functions, and replicating the API again to expose those idiomatically in Rust.
191That's a much worse form of repetition because it is unsafe all the way through.
192
193By using a CXX bridge as the shared understanding between the languages, rather
194than `extern "C"` C-style signatures as the shared understanding, common FFI use
195cases become expressible using 100% safe code.
196
197It would also be reasonable to mix and match, using CXX bridge for the 95% of
198your FFI that is straightforward and doing the remaining few oddball signatures
199the old fashioned way with bindgen and cbindgen, if for some reason CXX's static
200restrictions get in the way. Please file an issue if you end up taking this
201approach so that we know what ways it would be worthwhile to make the tool more
202expressive.
203
204<br>
205
206## Cargo-based setup
207
208For builds that are orchestrated by Cargo, you will use a build script that runs
209CXX's C++ code generator and compiles the resulting C++ code along with any
210other C++ code for your crate.
211
212The canonical build script is as follows. The indicated line returns a
213[`cc::Build`] instance (from the usual widely used `cc` crate) on which you can
214set up any additional source files and compiler flags as normal.
215
216[`cc::Build`]: https://docs.rs/cc/1.0/cc/struct.Build.html
217
David Tolnaycc9ece52020-04-29 18:57:05 -0700218```toml
219# Cargo.toml
220
221[build-dependencies]
David Tolnay5f3fb892020-09-01 23:02:57 -0700222cxx-build = "0.4"
David Tolnaycc9ece52020-04-29 18:57:05 -0700223```
224
David Tolnay7db73692019-10-20 14:51:12 -0400225```rust
226// build.rs
227
228fn main() {
David Tolnayf8ed0732020-04-29 12:34:47 -0700229 cxx_build::bridge("src/main.rs") // returns a cc::Build
David Tolnay278f6fc2020-09-01 16:16:57 -0700230 .file("src/demo.cc")
Philip Craig7e14e2e2020-05-09 10:42:30 +0100231 .flag_if_supported("-std=c++11")
David Tolnay7db73692019-10-20 14:51:12 -0400232 .compile("cxxbridge-demo");
233
234 println!("cargo:rerun-if-changed=src/main.rs");
David Tolnay278f6fc2020-09-01 16:16:57 -0700235 println!("cargo:rerun-if-changed=src/demo.cc");
236 println!("cargo:rerun-if-changed=include/demo.h");
David Tolnay7db73692019-10-20 14:51:12 -0400237}
238```
239
240<br>
241
242## Non-Cargo setup
243
244For use in non-Cargo builds like Bazel or Buck, CXX provides an alternate way of
245invoking the C++ code generator as a standalone command line tool. The tool is
246packaged as the `cxxbridge-cmd` crate on crates.io or can be built from the
247*cmd* directory of this repo.
248
249```bash
250$ cargo install cxxbridge-cmd
251
252$ cxxbridge src/main.rs --header > path/to/mybridge.h
253$ cxxbridge src/main.rs > path/to/mybridge.cc
254```
255
256<br>
257
258## Safety
259
260Be aware that the design of this library is intentionally restrictive and
261opinionated! It isn't a goal to be powerful enough to handle arbitrary
262signatures in either language. Instead this project is about carving out a
263reasonably expressive set of functionality about which we can make useful safety
264guarantees today and maybe extend over time. You may find that it takes some
265practice to use CXX bridge effectively as it won't work in all the ways that you
266are used to.
267
268Some of the considerations that go into ensuring safety are:
269
270- By design, our paired code generators work together to control both sides of
271 the FFI boundary. Ordinarily in Rust writing your own `extern "C"` blocks is
272 unsafe because the Rust compiler has no way to know whether the signatures
273 you've written actually match the signatures implemented in the other
274 language. With CXX we achieve that visibility and know what's on the other
275 side.
276
277- Our static analysis detects and prevents passing types by value that shouldn't
278 be passed by value from C++ to Rust, for example because they may contain
279 internal pointers that would be screwed up by Rust's move behavior.
280
281- To many people's surprise, it is possible to have a struct in Rust and a
282 struct in C++ with exactly the same layout / fields / alignment / everything,
283 and still not the same ABI when passed by value. This is a longstanding
284 bindgen bug that leads to segfaults in absolutely correct-looking code
285 ([rust-lang/rust-bindgen#778]). CXX knows about this and can insert the
286 necessary zero-cost workaround transparently where needed, so go ahead and
287 pass your structs by value without worries. This is made possible by owning
288 both sides of the boundary rather than just one.
289
290- Template instantiations: for example in order to expose a UniquePtr\<T\> type
291 in Rust backed by a real C++ unique\_ptr, we have a way of using a Rust trait
292 to connect the behavior back to the template instantiations performed by the
293 other language.
294
295[rust-lang/rust-bindgen#778]: https://github.com/rust-lang/rust-bindgen/issues/778
296
297<br>
298
299## Builtin types
300
David Tolnay559fbb32020-03-17 23:32:20 -0700301In addition to all the primitive types (i32 &lt;=&gt; int32_t), the following
David Tolnay06515f02020-03-17 23:28:02 -0700302common types may be used in the fields of shared structs and the arguments and
303returns of functions.
David Tolnay7db73692019-10-20 14:51:12 -0400304
305<table>
306<tr><th>name in Rust</th><th>name in C++</th><th>restrictions</th></tr>
David Tolnay750755e2020-03-01 13:04:08 -0800307<tr><td>String</td><td>rust::String</td><td></td></tr>
308<tr><td>&amp;str</td><td>rust::Str</td><td></td></tr>
David Tolnayefe81052020-04-14 16:28:24 -0700309<tr><td>&amp;[u8]</td><td>rust::Slice&lt;uint8_t&gt;</td><td><sup><i>arbitrary &amp;[T] not implemented yet</i></sup></td></tr>
David Tolnay5f3fb892020-09-01 23:02:57 -0700310<tr><td><a href="https://docs.rs/cxx/0.4/cxx/struct.CxxString.html">CxxString</a></td><td>std::string</td><td><sup><i>cannot be passed by value</i></sup></td></tr>
David Tolnay750755e2020-03-01 13:04:08 -0800311<tr><td>Box&lt;T&gt;</td><td>rust::Box&lt;T&gt;</td><td><sup><i>cannot hold opaque C++ type</i></sup></td></tr>
David Tolnay5f3fb892020-09-01 23:02:57 -0700312<tr><td><a href="https://docs.rs/cxx/0.4/cxx/struct.UniquePtr.html">UniquePtr&lt;T&gt;</a></td><td>std::unique_ptr&lt;T&gt;</td><td><sup><i>cannot hold opaque Rust type</i></sup></td></tr>
David Tolnay347c3d02020-04-24 16:14:07 -0700313<tr><td>Vec&lt;T&gt;</td><td>rust::Vec&lt;T&gt;</td><td><sup><i>cannot hold opaque C++ type</i></sup></td></tr>
David Tolnay5f3fb892020-09-01 23:02:57 -0700314<tr><td><a href="https://docs.rs/cxx/0.4/cxx/struct.CxxVector.html">CxxVector&lt;T&gt;</a></td><td>std::vector&lt;T&gt;</td><td><sup><i>cannot be passed by value, cannot hold opaque Rust type</i></sup></td></tr>
David Tolnayaddc7482020-03-29 22:19:44 -0700315<tr><td>fn(T, U) -&gt; V</td><td>rust::Fn&lt;V(T, U)&gt;</td><td><sup><i>only passing from Rust to C++ is implemented so far</i></sup></td></tr>
David Tolnay31b5aad2020-04-10 19:35:47 -0700316<tr><td>Result&lt;T&gt;</td><td>throw/catch</td><td><sup><i>allowed as return type only</i></sup></td></tr>
David Tolnay7db73692019-10-20 14:51:12 -0400317</table>
318
David Tolnay736cbca2020-03-11 16:49:18 -0700319The C++ API of the `rust` namespace is defined by the *include/cxx.h* file in
320this repo. You will need to include this header in your C++ code when working
321with those types.
David Tolnay7db73692019-10-20 14:51:12 -0400322
323The following types are intended to be supported "soon" but are just not
324implemented yet. I don't expect any of these to be hard to make work but it's a
325matter of designing a nice API for each in its non-native language.
326
327<table>
328<tr><th>name in Rust</th><th>name in C++</th></tr>
David Tolnay84f232e2020-01-08 12:22:56 -0800329<tr><td>BTreeMap&lt;K, V&gt;</td><td><sup><i>tbd</i></sup></td></tr>
330<tr><td>HashMap&lt;K, V&gt;</td><td><sup><i>tbd</i></sup></td></tr>
David Tolnay239d05f2020-03-13 01:36:50 -0700331<tr><td>Arc&lt;T&gt;</td><td><sup><i>tbd</i></sup></td></tr>
David Tolnay85487b02020-08-22 06:13:27 -0700332<tr><td>Option&lt;T&gt;</td><td><sup><i>tbd</i></sup></td></tr>
David Tolnay84f232e2020-01-08 12:22:56 -0800333<tr><td><sup><i>tbd</i></sup></td><td>std::map&lt;K, V&gt;</td></tr>
334<tr><td><sup><i>tbd</i></sup></td><td>std::unordered_map&lt;K, V&gt;</td></tr>
David Tolnay239d05f2020-03-13 01:36:50 -0700335<tr><td><sup><i>tbd</i></sup></td><td>std::shared_ptr&lt;T&gt;</td></tr>
David Tolnay7db73692019-10-20 14:51:12 -0400336</table>
337
338<br>
339
340## Remaining work
341
342This is still early days for CXX; I am releasing it as a minimum viable product
David Tolnay3deb2f92020-04-22 19:16:38 -0700343to collect feedback on the direction and invite collaborators. Please check the
344open issues.
David Tolnay7db73692019-10-20 14:51:12 -0400345
346On the build side, I don't have much experience with the `cc` crate so I expect
347there may be someone who can suggest ways to make that aspect of this crate
348friendlier or more robust. Please report issues if you run into trouble building
349or linking any of this stuff.
350
351Finally, I know more about Rust library design than C++ library design so I
352would appreciate help making the C++ APIs in this project more idiomatic where
353anyone has suggestions.
354
355<br>
356
357#### License
358
359<sup>
360Licensed under either of <a href="LICENSE-APACHE">Apache License, Version
3612.0</a> or <a href="LICENSE-MIT">MIT license</a> at your option.
362</sup>
363
364<br>
365
366<sub>
367Unless you explicitly state otherwise, any contribution intentionally submitted
368for inclusion in this project by you, as defined in the Apache-2.0 license,
369shall be dual licensed as above, without any additional terms or conditions.
370</sub>