blob: 1f4f0b6e75b9e7b391c214f77c4ddd7398b794df [file] [log] [blame]
R David Murray6a143812013-12-20 14:37:39 -05001.. currentmodule:: asyncio
Victor Stinnerea3183f2013-12-03 01:08:00 +01002
Yury Selivanov7c7605f2018-09-11 09:54:40 -07003
4==========
5Event Loop
6==========
7
Miss Islington (bot)6bfeb812019-10-10 16:25:28 -07008**Source code:** :source:`Lib/asyncio/events.py`,
9:source:`Lib/asyncio/base_events.py`
10
11------------------------------------
Yury Selivanov7c7605f2018-09-11 09:54:40 -070012
13.. rubric:: Preface
14
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -040015The event loop is the core of every asyncio application.
Yury Selivanov7c7605f2018-09-11 09:54:40 -070016Event loops run asynchronous tasks and callbacks, perform network
Carol Willing5b7cbd62018-09-12 17:05:17 -070017IO operations, and run subprocesses.
Yury Selivanov7c7605f2018-09-11 09:54:40 -070018
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -040019Application developers should typically use the high-level asyncio functions,
20such as :func:`asyncio.run`, and should rarely need to reference the loop
21object or call its methods. This section is intended mostly for authors
22of lower-level code, libraries, and frameworks, who need finer control over
23the event loop behavior.
Yury Selivanov7c7605f2018-09-11 09:54:40 -070024
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -040025.. rubric:: Obtaining the Event Loop
Yury Selivanov7c7605f2018-09-11 09:54:40 -070026
27The following low-level functions can be used to get, set, or create
28an event loop:
29
30.. function:: get_running_loop()
31
32 Return the running event loop in the current OS thread.
33
34 If there is no running event loop a :exc:`RuntimeError` is raised.
35 This function can only be called from a coroutine or a callback.
36
37 .. versionadded:: 3.7
38
39.. function:: get_event_loop()
40
41 Get the current event loop. If there is no current event loop set
42 in the current OS thread and :func:`set_event_loop` has not yet
43 been called, asyncio will create a new event loop and set it as the
44 current one.
45
Carol Willing5b7cbd62018-09-12 17:05:17 -070046 Because this function has rather complex behavior (especially
47 when custom event loop policies are in use), using the
48 :func:`get_running_loop` function is preferred to :func:`get_event_loop`
49 in coroutines and callbacks.
Yury Selivanov7c7605f2018-09-11 09:54:40 -070050
Carol Willing5b7cbd62018-09-12 17:05:17 -070051 Consider also using the :func:`asyncio.run` function instead of using
52 lower level functions to manually create and close an event loop.
Yury Selivanov7c7605f2018-09-11 09:54:40 -070053
54.. function:: set_event_loop(loop)
55
56 Set *loop* as a current event loop for the current OS thread.
57
58.. function:: new_event_loop()
59
60 Create a new event loop object.
61
62Note that the behaviour of :func:`get_event_loop`, :func:`set_event_loop`,
63and :func:`new_event_loop` functions can be altered by
64:ref:`setting a custom event loop policy <asyncio-policies>`.
65
66
67.. rubric:: Contents
68
69This documentation page contains the following sections:
70
Carol Willing5b7cbd62018-09-12 17:05:17 -070071* The `Event Loop Methods`_ section is the reference documentation of
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -040072 the event loop APIs;
Yury Selivanov7c7605f2018-09-11 09:54:40 -070073
74* The `Callback Handles`_ section documents the :class:`Handle` and
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -040075 :class:`TimerHandle` instances which are returned from scheduling
76 methods such as :meth:`loop.call_soon` and :meth:`loop.call_later`;
Yury Selivanov7c7605f2018-09-11 09:54:40 -070077
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -040078* The `Server Objects`_ section documents types returned from
Yury Selivanov7c7605f2018-09-11 09:54:40 -070079 event loop methods like :meth:`loop.create_server`;
80
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -040081* The `Event Loop Implementations`_ section documents the
Yury Selivanov7c7605f2018-09-11 09:54:40 -070082 :class:`SelectorEventLoop` and :class:`ProactorEventLoop` classes;
83
84* The `Examples`_ section showcases how to work with some event
85 loop APIs.
86
87
Victor Stinner9592edb2014-02-02 15:03:02 +010088.. _asyncio-event-loop:
Victor Stinnerea3183f2013-12-03 01:08:00 +010089
Yury Selivanov7c7605f2018-09-11 09:54:40 -070090Event Loop Methods
91==================
Victor Stinnerea3183f2013-12-03 01:08:00 +010092
Carol Willing5b7cbd62018-09-12 17:05:17 -070093Event loops have **low-level** APIs for the following:
lf627d2c82017-07-25 17:03:51 -060094
Yury Selivanov7c7605f2018-09-11 09:54:40 -070095.. contents::
96 :depth: 1
97 :local:
Victor Stinnerea3183f2013-12-03 01:08:00 +010098
Victor Stinnerea3183f2013-12-03 01:08:00 +010099
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700100Running and stopping the loop
101^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinnerea3183f2013-12-03 01:08:00 +0100102
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700103.. method:: loop.run_until_complete(future)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100104
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400105 Run until the *future* (an instance of :class:`Future`) has
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700106 completed.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100107
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700108 If the argument is a :ref:`coroutine object <coroutine>` it
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400109 is implicitly scheduled to run as a :class:`asyncio.Task`.
Eli Bendersky136fea22014-02-09 06:55:58 -0800110
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700111 Return the Future's result or raise its exception.
Guido van Rossumf68afd82016-08-08 09:41:21 -0700112
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700113.. method:: loop.run_forever()
Guido van Rossumf68afd82016-08-08 09:41:21 -0700114
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700115 Run the event loop until :meth:`stop` is called.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100116
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700117 If :meth:`stop` is called before :meth:`run_forever()` is called,
118 the loop will poll the I/O selector once with a timeout of zero,
119 run all callbacks scheduled in response to I/O events (and
120 those that were already scheduled), and then exit.
Victor Stinner83704962015-02-25 14:24:15 +0100121
Guido van Rossum41f69f42015-11-19 13:28:47 -0800122 If :meth:`stop` is called while :meth:`run_forever` is running,
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700123 the loop will run the current batch of callbacks and then exit.
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400124 Note that new callbacks scheduled by callbacks will not run in this
Carol Willing5b7cbd62018-09-12 17:05:17 -0700125 case; instead, they will run the next time :meth:`run_forever` or
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700126 :meth:`run_until_complete` is called.
Guido van Rossum41f69f42015-11-19 13:28:47 -0800127
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700128.. method:: loop.stop()
Victor Stinnerea3183f2013-12-03 01:08:00 +0100129
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700130 Stop the event loop.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100131
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700132.. method:: loop.is_running()
Victor Stinnerea3183f2013-12-03 01:08:00 +0100133
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700134 Return ``True`` if the event loop is currently running.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100135
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700136.. method:: loop.is_closed()
Victor Stinnerea3183f2013-12-03 01:08:00 +0100137
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700138 Return ``True`` if the event loop was closed.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100139
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700140.. method:: loop.close()
Victor Stinnerea3183f2013-12-03 01:08:00 +0100141
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700142 Close the event loop.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100143
Andriy Maletskyb83d9172018-10-29 23:39:21 +0200144 The loop must not be running when this function is called.
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700145 Any pending callbacks will be discarded.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100146
Łukasz Langa7f9a2ae2019-06-04 13:03:20 +0200147 This method clears all queues and shuts down the executor, but does
148 not wait for the executor to finish.
Guido van Rossum41f69f42015-11-19 13:28:47 -0800149
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700150 This method is idempotent and irreversible. No other methods
151 should be called after the event loop is closed.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100152
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700153.. coroutinemethod:: loop.shutdown_asyncgens()
Yury Selivanov03660042016-12-15 17:36:05 -0500154
155 Schedule all currently open :term:`asynchronous generator` objects to
156 close with an :meth:`~agen.aclose()` call. After calling this method,
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700157 the event loop will issue a warning if a new asynchronous generator
Carol Willing5b7cbd62018-09-12 17:05:17 -0700158 is iterated. This should be used to reliably finalize all scheduled
Yury Selivanovac94e382018-09-17 23:58:00 -0400159 asynchronous generators.
Carol Willing5b7cbd62018-09-12 17:05:17 -0700160
Yury Selivanovac94e382018-09-17 23:58:00 -0400161 Note that there is no need to call this function when
162 :func:`asyncio.run` is used.
163
164 Example::
Yury Selivanov03660042016-12-15 17:36:05 -0500165
166 try:
167 loop.run_forever()
168 finally:
169 loop.run_until_complete(loop.shutdown_asyncgens())
170 loop.close()
171
172 .. versionadded:: 3.6
173
174
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700175Scheduling callbacks
176^^^^^^^^^^^^^^^^^^^^
Victor Stinnerea3183f2013-12-03 01:08:00 +0100177
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700178.. method:: loop.call_soon(callback, *args, context=None)
Victor Stinner8464c242014-11-28 13:15:41 +0100179
Carol Willing5b7cbd62018-09-12 17:05:17 -0700180 Schedule a *callback* to be called with *args* arguments at
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700181 the next iteration of the event loop.
Victor Stinner8464c242014-11-28 13:15:41 +0100182
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700183 Callbacks are called in the order in which they are registered.
184 Each callback will be called exactly once.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100185
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700186 An optional keyword-only *context* argument allows specifying a
187 custom :class:`contextvars.Context` for the *callback* to run in.
188 The current context is used when no *context* is provided.
Yury Selivanov28b91782018-05-23 13:35:04 -0400189
Yury Selivanov1096f762015-06-25 13:49:52 -0400190 An instance of :class:`asyncio.Handle` is returned, which can be
Carol Willing5b7cbd62018-09-12 17:05:17 -0700191 used later to cancel the callback.
192
193 This method is not thread-safe.
Yury Selivanov43ee1c12014-02-19 20:58:44 -0500194
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700195.. method:: loop.call_soon_threadsafe(callback, *args, context=None)
Victor Stinner8464c242014-11-28 13:15:41 +0100196
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700197 A thread-safe variant of :meth:`call_soon`. Must be used to
198 schedule callbacks *from another thread*.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100199
Victor Stinner83704962015-02-25 14:24:15 +0100200 See the :ref:`concurrency and multithreading <asyncio-multithreading>`
201 section of the documentation.
202
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700203.. versionchanged:: 3.7
204 The *context* keyword-only parameter was added. See :pep:`567`
205 for more details.
206
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400207.. _asyncio-pass-keywords:
208
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700209.. note::
210
Carol Willing5b7cbd62018-09-12 17:05:17 -0700211 Most :mod:`asyncio` scheduling functions don't allow passing
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400212 keyword arguments. To do that, use :func:`functools.partial`::
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700213
Carol Willing5b7cbd62018-09-12 17:05:17 -0700214 # will schedule "print("Hello", flush=True)"
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700215 loop.call_soon(
216 functools.partial(print, "Hello", flush=True))
217
218 Using partial objects is usually more convenient than using lambdas,
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400219 as asyncio can render partial objects better in debug and error
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700220 messages.
Yury Selivanov28b91782018-05-23 13:35:04 -0400221
Victor Stinnerea3183f2013-12-03 01:08:00 +0100222
Victor Stinner45b27ed2014-02-01 02:36:43 +0100223.. _asyncio-delayed-calls:
224
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700225Scheduling delayed callbacks
226^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinnerea3183f2013-12-03 01:08:00 +0100227
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700228Event loop provides mechanisms to schedule callback functions
229to be called at some point in the future. Event loop uses monotonic
230clocks to track time.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100231
Victor Stinner45b27ed2014-02-01 02:36:43 +0100232
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700233.. method:: loop.call_later(delay, callback, *args, context=None)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100234
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700235 Schedule *callback* to be called after the given *delay*
236 number of seconds (can be either an int or a float).
Victor Stinnerea3183f2013-12-03 01:08:00 +0100237
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700238 An instance of :class:`asyncio.TimerHandle` is returned which can
239 be used to cancel the callback.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100240
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700241 *callback* will be called exactly once. If two callbacks are
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400242 scheduled for exactly the same time, the order in which they
243 are called is undefined.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100244
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700245 The optional positional *args* will be passed to the callback when
246 it is called. If you want the callback to be called with keyword
247 arguments use :func:`functools.partial`.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100248
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700249 An optional keyword-only *context* argument allows specifying a
250 custom :class:`contextvars.Context` for the *callback* to run in.
251 The current context is used when no *context* is provided.
Victor Stinner8464c242014-11-28 13:15:41 +0100252
Yury Selivanov28b91782018-05-23 13:35:04 -0400253 .. versionchanged:: 3.7
254 The *context* keyword-only parameter was added. See :pep:`567`
255 for more details.
256
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400257 .. versionchanged:: 3.8
258 In Python 3.7 and earlier with the default event loop implementation,
259 the *delay* could not exceed one day.
260 This has been fixed in Python 3.8.
261
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700262.. method:: loop.call_at(when, callback, *args, context=None)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100263
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700264 Schedule *callback* to be called at the given absolute timestamp
265 *when* (an int or a float), using the same time reference as
266 :meth:`loop.time`.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100267
268 This method's behavior is the same as :meth:`call_later`.
269
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700270 An instance of :class:`asyncio.TimerHandle` is returned which can
271 be used to cancel the callback.
Victor Stinner8464c242014-11-28 13:15:41 +0100272
Yury Selivanov28b91782018-05-23 13:35:04 -0400273 .. versionchanged:: 3.7
274 The *context* keyword-only parameter was added. See :pep:`567`
275 for more details.
276
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400277 .. versionchanged:: 3.8
278 In Python 3.7 and earlier with the default event loop implementation,
279 the difference between *when* and the current time could not exceed
280 one day. This has been fixed in Python 3.8.
281
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700282.. method:: loop.time()
Victor Stinnerea3183f2013-12-03 01:08:00 +0100283
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700284 Return the current time, as a :class:`float` value, according to
285 the event loop's internal monotonic clock.
286
287.. note::
Enrico Alarico Carbognani7e954e72019-04-18 14:43:14 +0200288 .. versionchanged:: 3.8
289 In Python 3.7 and earlier timeouts (relative *delay* or absolute *when*)
290 should not exceed one day. This has been fixed in Python 3.8.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100291
Victor Stinner3e09e322013-12-03 01:22:06 +0100292.. seealso::
293
294 The :func:`asyncio.sleep` function.
295
Victor Stinnerea3183f2013-12-03 01:08:00 +0100296
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700297Creating Futures and Tasks
298^^^^^^^^^^^^^^^^^^^^^^^^^^
Yury Selivanov950204d2016-05-16 16:23:00 -0400299
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700300.. method:: loop.create_future()
Yury Selivanov950204d2016-05-16 16:23:00 -0400301
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700302 Create an :class:`asyncio.Future` object attached to the event loop.
Yury Selivanov950204d2016-05-16 16:23:00 -0400303
Carol Willing5b7cbd62018-09-12 17:05:17 -0700304 This is the preferred way to create Futures in asyncio. This lets
305 third-party event loops provide alternative implementations of
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700306 the Future object (with better performance or instrumentation).
Yury Selivanov950204d2016-05-16 16:23:00 -0400307
308 .. versionadded:: 3.5.2
309
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700310.. method:: loop.create_task(coro, \*, name=None)
Yury Selivanov950204d2016-05-16 16:23:00 -0400311
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700312 Schedule the execution of a :ref:`coroutine`.
313 Return a :class:`Task` object.
Victor Stinner530ef2f2014-07-08 12:39:10 +0200314
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700315 Third-party event loops can use their own subclass of :class:`Task`
316 for interoperability. In this case, the result type is a subclass
317 of :class:`Task`.
Victor Stinner530ef2f2014-07-08 12:39:10 +0200318
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700319 If the *name* argument is provided and not ``None``, it is set as
320 the name of the task using :meth:`Task.set_name`.
Victor Stinner530ef2f2014-07-08 12:39:10 +0200321
Alex Grönholmcca4eec2018-08-09 00:06:47 +0300322 .. versionchanged:: 3.8
323 Added the ``name`` parameter.
324
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700325.. method:: loop.set_task_factory(factory)
Yury Selivanov71854612015-05-11 16:28:27 -0400326
327 Set a task factory that will be used by
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700328 :meth:`loop.create_task`.
Yury Selivanov71854612015-05-11 16:28:27 -0400329
330 If *factory* is ``None`` the default task factory will be set.
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400331 Otherwise, *factory* must be a *callable* with the signature matching
332 ``(loop, coro)``, where *loop* is a reference to the active
333 event loop, and *coro* is a coroutine object. The callable
334 must return a :class:`asyncio.Future`-compatible object.
Yury Selivanov71854612015-05-11 16:28:27 -0400335
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700336.. method:: loop.get_task_factory()
Yury Selivanov71854612015-05-11 16:28:27 -0400337
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700338 Return a task factory or ``None`` if the default one is in use.
Yury Selivanov71854612015-05-11 16:28:27 -0400339
Victor Stinner530ef2f2014-07-08 12:39:10 +0200340
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700341Opening network connections
342^^^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinnerea3183f2013-12-03 01:08:00 +0100343
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700344.. coroutinemethod:: loop.create_connection(protocol_factory, \
345 host=None, port=None, \*, ssl=None, \
346 family=0, proto=0, flags=0, sock=None, \
347 local_addr=None, server_hostname=None, \
348 ssl_handshake_timeout=None)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100349
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700350 Open a streaming transport connection to a given
351 address specified by *host* and *port*.
352
353 The socket family can be either :py:data:`~socket.AF_INET` or
354 :py:data:`~socket.AF_INET6` depending on *host* (or the *family*
355 argument, if provided).
356
357 The socket type will be :py:data:`~socket.SOCK_STREAM`.
358
359 *protocol_factory* must be a callable returning an
360 :ref:`asyncio protocol <asyncio-protocol>` implementation.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100361
Yury Selivanov19a44f62017-12-14 20:53:26 -0500362 This method will try to establish the connection in the background.
363 When successful, it returns a ``(transport, protocol)`` pair.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100364
365 The chronological synopsis of the underlying operation is as follows:
366
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700367 #. The connection is established and a :ref:`transport <asyncio-transport>`
368 is created for it.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100369
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700370 #. *protocol_factory* is called without arguments and is expected to
371 return a :ref:`protocol <asyncio-protocol>` instance.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100372
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700373 #. The protocol instance is coupled with the transport by calling its
374 :meth:`~BaseProtocol.connection_made` method.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100375
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700376 #. A ``(transport, protocol)`` tuple is returned on success.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100377
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700378 The created transport is an implementation-dependent bidirectional
379 stream.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100380
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700381 Other arguments:
Victor Stinnerea3183f2013-12-03 01:08:00 +0100382
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400383 * *ssl*: if given and not false, a SSL/TLS transport is created
Victor Stinnerea3183f2013-12-03 01:08:00 +0100384 (by default a plain TCP transport is created). If *ssl* is
385 a :class:`ssl.SSLContext` object, this context is used to create
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400386 the transport; if *ssl* is :const:`True`, a default context returned
387 from :func:`ssl.create_default_context` is used.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100388
Berker Peksag9c1dba22014-09-28 00:00:58 +0300389 .. seealso:: :ref:`SSL/TLS security considerations <ssl-security>`
Antoine Pitrouc5e075f2014-03-22 18:19:11 +0100390
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400391 * *server_hostname* sets or overrides the hostname that the target
392 server's certificate will be matched against. Should only be passed
393 if *ssl* is not ``None``. By default the value of the *host* argument
Victor Stinnerea3183f2013-12-03 01:08:00 +0100394 is used. If *host* is empty, there is no default and you must pass a
395 value for *server_hostname*. If *server_hostname* is an empty
396 string, hostname matching is disabled (which is a serious security
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400397 risk, allowing for potential man-in-the-middle attacks).
Victor Stinnerea3183f2013-12-03 01:08:00 +0100398
399 * *family*, *proto*, *flags* are the optional address family, protocol
400 and flags to be passed through to getaddrinfo() for *host* resolution.
401 If given, these should all be integers from the corresponding
402 :mod:`socket` module constants.
403
twisteroid ambassador88f07a82019-05-05 19:14:35 +0800404 * *happy_eyeballs_delay*, if given, enables Happy Eyeballs for this
405 connection. It should
406 be a floating-point number representing the amount of time in seconds
407 to wait for a connection attempt to complete, before starting the next
408 attempt in parallel. This is the "Connection Attempt Delay" as defined
409 in :rfc:`8305`. A sensible default value recommended by the RFC is ``0.25``
410 (250 milliseconds).
411
412 * *interleave* controls address reordering when a host name resolves to
413 multiple IP addresses.
414 If ``0`` or unspecified, no reordering is done, and addresses are
415 tried in the order returned by :meth:`getaddrinfo`. If a positive integer
416 is specified, the addresses are interleaved by address family, and the
417 given integer is interpreted as "First Address Family Count" as defined
418 in :rfc:`8305`. The default is ``0`` if *happy_eyeballs_delay* is not
419 specified, and ``1`` if it is.
420
Victor Stinnerea3183f2013-12-03 01:08:00 +0100421 * *sock*, if given, should be an existing, already connected
422 :class:`socket.socket` object to be used by the transport.
twisteroid ambassador88f07a82019-05-05 19:14:35 +0800423 If *sock* is given, none of *host*, *port*, *family*, *proto*, *flags*,
424 *happy_eyeballs_delay*, *interleave*
Victor Stinnerea3183f2013-12-03 01:08:00 +0100425 and *local_addr* should be specified.
426
427 * *local_addr*, if given, is a ``(local_host, local_port)`` tuple used
428 to bind the socket to locally. The *local_host* and *local_port*
Carol Willing5b7cbd62018-09-12 17:05:17 -0700429 are looked up using ``getaddrinfo()``, similarly to *host* and *port*.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100430
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400431 * *ssl_handshake_timeout* is (for a TLS connection) the time in seconds
432 to wait for the TLS handshake to complete before aborting the connection.
Yury Selivanov96026432018-06-04 11:32:35 -0400433 ``60.0`` seconds if ``None`` (default).
Neil Aspinallf7686c12017-12-19 19:45:42 +0000434
twisteroid ambassador88f07a82019-05-05 19:14:35 +0800435 .. versionadded:: 3.8
436
437 The *happy_eyeballs_delay* and *interleave* parameters.
438
Neil Aspinallf7686c12017-12-19 19:45:42 +0000439 .. versionadded:: 3.7
440
441 The *ssl_handshake_timeout* parameter.
442
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700443 .. versionchanged:: 3.6
444
445 The socket option :py:data:`~socket.TCP_NODELAY` is set by default
446 for all TCP connections.
447
Victor Stinner60208a12015-09-15 22:41:52 +0200448 .. versionchanged:: 3.5
449
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400450 Added support for SSL/TLS in :class:`ProactorEventLoop`.
Victor Stinner41f3c3f2014-08-31 14:47:37 +0200451
Victor Stinnerc8ea8132014-01-23 11:02:09 +0100452 .. seealso::
453
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700454 The :func:`open_connection` function is a high-level alternative
455 API. It returns a pair of (:class:`StreamReader`, :class:`StreamWriter`)
456 that can be used directly in async/await code.
Victor Stinnerc8ea8132014-01-23 11:02:09 +0100457
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700458.. coroutinemethod:: loop.create_datagram_endpoint(protocol_factory, \
459 local_addr=None, remote_addr=None, \*, \
460 family=0, proto=0, flags=0, \
461 reuse_address=None, reuse_port=None, \
462 allow_broadcast=None, sock=None)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100463
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700464 Create a datagram connection.
Victor Stinnera6919aa2014-02-19 13:32:34 +0100465
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700466 The socket family can be either :py:data:`~socket.AF_INET`,
467 :py:data:`~socket.AF_INET6`, or :py:data:`~socket.AF_UNIX`,
468 depending on *host* (or the *family* argument, if provided).
Victor Stinnera6919aa2014-02-19 13:32:34 +0100469
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700470 The socket type will be :py:data:`~socket.SOCK_DGRAM`.
Victor Stinnera6919aa2014-02-19 13:32:34 +0100471
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700472 *protocol_factory* must be a callable returning a
473 :ref:`protocol <asyncio-protocol>` implementation.
474
475 A tuple of ``(transport, protocol)`` is returned on success.
476
477 Other arguments:
Guido van Rossumb9bf9132015-10-05 09:15:28 -0700478
479 * *local_addr*, if given, is a ``(local_host, local_port)`` tuple used
480 to bind the socket to locally. The *local_host* and *local_port*
481 are looked up using :meth:`getaddrinfo`.
482
483 * *remote_addr*, if given, is a ``(remote_host, remote_port)`` tuple used
484 to connect the socket to a remote address. The *remote_host* and
485 *remote_port* are looked up using :meth:`getaddrinfo`.
486
487 * *family*, *proto*, *flags* are the optional address family, protocol
488 and flags to be passed through to :meth:`getaddrinfo` for *host*
489 resolution. If given, these should all be integers from the
490 corresponding :mod:`socket` module constants.
491
492 * *reuse_address* tells the kernel to reuse a local socket in
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700493 ``TIME_WAIT`` state, without waiting for its natural timeout to
Serhiy Storchaka4adf01c2016-10-19 18:30:05 +0300494 expire. If not specified will automatically be set to ``True`` on
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400495 Unix.
Guido van Rossumb9bf9132015-10-05 09:15:28 -0700496
497 * *reuse_port* tells the kernel to allow this endpoint to be bound to the
498 same port as other existing endpoints are bound to, so long as they all
499 set this flag when being created. This option is not supported on Windows
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400500 and some Unixes. If the :py:data:`~socket.SO_REUSEPORT` constant is not
Guido van Rossumb9bf9132015-10-05 09:15:28 -0700501 defined then this capability is unsupported.
502
503 * *allow_broadcast* tells the kernel to allow this endpoint to send
504 messages to the broadcast address.
505
506 * *sock* can optionally be specified in order to use a preexisting,
507 already connected, :class:`socket.socket` object to be used by the
508 transport. If specified, *local_addr* and *remote_addr* should be omitted
509 (must be :const:`None`).
Victor Stinnera6919aa2014-02-19 13:32:34 +0100510
Victor Stinnerc7edffd2014-10-12 11:24:26 +0200511 See :ref:`UDP echo client protocol <asyncio-udp-echo-client-protocol>` and
512 :ref:`UDP echo server protocol <asyncio-udp-echo-server-protocol>` examples.
513
Romuald Brunet0ded5802018-05-14 18:22:00 +0200514 .. versionchanged:: 3.4.4
515 The *family*, *proto*, *flags*, *reuse_address*, *reuse_port,
516 *allow_broadcast*, and *sock* parameters were added.
Victor Stinnera6919aa2014-02-19 13:32:34 +0100517
Andrew Svetlovbafd4b52019-05-28 12:52:15 +0300518 .. versionchanged:: 3.8
519 Added support for Windows.
520
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700521.. coroutinemethod:: loop.create_unix_connection(protocol_factory, \
522 path=None, \*, ssl=None, sock=None, \
523 server_hostname=None, ssl_handshake_timeout=None)
Victor Stinnera6919aa2014-02-19 13:32:34 +0100524
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400525 Create a Unix connection.
Victor Stinnera6919aa2014-02-19 13:32:34 +0100526
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700527 The socket family will be :py:data:`~socket.AF_UNIX`; socket
528 type will be :py:data:`~socket.SOCK_STREAM`.
Victor Stinnera6919aa2014-02-19 13:32:34 +0100529
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700530 A tuple of ``(transport, protocol)`` is returned on success.
Guido van Rossum9e80eeb2016-11-03 14:17:25 -0700531
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400532 *path* is the name of a Unix domain socket and is required,
533 unless a *sock* parameter is specified. Abstract Unix sockets,
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700534 :class:`str`, :class:`bytes`, and :class:`~pathlib.Path` paths are
535 supported.
536
537 See the documentation of the :meth:`loop.create_connection` method
538 for information about arguments to this method.
Victor Stinnera6919aa2014-02-19 13:32:34 +0100539
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400540 .. availability:: Unix.
Victor Stinnera6919aa2014-02-19 13:32:34 +0100541
Neil Aspinallf7686c12017-12-19 19:45:42 +0000542 .. versionadded:: 3.7
543
544 The *ssl_handshake_timeout* parameter.
545
Yury Selivanov423fd362017-11-20 17:26:28 -0500546 .. versionchanged:: 3.7
547
Elvis Pranskevichusc0d062f2018-06-08 11:36:00 -0400548 The *path* parameter can now be a :term:`path-like object`.
Yury Selivanov423fd362017-11-20 17:26:28 -0500549
Victor Stinnera6919aa2014-02-19 13:32:34 +0100550
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700551Creating network servers
552^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinnerea3183f2013-12-03 01:08:00 +0100553
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700554.. coroutinemethod:: loop.create_server(protocol_factory, \
555 host=None, port=None, \*, \
556 family=socket.AF_UNSPEC, \
557 flags=socket.AI_PASSIVE, \
558 sock=None, backlog=100, ssl=None, \
559 reuse_address=None, reuse_port=None, \
560 ssl_handshake_timeout=None, start_serving=True)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100561
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700562 Create a TCP server (socket type :data:`~socket.SOCK_STREAM`) listening
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400563 on *port* of the *host* address.
Victor Stinner33f6abe2014-10-12 20:36:04 +0200564
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700565 Returns a :class:`Server` object.
Victor Stinner33f6abe2014-10-12 20:36:04 +0200566
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700567 Arguments:
Victor Stinner33f6abe2014-10-12 20:36:04 +0200568
Bumsik Kim5cc583d2018-09-16 19:40:44 -0400569 * *protocol_factory* must be a callable returning a
570 :ref:`protocol <asyncio-protocol>` implementation.
571
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400572 * The *host* parameter can be set to several types which determine where
573 the server would be listening:
574
575 - If *host* is a string, the TCP server is bound to a single network
576 interface specified by *host*.
577
578 - If *host* is a sequence of strings, the TCP server is bound to all
579 network interfaces specified by the sequence.
580
581 - If *host* is an empty string or ``None``, all interfaces are
582 assumed and a list of multiple sockets will be returned (most likely
583 one for IPv4 and another one for IPv6).
Victor Stinner33f6abe2014-10-12 20:36:04 +0200584
585 * *family* can be set to either :data:`socket.AF_INET` or
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700586 :data:`~socket.AF_INET6` to force the socket to use IPv4 or IPv6.
Carol Willing5b7cbd62018-09-12 17:05:17 -0700587 If not set, the *family* will be determined from host name
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700588 (defaults to :data:`~socket.AF_UNSPEC`).
Victor Stinner33f6abe2014-10-12 20:36:04 +0200589
590 * *flags* is a bitmask for :meth:`getaddrinfo`.
591
592 * *sock* can optionally be specified in order to use a preexisting
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400593 socket object. If specified, *host* and *port* must not be specified.
Victor Stinner33f6abe2014-10-12 20:36:04 +0200594
595 * *backlog* is the maximum number of queued connections passed to
596 :meth:`~socket.socket.listen` (defaults to 100).
597
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400598 * *ssl* can be set to an :class:`~ssl.SSLContext` instance to enable
599 TLS over the accepted connections.
Victor Stinner33f6abe2014-10-12 20:36:04 +0200600
601 * *reuse_address* tells the kernel to reuse a local socket in
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700602 ``TIME_WAIT`` state, without waiting for its natural timeout to
Serhiy Storchaka4adf01c2016-10-19 18:30:05 +0300603 expire. If not specified will automatically be set to ``True`` on
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400604 Unix.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100605
Guido van Rossumb9bf9132015-10-05 09:15:28 -0700606 * *reuse_port* tells the kernel to allow this endpoint to be bound to the
607 same port as other existing endpoints are bound to, so long as they all
608 set this flag when being created. This option is not supported on
609 Windows.
610
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400611 * *ssl_handshake_timeout* is (for a TLS server) the time in seconds to wait
612 for the TLS handshake to complete before aborting the connection.
Yury Selivanov96026432018-06-04 11:32:35 -0400613 ``60.0`` seconds if ``None`` (default).
Neil Aspinallf7686c12017-12-19 19:45:42 +0000614
Yury Selivanovc9070d02018-01-25 18:08:09 -0500615 * *start_serving* set to ``True`` (the default) causes the created server
616 to start accepting connections immediately. When set to ``False``,
617 the user should await on :meth:`Server.start_serving` or
618 :meth:`Server.serve_forever` to make the server to start accepting
619 connections.
620
Neil Aspinallf7686c12017-12-19 19:45:42 +0000621 .. versionadded:: 3.7
622
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700623 Added *ssl_handshake_timeout* and *start_serving* parameters.
624
625 .. versionchanged:: 3.6
626
627 The socket option :py:data:`~socket.TCP_NODELAY` is set by default
628 for all TCP connections.
Neil Aspinallf7686c12017-12-19 19:45:42 +0000629
Victor Stinner60208a12015-09-15 22:41:52 +0200630 .. versionchanged:: 3.5
631
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400632 Added support for SSL/TLS in :class:`ProactorEventLoop`.
Victor Stinnerc8ea8132014-01-23 11:02:09 +0100633
Victor Stinner7b58a2b2015-09-21 18:41:05 +0200634 .. versionchanged:: 3.5.1
Victor Stinner5e4a7d82015-09-21 18:33:43 +0200635
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700636 The *host* parameter can be a sequence of strings.
637
638 .. seealso::
639
640 The :func:`start_server` function is a higher-level alternative API
641 that returns a pair of :class:`StreamReader` and :class:`StreamWriter`
642 that can be used in an async/await code.
Victor Stinner5e4a7d82015-09-21 18:33:43 +0200643
Victor Stinnerea3183f2013-12-03 01:08:00 +0100644
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700645.. coroutinemethod:: loop.create_unix_server(protocol_factory, path=None, \
646 \*, sock=None, backlog=100, ssl=None, \
647 ssl_handshake_timeout=None, start_serving=True)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100648
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700649 Similar to :meth:`loop.create_server` but works with the
650 :py:data:`~socket.AF_UNIX` socket family.
Victor Stinnera6919aa2014-02-19 13:32:34 +0100651
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400652 *path* is the name of a Unix domain socket, and is required,
653 unless a *sock* argument is provided. Abstract Unix sockets,
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700654 :class:`str`, :class:`bytes`, and :class:`~pathlib.Path` paths
655 are supported.
Yury Selivanov423fd362017-11-20 17:26:28 -0500656
Bumsik Kim5cc583d2018-09-16 19:40:44 -0400657 See the documentation of the :meth:`loop.create_server` method
658 for information about arguments to this method.
659
Cheryl Sabella2d6097d2018-10-12 10:55:20 -0400660 .. availability:: Unix.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100661
Neil Aspinallf7686c12017-12-19 19:45:42 +0000662 .. versionadded:: 3.7
663
Elvis Pranskevichusc0d062f2018-06-08 11:36:00 -0400664 The *ssl_handshake_timeout* and *start_serving* parameters.
Neil Aspinallf7686c12017-12-19 19:45:42 +0000665
Yury Selivanov423fd362017-11-20 17:26:28 -0500666 .. versionchanged:: 3.7
667
668 The *path* parameter can now be a :class:`~pathlib.Path` object.
669
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700670.. coroutinemethod:: loop.connect_accepted_socket(protocol_factory, \
671 sock, \*, ssl=None, ssl_handshake_timeout=None)
Yury Selivanov3b3a1412016-11-07 15:35:25 -0500672
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700673 Wrap an already accepted connection into a transport/protocol pair.
Yury Selivanov3b3a1412016-11-07 15:35:25 -0500674
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700675 This method can be used by servers that accept connections outside
676 of asyncio but that use asyncio to handle them.
Yury Selivanov3b3a1412016-11-07 15:35:25 -0500677
678 Parameters:
679
Bumsik Kim5cc583d2018-09-16 19:40:44 -0400680 * *protocol_factory* must be a callable returning a
681 :ref:`protocol <asyncio-protocol>` implementation.
682
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700683 * *sock* is a preexisting socket object returned from
684 :meth:`socket.accept <socket.socket.accept>`.
Yury Selivanov3b3a1412016-11-07 15:35:25 -0500685
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700686 * *ssl* can be set to an :class:`~ssl.SSLContext` to enable SSL over
687 the accepted connections.
Yury Selivanov3b3a1412016-11-07 15:35:25 -0500688
Neil Aspinallf7686c12017-12-19 19:45:42 +0000689 * *ssl_handshake_timeout* is (for an SSL connection) the time in seconds to
690 wait for the SSL handshake to complete before aborting the connection.
Yury Selivanov96026432018-06-04 11:32:35 -0400691 ``60.0`` seconds if ``None`` (default).
Neil Aspinallf7686c12017-12-19 19:45:42 +0000692
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700693 Returns a ``(transport, protocol)`` pair.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100694
Neil Aspinallf7686c12017-12-19 19:45:42 +0000695 .. versionadded:: 3.7
696
697 The *ssl_handshake_timeout* parameter.
698
AraHaan431665b2017-11-21 11:06:26 -0500699 .. versionadded:: 3.5.3
700
701
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700702Transferring files
703^^^^^^^^^^^^^^^^^^
Andrew Svetlov7c684072018-01-27 21:22:47 +0200704
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700705.. coroutinemethod:: loop.sendfile(transport, file, \
706 offset=0, count=None, *, fallback=True)
Andrew Svetlov7c684072018-01-27 21:22:47 +0200707
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700708 Send a *file* over a *transport*. Return the total number of bytes
709 sent.
Andrew Svetlov7c684072018-01-27 21:22:47 +0200710
711 The method uses high-performance :meth:`os.sendfile` if available.
712
713 *file* must be a regular file object opened in binary mode.
714
715 *offset* tells from where to start reading the file. If specified,
716 *count* is the total number of bytes to transmit as opposed to
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400717 sending the file until EOF is reached. File position is always updated,
718 even when this method raises an error, and
719 :meth:`file.tell() <io.IOBase.tell>` can be used to obtain the actual
720 number of bytes sent.
Andrew Svetlov7c684072018-01-27 21:22:47 +0200721
722 *fallback* set to ``True`` makes asyncio to manually read and send
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700723 the file when the platform does not support the sendfile system call
Andrew Svetlov7c684072018-01-27 21:22:47 +0200724 (e.g. Windows or SSL socket on Unix).
725
726 Raise :exc:`SendfileNotAvailableError` if the system does not support
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400727 the *sendfile* syscall and *fallback* is ``False``.
Andrew Svetlov7c684072018-01-27 21:22:47 +0200728
729 .. versionadded:: 3.7
730
731
Yury Selivanovf111b3d2017-12-30 00:35:36 -0500732TLS Upgrade
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700733^^^^^^^^^^^
Yury Selivanovf111b3d2017-12-30 00:35:36 -0500734
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700735.. coroutinemethod:: loop.start_tls(transport, protocol, \
736 sslcontext, \*, server_side=False, \
737 server_hostname=None, ssl_handshake_timeout=None)
Yury Selivanovf111b3d2017-12-30 00:35:36 -0500738
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700739 Upgrade an existing transport-based connection to TLS.
Yury Selivanovf111b3d2017-12-30 00:35:36 -0500740
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700741 Return a new transport instance, that the *protocol* must start using
Yury Selivanovf111b3d2017-12-30 00:35:36 -0500742 immediately after the *await*. The *transport* instance passed to
743 the *start_tls* method should never be used again.
744
745 Parameters:
746
747 * *transport* and *protocol* instances that methods like
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700748 :meth:`~loop.create_server` and
749 :meth:`~loop.create_connection` return.
Yury Selivanovf111b3d2017-12-30 00:35:36 -0500750
751 * *sslcontext*: a configured instance of :class:`~ssl.SSLContext`.
752
753 * *server_side* pass ``True`` when a server-side connection is being
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700754 upgraded (like the one created by :meth:`~loop.create_server`).
Yury Selivanovf111b3d2017-12-30 00:35:36 -0500755
756 * *server_hostname*: sets or overrides the host name that the target
757 server's certificate will be matched against.
758
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400759 * *ssl_handshake_timeout* is (for a TLS connection) the time in seconds to
760 wait for the TLS handshake to complete before aborting the connection.
Yury Selivanov96026432018-06-04 11:32:35 -0400761 ``60.0`` seconds if ``None`` (default).
Yury Selivanovf111b3d2017-12-30 00:35:36 -0500762
763 .. versionadded:: 3.7
764
765
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700766Watching file descriptors
767^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinnerc1567df2014-02-08 23:22:58 +0100768
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700769.. method:: loop.add_reader(fd, callback, \*args)
Victor Stinner41f3c3f2014-08-31 14:47:37 +0200770
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400771 Start monitoring the *fd* file descriptor for read availability and
772 invoke *callback* with the specified arguments once *fd* is available for
773 reading.
Victor Stinner41f3c3f2014-08-31 14:47:37 +0200774
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700775.. method:: loop.remove_reader(fd)
Victor Stinnerc1567df2014-02-08 23:22:58 +0100776
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400777 Stop monitoring the *fd* file descriptor for read availability.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100778
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700779.. method:: loop.add_writer(fd, callback, \*args)
Victor Stinnerc1567df2014-02-08 23:22:58 +0100780
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400781 Start monitoring the *fd* file descriptor for write availability and
782 invoke *callback* with the specified arguments once *fd* is available for
783 writing.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100784
Yury Selivanove247b462018-09-20 12:43:59 -0400785 Use :func:`functools.partial` :ref:`to pass keyword arguments
Naglis17473342018-12-04 09:31:15 +0200786 <asyncio-pass-keywords>` to *callback*.
Victor Stinner8464c242014-11-28 13:15:41 +0100787
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700788.. method:: loop.remove_writer(fd)
Victor Stinnerc1567df2014-02-08 23:22:58 +0100789
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400790 Stop monitoring the *fd* file descriptor for write availability.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100791
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700792See also :ref:`Platform Support <asyncio-platform-support>` section
793for some limitations of these methods.
Victor Stinner04e6df32014-10-11 16:16:27 +0200794
Victor Stinnerc1567df2014-02-08 23:22:58 +0100795
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700796Working with socket objects directly
797^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinnerc1567df2014-02-08 23:22:58 +0100798
Carol Willing5b7cbd62018-09-12 17:05:17 -0700799In general, protocol implementations that use transport-based APIs
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700800such as :meth:`loop.create_connection` and :meth:`loop.create_server`
801are faster than implementations that work with sockets directly.
Carol Willing5b7cbd62018-09-12 17:05:17 -0700802However, there are some use cases when performance is not critical, and
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700803working with :class:`~socket.socket` objects directly is more
804convenient.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100805
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700806.. coroutinemethod:: loop.sock_recv(sock, nbytes)
Yury Selivanov55c50842016-06-08 12:48:15 -0400807
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400808 Receive up to *nbytes* from *sock*. Asynchronous version of
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700809 :meth:`socket.recv() <socket.socket.recv>`.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100810
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400811 Return the received data as a bytes object.
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700812
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400813 *sock* must be a non-blocking socket.
Victor Stinnerec2ce092014-07-29 23:12:22 +0200814
Yury Selivanov19a44f62017-12-14 20:53:26 -0500815 .. versionchanged:: 3.7
Carol Willing5b7cbd62018-09-12 17:05:17 -0700816 Even though this method was always documented as a coroutine
817 method, releases before Python 3.7 returned a :class:`Future`.
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700818 Since Python 3.7 this is an ``async def`` method.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100819
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700820.. coroutinemethod:: loop.sock_recv_into(sock, buf)
Antoine Pitrou525f40d2017-10-19 21:46:40 +0200821
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400822 Receive data from *sock* into the *buf* buffer. Modeled after the blocking
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700823 :meth:`socket.recv_into() <socket.socket.recv_into>` method.
Antoine Pitrou525f40d2017-10-19 21:46:40 +0200824
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700825 Return the number of bytes written to the buffer.
Antoine Pitrou525f40d2017-10-19 21:46:40 +0200826
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400827 *sock* must be a non-blocking socket.
Antoine Pitrou525f40d2017-10-19 21:46:40 +0200828
Antoine Pitrou525f40d2017-10-19 21:46:40 +0200829 .. versionadded:: 3.7
830
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700831.. coroutinemethod:: loop.sock_sendall(sock, data)
Victor Stinnerc1567df2014-02-08 23:22:58 +0100832
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400833 Send *data* to the *sock* socket. Asynchronous version of
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700834 :meth:`socket.sendall() <socket.socket.sendall>`.
Yury Selivanov55c50842016-06-08 12:48:15 -0400835
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400836 This method continues to send to the socket until either all data
837 in *data* has been sent or an error occurs. ``None`` is returned
Carol Willing5b7cbd62018-09-12 17:05:17 -0700838 on success. On error, an exception is raised. Additionally, there is no way
839 to determine how much data, if any, was successfully processed by the
840 receiving end of the connection.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100841
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400842 *sock* must be a non-blocking socket.
Victor Stinnerec2ce092014-07-29 23:12:22 +0200843
Yury Selivanov19a44f62017-12-14 20:53:26 -0500844 .. versionchanged:: 3.7
845 Even though the method was always documented as a coroutine
846 method, before Python 3.7 it returned an :class:`Future`.
847 Since Python 3.7, this is an ``async def`` method.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100848
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700849.. coroutinemethod:: loop.sock_connect(sock, address)
Victor Stinnerc1567df2014-02-08 23:22:58 +0100850
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400851 Connect *sock* to a remote socket at *address*.
Victor Stinner1b0580b2014-02-13 09:24:37 +0100852
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700853 Asynchronous version of :meth:`socket.connect() <socket.socket.connect>`.
854
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400855 *sock* must be a non-blocking socket.
Victor Stinnerec2ce092014-07-29 23:12:22 +0200856
Yury Selivanov55c50842016-06-08 12:48:15 -0400857 .. versionchanged:: 3.5.2
858 ``address`` no longer needs to be resolved. ``sock_connect``
859 will try to check if the *address* is already resolved by calling
860 :func:`socket.inet_pton`. If not,
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700861 :meth:`loop.getaddrinfo` will be used to resolve the
Yury Selivanov55c50842016-06-08 12:48:15 -0400862 *address*.
863
Victor Stinnerc1567df2014-02-08 23:22:58 +0100864 .. seealso::
865
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700866 :meth:`loop.create_connection`
Yury Selivanov55c50842016-06-08 12:48:15 -0400867 and :func:`asyncio.open_connection() <open_connection>`.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100868
869
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700870.. coroutinemethod:: loop.sock_accept(sock)
Victor Stinnerc1567df2014-02-08 23:22:58 +0100871
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700872 Accept a connection. Modeled after the blocking
873 :meth:`socket.accept() <socket.socket.accept>` method.
Yury Selivanov55c50842016-06-08 12:48:15 -0400874
875 The socket must be bound to an address and listening
Victor Stinnerc1567df2014-02-08 23:22:58 +0100876 for connections. The return value is a pair ``(conn, address)`` where *conn*
877 is a *new* socket object usable to send and receive data on the connection,
878 and *address* is the address bound to the socket on the other end of the
879 connection.
880
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400881 *sock* must be a non-blocking socket.
Victor Stinnerec2ce092014-07-29 23:12:22 +0200882
Yury Selivanov19a44f62017-12-14 20:53:26 -0500883 .. versionchanged:: 3.7
884 Even though the method was always documented as a coroutine
885 method, before Python 3.7 it returned a :class:`Future`.
886 Since Python 3.7, this is an ``async def`` method.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100887
888 .. seealso::
889
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700890 :meth:`loop.create_server` and :func:`start_server`.
Victor Stinnerc1567df2014-02-08 23:22:58 +0100891
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700892.. coroutinemethod:: loop.sock_sendfile(sock, file, offset=0, count=None, \
893 \*, fallback=True)
Andrew Svetlov6b5a2792018-01-16 19:59:34 +0200894
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700895 Send a file using high-performance :mod:`os.sendfile` if possible.
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400896 Return the total number of bytes sent.
Andrew Svetlov6b5a2792018-01-16 19:59:34 +0200897
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700898 Asynchronous version of :meth:`socket.sendfile() <socket.socket.sendfile>`.
Andrew Svetlov6b5a2792018-01-16 19:59:34 +0200899
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400900 *sock* must be a non-blocking :const:`socket.SOCK_STREAM`
901 :class:`~socket.socket`.
Andrew Svetlov6b5a2792018-01-16 19:59:34 +0200902
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400903 *file* must be a regular file object open in binary mode.
Andrew Svetlov6b5a2792018-01-16 19:59:34 +0200904
905 *offset* tells from where to start reading the file. If specified,
906 *count* is the total number of bytes to transmit as opposed to
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400907 sending the file until EOF is reached. File position is always updated,
908 even when this method raises an error, and
909 :meth:`file.tell() <io.IOBase.tell>` can be used to obtain the actual
910 number of bytes sent.
Andrew Svetlov6b5a2792018-01-16 19:59:34 +0200911
Carol Willing5b7cbd62018-09-12 17:05:17 -0700912 *fallback*, when set to ``True``, makes asyncio manually read and send
Andrew Svetlov6b5a2792018-01-16 19:59:34 +0200913 the file when the platform does not support the sendfile syscall
914 (e.g. Windows or SSL socket on Unix).
915
Andrew Svetlov7464e872018-01-19 20:04:29 +0200916 Raise :exc:`SendfileNotAvailableError` if the system does not support
Andrew Svetlov6b5a2792018-01-16 19:59:34 +0200917 *sendfile* syscall and *fallback* is ``False``.
918
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400919 *sock* must be a non-blocking socket.
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700920
Andrew Svetlov6b5a2792018-01-16 19:59:34 +0200921 .. versionadded:: 3.7
922
Victor Stinnerc1567df2014-02-08 23:22:58 +0100923
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700924DNS
925^^^
Victor Stinnerea3183f2013-12-03 01:08:00 +0100926
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700927.. coroutinemethod:: loop.getaddrinfo(host, port, \*, family=0, \
928 type=0, proto=0, flags=0)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100929
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700930 Asynchronous version of :meth:`socket.getaddrinfo`.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100931
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700932.. coroutinemethod:: loop.getnameinfo(sockaddr, flags=0)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100933
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700934 Asynchronous version of :meth:`socket.getnameinfo`.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100935
Yury Selivanovbec23722018-01-28 14:09:40 -0500936.. versionchanged:: 3.7
937 Both *getaddrinfo* and *getnameinfo* methods were always documented
938 to return a coroutine, but prior to Python 3.7 they were, in fact,
939 returning :class:`asyncio.Future` objects. Starting with Python 3.7
940 both methods are coroutines.
941
Victor Stinnerea3183f2013-12-03 01:08:00 +0100942
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700943Working with pipes
944^^^^^^^^^^^^^^^^^^
Victor Stinnerea3183f2013-12-03 01:08:00 +0100945
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700946.. coroutinemethod:: loop.connect_read_pipe(protocol_factory, pipe)
Victor Stinner41f3c3f2014-08-31 14:47:37 +0200947
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400948 Register the read end of *pipe* in the event loop.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100949
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700950 *protocol_factory* must be a callable returning an
951 :ref:`asyncio protocol <asyncio-protocol>` implementation.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100952
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700953 *pipe* is a :term:`file-like object <file object>`.
954
955 Return pair ``(transport, protocol)``, where *transport* supports
Bumsik Kim5cc583d2018-09-16 19:40:44 -0400956 the :class:`ReadTransport` interface and *protocol* is an object
957 instantiated by the *protocol_factory*.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100958
Victor Stinnerd84fd732014-08-26 01:01:59 +0200959 With :class:`SelectorEventLoop` event loop, the *pipe* is set to
960 non-blocking mode.
961
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700962.. coroutinemethod:: loop.connect_write_pipe(protocol_factory, pipe)
Victor Stinnerea3183f2013-12-03 01:08:00 +0100963
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400964 Register the write end of *pipe* in the event loop.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100965
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700966 *protocol_factory* must be a callable returning an
967 :ref:`asyncio protocol <asyncio-protocol>` implementation.
968
969 *pipe* is :term:`file-like object <file object>`.
970
Victor Stinner2cef3002014-10-23 22:38:46 +0200971 Return pair ``(transport, protocol)``, where *transport* supports
Bumsik Kim5cc583d2018-09-16 19:40:44 -0400972 :class:`WriteTransport` interface and *protocol* is an object
973 instantiated by the *protocol_factory*.
Victor Stinnerea3183f2013-12-03 01:08:00 +0100974
Victor Stinnerd84fd732014-08-26 01:01:59 +0200975 With :class:`SelectorEventLoop` event loop, the *pipe* is set to
976 non-blocking mode.
977
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700978.. note::
979
980 :class:`SelectorEventLoop` does not support the above methods on
Carol Willing5b7cbd62018-09-12 17:05:17 -0700981 Windows. Use :class:`ProactorEventLoop` instead for Windows.
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700982
Victor Stinner08444382014-02-02 22:43:39 +0100983.. seealso::
984
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700985 The :meth:`loop.subprocess_exec` and
986 :meth:`loop.subprocess_shell` methods.
Victor Stinner08444382014-02-02 22:43:39 +0100987
Victor Stinnerea3183f2013-12-03 01:08:00 +0100988
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400989Unix signals
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700990^^^^^^^^^^^^
Victor Stinner8b863482014-01-27 10:07:50 +0100991
Yury Selivanov7c7605f2018-09-11 09:54:40 -0700992.. method:: loop.add_signal_handler(signum, callback, \*args)
Victor Stinner8b863482014-01-27 10:07:50 +0100993
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -0400994 Set *callback* as the handler for the *signum* signal.
Victor Stinner8b863482014-01-27 10:07:50 +0100995
Hrvoje Nikšiće3666fc2018-12-18 22:31:29 +0100996 The callback will be invoked by *loop*, along with other queued callbacks
997 and runnable coroutines of that event loop. Unlike signal handlers
998 registered using :func:`signal.signal`, a callback registered with this
999 function is allowed to interact with the event loop.
1000
Victor Stinner8b863482014-01-27 10:07:50 +01001001 Raise :exc:`ValueError` if the signal number is invalid or uncatchable.
1002 Raise :exc:`RuntimeError` if there is a problem setting up the handler.
1003
Yury Selivanove247b462018-09-20 12:43:59 -04001004 Use :func:`functools.partial` :ref:`to pass keyword arguments
Naglis17473342018-12-04 09:31:15 +02001005 <asyncio-pass-keywords>` to *callback*.
Victor Stinner8464c242014-11-28 13:15:41 +01001006
Hrvoje Nikšiće3666fc2018-12-18 22:31:29 +01001007 Like :func:`signal.signal`, this function must be invoked in the main
1008 thread.
1009
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001010.. method:: loop.remove_signal_handler(sig)
Victor Stinner8b863482014-01-27 10:07:50 +01001011
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001012 Remove the handler for the *sig* signal.
Victor Stinner8b863482014-01-27 10:07:50 +01001013
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001014 Return ``True`` if the signal handler was removed, or ``False`` if
1015 no handler was set for the given signal.
Victor Stinner8b863482014-01-27 10:07:50 +01001016
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001017 .. availability:: Unix.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001018
Victor Stinner8b863482014-01-27 10:07:50 +01001019.. seealso::
1020
1021 The :mod:`signal` module.
1022
1023
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001024Executing code in thread or process pools
1025^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinnerea3183f2013-12-03 01:08:00 +01001026
Yury Selivanov47150392018-09-18 17:55:44 -04001027.. awaitablemethod:: loop.run_in_executor(executor, func, \*args)
Victor Stinnerea3183f2013-12-03 01:08:00 +01001028
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001029 Arrange for *func* to be called in the specified executor.
Victor Stinnerea3183f2013-12-03 01:08:00 +01001030
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001031 The *executor* argument should be an :class:`concurrent.futures.Executor`
Larry Hastings3732ed22014-03-15 21:13:56 -07001032 instance. The default executor is used if *executor* is ``None``.
Victor Stinnerea3183f2013-12-03 01:08:00 +01001033
Yury Selivanove247b462018-09-20 12:43:59 -04001034 Example::
1035
1036 import asyncio
1037 import concurrent.futures
1038
1039 def blocking_io():
1040 # File operations (such as logging) can block the
1041 # event loop: run them in a thread pool.
1042 with open('/dev/urandom', 'rb') as f:
1043 return f.read(100)
1044
1045 def cpu_bound():
1046 # CPU-bound operations will block the event loop:
1047 # in general it is preferable to run them in a
1048 # process pool.
1049 return sum(i * i for i in range(10 ** 7))
1050
1051 async def main():
1052 loop = asyncio.get_running_loop()
1053
1054 ## Options:
1055
1056 # 1. Run in the default loop's executor:
1057 result = await loop.run_in_executor(
1058 None, blocking_io)
1059 print('default thread pool', result)
1060
1061 # 2. Run in a custom thread pool:
1062 with concurrent.futures.ThreadPoolExecutor() as pool:
1063 result = await loop.run_in_executor(
1064 pool, blocking_io)
1065 print('custom thread pool', result)
1066
1067 # 3. Run in a custom process pool:
1068 with concurrent.futures.ProcessPoolExecutor() as pool:
1069 result = await loop.run_in_executor(
1070 pool, cpu_bound)
1071 print('custom process pool', result)
1072
1073 asyncio.run(main())
Victor Stinner8464c242014-11-28 13:15:41 +01001074
Yury Selivanovbec23722018-01-28 14:09:40 -05001075 This method returns a :class:`asyncio.Future` object.
1076
Yury Selivanove247b462018-09-20 12:43:59 -04001077 Use :func:`functools.partial` :ref:`to pass keyword arguments
1078 <asyncio-pass-keywords>` to *func*.
1079
Yury Selivanove8a60452016-10-21 17:40:42 -04001080 .. versionchanged:: 3.5.3
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001081 :meth:`loop.run_in_executor` no longer configures the
Yury Selivanove8a60452016-10-21 17:40:42 -04001082 ``max_workers`` of the thread pool executor it creates, instead
1083 leaving it up to the thread pool executor
1084 (:class:`~concurrent.futures.ThreadPoolExecutor`) to set the
1085 default.
1086
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001087.. method:: loop.set_default_executor(executor)
Victor Stinnerea3183f2013-12-03 01:08:00 +01001088
Elvis Pranskevichus22d25082018-07-30 11:42:43 +01001089 Set *executor* as the default executor used by :meth:`run_in_executor`.
1090 *executor* should be an instance of
1091 :class:`~concurrent.futures.ThreadPoolExecutor`.
1092
1093 .. deprecated:: 3.8
1094 Using an executor that is not an instance of
1095 :class:`~concurrent.futures.ThreadPoolExecutor` is deprecated and
1096 will trigger an error in Python 3.9.
Victor Stinnerea3183f2013-12-03 01:08:00 +01001097
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001098 *executor* must be an instance of
1099 :class:`concurrent.futures.ThreadPoolExecutor`.
1100
Victor Stinnerea3183f2013-12-03 01:08:00 +01001101
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001102Error Handling API
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001103^^^^^^^^^^^^^^^^^^
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001104
Martin Panterc04fb562016-02-10 05:44:01 +00001105Allows customizing how exceptions are handled in the event loop.
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001106
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001107.. method:: loop.set_exception_handler(handler)
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001108
1109 Set *handler* as the new event loop exception handler.
1110
1111 If *handler* is ``None``, the default exception handler will
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001112 be set. Otherwise, *handler* must be a callable with the signature
1113 matching ``(loop, context)``, where ``loop``
1114 is a reference to the active event loop, and ``context``
1115 is a ``dict`` object containing the details of the exception
1116 (see :meth:`call_exception_handler` documentation for details
1117 about context).
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001118
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001119.. method:: loop.get_exception_handler()
Yury Selivanov950204d2016-05-16 16:23:00 -04001120
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001121 Return the current exception handler, or ``None`` if no custom
1122 exception handler was set.
Yury Selivanov950204d2016-05-16 16:23:00 -04001123
1124 .. versionadded:: 3.5.2
1125
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001126.. method:: loop.default_exception_handler(context)
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001127
1128 Default exception handler.
1129
1130 This is called when an exception occurs and no exception
Carol Willing5b7cbd62018-09-12 17:05:17 -07001131 handler is set. This can be called by a custom exception
1132 handler that wants to defer to the default handler behavior.
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001133
1134 *context* parameter has the same meaning as in
1135 :meth:`call_exception_handler`.
1136
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001137.. method:: loop.call_exception_handler(context)
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001138
1139 Call the current event loop exception handler.
1140
1141 *context* is a ``dict`` object containing the following keys
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001142 (new keys may be introduced in future Python versions):
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001143
1144 * 'message': Error message;
1145 * 'exception' (optional): Exception object;
1146 * 'future' (optional): :class:`asyncio.Future` instance;
1147 * 'handle' (optional): :class:`asyncio.Handle` instance;
1148 * 'protocol' (optional): :ref:`Protocol <asyncio-protocol>` instance;
1149 * 'transport' (optional): :ref:`Transport <asyncio-transport>` instance;
1150 * 'socket' (optional): :class:`socket.socket` instance.
1151
1152 .. note::
1153
Carol Willing5b7cbd62018-09-12 17:05:17 -07001154 This method should not be overloaded in subclassed
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001155 event loops. For custom exception handling, use
1156 the :meth:`set_exception_handler()` method.
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001157
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001158Enabling debug mode
1159^^^^^^^^^^^^^^^^^^^
Victor Stinner0f3e6bc2014-02-19 23:15:02 +01001160
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001161.. method:: loop.get_debug()
Victor Stinner0f3e6bc2014-02-19 23:15:02 +01001162
Victor Stinner7b7120e2014-06-23 00:12:14 +02001163 Get the debug mode (:class:`bool`) of the event loop.
1164
1165 The default value is ``True`` if the environment variable
1166 :envvar:`PYTHONASYNCIODEBUG` is set to a non-empty string, ``False``
1167 otherwise.
Victor Stinner0f3e6bc2014-02-19 23:15:02 +01001168
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001169.. method:: loop.set_debug(enabled: bool)
Victor Stinner0f3e6bc2014-02-19 23:15:02 +01001170
1171 Set the debug mode of the event loop.
1172
Yury Selivanov805e27e2018-09-14 16:57:11 -07001173 .. versionchanged:: 3.7
1174
1175 The new ``-X dev`` command line option can now also be used
1176 to enable the debug mode.
1177
Victor Stinner0f3e6bc2014-02-19 23:15:02 +01001178.. seealso::
1179
Victor Stinner62511fd2014-06-23 00:36:11 +02001180 The :ref:`debug mode of asyncio <asyncio-debug-mode>`.
Victor Stinner0f3e6bc2014-02-19 23:15:02 +01001181
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001182
1183Running Subprocesses
1184^^^^^^^^^^^^^^^^^^^^
1185
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001186Methods described in this subsections are low-level. In regular
1187async/await code consider using the high-level
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001188:func:`asyncio.create_subprocess_shell` and
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001189:func:`asyncio.create_subprocess_exec` convenience functions instead.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001190
1191.. note::
1192
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001193 The default asyncio event loop on **Windows** does not support
1194 subprocesses. See :ref:`Subprocess Support on Windows
1195 <asyncio-windows-subprocess>` for details.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001196
1197.. coroutinemethod:: loop.subprocess_exec(protocol_factory, \*args, \
1198 stdin=subprocess.PIPE, stdout=subprocess.PIPE, \
1199 stderr=subprocess.PIPE, \*\*kwargs)
1200
1201 Create a subprocess from one or more string arguments specified by
1202 *args*.
1203
1204 *args* must be a list of strings represented by:
1205
1206 * :class:`str`;
1207 * or :class:`bytes`, encoded to the
1208 :ref:`filesystem encoding <filesystem-encoding>`.
1209
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001210 The first string specifies the program executable,
Carol Willing5b7cbd62018-09-12 17:05:17 -07001211 and the remaining strings specify the arguments. Together, string
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001212 arguments form the ``argv`` of the program.
1213
1214 This is similar to the standard library :class:`subprocess.Popen`
1215 class called with ``shell=False`` and the list of strings passed as
1216 the first argument; however, where :class:`~subprocess.Popen` takes
1217 a single argument which is list of strings, *subprocess_exec*
1218 takes multiple string arguments.
1219
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001220 The *protocol_factory* must be a callable returning a subclass of the
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001221 :class:`asyncio.SubprocessProtocol` class.
1222
1223 Other parameters:
1224
sbstpf0d4c642019-05-27 19:51:19 -04001225 * *stdin* can be any of these:
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001226
sbstpf0d4c642019-05-27 19:51:19 -04001227 * a file-like object representing a pipe to be connected to the
1228 subprocess's standard input stream using
1229 :meth:`~loop.connect_write_pipe`
1230 * the :const:`subprocess.PIPE` constant (default) which will create a new
1231 pipe and connect it,
1232 * the value ``None`` which will make the subprocess inherit the file
1233 descriptor from this process
1234 * the :const:`subprocess.DEVNULL` constant which indicates that the
1235 special :data:`os.devnull` file will be used
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001236
sbstpf0d4c642019-05-27 19:51:19 -04001237 * *stdout* can be any of these:
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001238
sbstpf0d4c642019-05-27 19:51:19 -04001239 * a file-like object representing a pipe to be connected to the
1240 subprocess's standard output stream using
1241 :meth:`~loop.connect_write_pipe`
1242 * the :const:`subprocess.PIPE` constant (default) which will create a new
1243 pipe and connect it,
1244 * the value ``None`` which will make the subprocess inherit the file
1245 descriptor from this process
1246 * the :const:`subprocess.DEVNULL` constant which indicates that the
1247 special :data:`os.devnull` file will be used
1248
1249 * *stderr* can be any of these:
1250
1251 * a file-like object representing a pipe to be connected to the
1252 subprocess's standard error stream using
1253 :meth:`~loop.connect_write_pipe`
1254 * the :const:`subprocess.PIPE` constant (default) which will create a new
1255 pipe and connect it,
1256 * the value ``None`` which will make the subprocess inherit the file
1257 descriptor from this process
1258 * the :const:`subprocess.DEVNULL` constant which indicates that the
1259 special :data:`os.devnull` file will be used
1260 * the :const:`subprocess.STDOUT` constant which will connect the standard
1261 error stream to the process' standard output stream
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001262
1263 * All other keyword arguments are passed to :class:`subprocess.Popen`
sbstpf0d4c642019-05-27 19:51:19 -04001264 without interpretation, except for *bufsize*, *universal_newlines*,
1265 *shell*, *text*, *encoding* and *errors*, which should not be specified
1266 at all.
1267
1268 The ``asyncio`` subprocess API does not support decoding the streams
1269 as text. :func:`bytes.decode` can be used to convert the bytes returned
1270 from the stream to text.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001271
1272 See the constructor of the :class:`subprocess.Popen` class
1273 for documentation on other arguments.
1274
1275 Returns a pair of ``(transport, protocol)``, where *transport*
Bumsik Kim5cc583d2018-09-16 19:40:44 -04001276 conforms to the :class:`asyncio.SubprocessTransport` base class and
1277 *protocol* is an object instantiated by the *protocol_factory*.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001278
1279.. coroutinemethod:: loop.subprocess_shell(protocol_factory, cmd, \*, \
1280 stdin=subprocess.PIPE, stdout=subprocess.PIPE, \
1281 stderr=subprocess.PIPE, \*\*kwargs)
1282
1283 Create a subprocess from *cmd*, which can be a :class:`str` or a
1284 :class:`bytes` string encoded to the
1285 :ref:`filesystem encoding <filesystem-encoding>`,
1286 using the platform's "shell" syntax.
1287
1288 This is similar to the standard library :class:`subprocess.Popen`
1289 class called with ``shell=True``.
1290
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001291 The *protocol_factory* must be a callable returning a subclass of the
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001292 :class:`SubprocessProtocol` class.
1293
1294 See :meth:`~loop.subprocess_exec` for more details about
1295 the remaining arguments.
1296
1297 Returns a pair of ``(transport, protocol)``, where *transport*
Bumsik Kim5cc583d2018-09-16 19:40:44 -04001298 conforms to the :class:`SubprocessTransport` base class and
1299 *protocol* is an object instantiated by the *protocol_factory*.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001300
1301.. note::
1302 It is the application's responsibility to ensure that all whitespace
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001303 and special characters are quoted appropriately to avoid `shell injection
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001304 <https://en.wikipedia.org/wiki/Shell_injection#Shell_injection>`_
1305 vulnerabilities. The :func:`shlex.quote` function can be used to
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001306 properly escape whitespace and special characters in strings that
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001307 are going to be used to construct shell commands.
1308
1309
1310Callback Handles
1311================
1312
1313.. class:: Handle
1314
1315 A callback wrapper object returned by :meth:`loop.call_soon`,
1316 :meth:`loop.call_soon_threadsafe`.
1317
1318 .. method:: cancel()
1319
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001320 Cancel the callback. If the callback has already been canceled
1321 or executed, this method has no effect.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001322
1323 .. method:: cancelled()
1324
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001325 Return ``True`` if the callback was cancelled.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001326
1327 .. versionadded:: 3.7
1328
1329.. class:: TimerHandle
1330
1331 A callback wrapper object returned by :meth:`loop.call_later`,
1332 and :meth:`loop.call_at`.
1333
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001334 This class is a subclass of :class:`Handle`.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001335
1336 .. method:: when()
1337
1338 Return a scheduled callback time as :class:`float` seconds.
1339
1340 The time is an absolute timestamp, using the same time
1341 reference as :meth:`loop.time`.
1342
1343 .. versionadded:: 3.7
1344
1345
1346Server Objects
1347==============
1348
1349Server objects are created by :meth:`loop.create_server`,
1350:meth:`loop.create_unix_server`, :func:`start_server`,
1351and :func:`start_unix_server` functions.
1352
1353Do not instantiate the class directly.
Victor Stinner8c462c52014-01-24 18:11:43 +01001354
Victor Stinner8ebeb032014-07-11 23:47:40 +02001355.. class:: Server
Victor Stinner8c462c52014-01-24 18:11:43 +01001356
Yury Selivanovc9070d02018-01-25 18:08:09 -05001357 *Server* objects are asynchronous context managers. When used in an
1358 ``async with`` statement, it's guaranteed that the Server object is
1359 closed and not accepting new connections when the ``async with``
1360 statement is completed::
1361
1362 srv = await loop.create_server(...)
1363
1364 async with srv:
1365 # some code
1366
Carol Willing5b7cbd62018-09-12 17:05:17 -07001367 # At this point, srv is closed and no longer accepts new connections.
Yury Selivanovc9070d02018-01-25 18:08:09 -05001368
1369
1370 .. versionchanged:: 3.7
1371 Server object is an asynchronous context manager since Python 3.7.
Victor Stinner8c462c52014-01-24 18:11:43 +01001372
1373 .. method:: close()
1374
Victor Stinner4bfb14a2014-07-12 03:20:24 +02001375 Stop serving: close listening sockets and set the :attr:`sockets`
1376 attribute to ``None``.
1377
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001378 The sockets that represent existing incoming client connections
1379 are left open.
Victor Stinner8ebeb032014-07-11 23:47:40 +02001380
Berker Peksag49c9edf2016-01-20 07:14:22 +02001381 The server is closed asynchronously, use the :meth:`wait_closed`
1382 coroutine to wait until the server is closed.
Victor Stinner8c462c52014-01-24 18:11:43 +01001383
Srinivas Reddy Thatiparthy (శ్రీనివాస్ రెడ్డి తాటిపర్తి)1634fc22017-12-30 20:39:32 +05301384 .. method:: get_loop()
1385
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001386 Return the event loop associated with the server object.
Srinivas Reddy Thatiparthy (శ్రీనివాస్ రెడ్డి తాటిపర్తి)1634fc22017-12-30 20:39:32 +05301387
1388 .. versionadded:: 3.7
1389
Yury Selivanovc9070d02018-01-25 18:08:09 -05001390 .. coroutinemethod:: start_serving()
1391
1392 Start accepting connections.
1393
1394 This method is idempotent, so it can be called when
1395 the server is already being serving.
1396
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001397 The *start_serving* keyword-only parameter to
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001398 :meth:`loop.create_server` and
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001399 :meth:`asyncio.start_server` allows creating a Server object
1400 that is not accepting connections initially. In this case
1401 ``Server.start_serving()``, or :meth:`Server.serve_forever` can be used
1402 to make the Server start accepting connections.
Yury Selivanovc9070d02018-01-25 18:08:09 -05001403
1404 .. versionadded:: 3.7
1405
1406 .. coroutinemethod:: serve_forever()
1407
1408 Start accepting connections until the coroutine is cancelled.
1409 Cancellation of ``serve_forever`` task causes the server
1410 to be closed.
1411
1412 This method can be called if the server is already accepting
1413 connections. Only one ``serve_forever`` task can exist per
1414 one *Server* object.
1415
1416 Example::
1417
1418 async def client_connected(reader, writer):
1419 # Communicate with the client with
1420 # reader/writer streams. For example:
1421 await reader.readline()
1422
1423 async def main(host, port):
1424 srv = await asyncio.start_server(
1425 client_connected, host, port)
Andrew Svetlov17ab8f02018-02-17 19:44:35 +02001426 await srv.serve_forever()
Yury Selivanovc9070d02018-01-25 18:08:09 -05001427
1428 asyncio.run(main('127.0.0.1', 0))
1429
1430 .. versionadded:: 3.7
1431
1432 .. method:: is_serving()
1433
1434 Return ``True`` if the server is accepting new connections.
1435
1436 .. versionadded:: 3.7
1437
Victor Stinnerbdd574d2015-02-12 22:49:18 +01001438 .. coroutinemethod:: wait_closed()
Victor Stinner8c462c52014-01-24 18:11:43 +01001439
Victor Stinner8ebeb032014-07-11 23:47:40 +02001440 Wait until the :meth:`close` method completes.
1441
Victor Stinner8ebeb032014-07-11 23:47:40 +02001442 .. attribute:: sockets
1443
Emmanuel Ariasdf5cdc12019-02-22 14:34:41 -03001444 List of :class:`socket.socket` objects the server is listening on.
Victor Stinner8c462c52014-01-24 18:11:43 +01001445
Yury Selivanovc9070d02018-01-25 18:08:09 -05001446 .. versionchanged:: 3.7
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001447 Prior to Python 3.7 ``Server.sockets`` used to return an
1448 internal list of server sockets directly. In 3.7 a copy
Yury Selivanovc9070d02018-01-25 18:08:09 -05001449 of that list is returned.
1450
Victor Stinner8c462c52014-01-24 18:11:43 +01001451
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001452.. _asyncio-event-loops:
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001453
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001454Event Loop Implementations
1455==========================
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001456
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001457asyncio ships with two different event loop implementations:
1458:class:`SelectorEventLoop` and :class:`ProactorEventLoop`.
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001459
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001460By default asyncio is configured to use :class:`SelectorEventLoop`
Miss Islington (bot)2e0ec5b2019-06-23 17:33:00 -07001461on Unix and :class:`ProactorEventLoop` on Windows.
Andrew Svetlov3d4dbd82018-02-01 19:59:32 +02001462
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001463
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001464.. class:: SelectorEventLoop
1465
1466 An event loop based on the :mod:`selectors` module.
1467
1468 Uses the most efficient *selector* available for the given
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001469 platform. It is also possible to manually configure the
1470 exact selector implementation to be used::
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001471
1472 import asyncio
1473 import selectors
1474
1475 selector = selectors.SelectSelector()
1476 loop = asyncio.SelectorEventLoop(selector)
1477 asyncio.set_event_loop(loop)
Andrew Svetlov7464e872018-01-19 20:04:29 +02001478
1479
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001480 .. availability:: Unix, Windows.
Andrew Svetlov7464e872018-01-19 20:04:29 +02001481
1482
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001483.. class:: ProactorEventLoop
1484
1485 An event loop for Windows that uses "I/O Completion Ports" (IOCP).
1486
Cheryl Sabella2d6097d2018-10-12 10:55:20 -04001487 .. availability:: Windows.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001488
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001489 .. seealso::
1490
1491 `MSDN documentation on I/O Completion Ports
1492 <https://docs.microsoft.com/en-ca/windows/desktop/FileIO/i-o-completion-ports>`_.
1493
1494
1495.. class:: AbstractEventLoop
1496
1497 Abstract base class for asyncio-compliant event loops.
1498
1499 The :ref:`Event Loop Methods <asyncio-event-loop>` section lists all
1500 methods that an alternative implementation of ``AbstractEventLoop``
1501 should have defined.
1502
1503
1504Examples
1505========
1506
1507Note that all examples in this section **purposefully** show how
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001508to use the low-level event loop APIs, such as :meth:`loop.run_forever`
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001509and :meth:`loop.call_soon`. Modern asyncio applications rarely
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001510need to be written this way; consider using the high-level functions
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001511like :func:`asyncio.run`.
1512
Yury Selivanov43ee1c12014-02-19 20:58:44 -05001513
Yury Selivanov394374e2018-09-17 15:35:24 -04001514.. _asyncio_example_lowlevel_helloworld:
Victor Stinnerea3183f2013-12-03 01:08:00 +01001515
Victor Stinner7f314ed2014-10-15 18:49:16 +02001516Hello World with call_soon()
Victor Stinnera092a612015-01-09 15:58:41 +01001517^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinnerea3183f2013-12-03 01:08:00 +01001518
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001519An example using the :meth:`loop.call_soon` method to schedule a
1520callback. The callback displays ``"Hello World"`` and then stops the
1521event loop::
Victor Stinnerea3183f2013-12-03 01:08:00 +01001522
1523 import asyncio
1524
Victor Stinner7f314ed2014-10-15 18:49:16 +02001525 def hello_world(loop):
Carol Willing5b7cbd62018-09-12 17:05:17 -07001526 """A callback to print 'Hello World' and stop the event loop"""
Victor Stinnerea3183f2013-12-03 01:08:00 +01001527 print('Hello World')
Victor Stinner7f314ed2014-10-15 18:49:16 +02001528 loop.stop()
Victor Stinnerea3183f2013-12-03 01:08:00 +01001529
1530 loop = asyncio.get_event_loop()
Victor Stinner7f314ed2014-10-15 18:49:16 +02001531
1532 # Schedule a call to hello_world()
1533 loop.call_soon(hello_world, loop)
1534
1535 # Blocking call interrupted by loop.stop()
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001536 try:
1537 loop.run_forever()
1538 finally:
1539 loop.close()
Victor Stinnerea3183f2013-12-03 01:08:00 +01001540
Victor Stinner3e09e322013-12-03 01:22:06 +01001541.. seealso::
Victor Stinnerea3183f2013-12-03 01:08:00 +01001542
Yury Selivanov3faaa882018-09-14 13:32:07 -07001543 A similar :ref:`Hello World <coroutine>`
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001544 example created with a coroutine and the :func:`run` function.
Victor Stinnerea3183f2013-12-03 01:08:00 +01001545
Victor Stinner8b863482014-01-27 10:07:50 +01001546
Yury Selivanov394374e2018-09-17 15:35:24 -04001547.. _asyncio_example_call_later:
Victor Stinner7f314ed2014-10-15 18:49:16 +02001548
1549Display the current date with call_later()
Victor Stinnera092a612015-01-09 15:58:41 +01001550^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinner7f314ed2014-10-15 18:49:16 +02001551
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001552An example of a callback displaying the current date every second. The
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001553callback uses the :meth:`loop.call_later` method to reschedule itself
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001554after 5 seconds, and then stops the event loop::
Victor Stinner7f314ed2014-10-15 18:49:16 +02001555
1556 import asyncio
1557 import datetime
1558
1559 def display_date(end_time, loop):
1560 print(datetime.datetime.now())
1561 if (loop.time() + 1.0) < end_time:
1562 loop.call_later(1, display_date, end_time, loop)
1563 else:
1564 loop.stop()
1565
1566 loop = asyncio.get_event_loop()
1567
1568 # Schedule the first call to display_date()
1569 end_time = loop.time() + 5.0
1570 loop.call_soon(display_date, end_time, loop)
1571
1572 # Blocking call interrupted by loop.stop()
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001573 try:
1574 loop.run_forever()
1575 finally:
1576 loop.close()
Victor Stinner7f314ed2014-10-15 18:49:16 +02001577
1578.. seealso::
1579
Yury Selivanov7372c3b2018-09-14 15:11:24 -07001580 A similar :ref:`current date <asyncio_example_sleep>` example
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001581 created with a coroutine and the :func:`run` function.
Victor Stinner7f314ed2014-10-15 18:49:16 +02001582
1583
Yury Selivanov394374e2018-09-17 15:35:24 -04001584.. _asyncio_example_watch_fd:
Victor Stinner8b863482014-01-27 10:07:50 +01001585
Victor Stinner04e6df32014-10-11 16:16:27 +02001586Watch a file descriptor for read events
Victor Stinnera092a612015-01-09 15:58:41 +01001587^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinner04e6df32014-10-11 16:16:27 +02001588
1589Wait until a file descriptor received some data using the
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001590:meth:`loop.add_reader` method and then close the event loop::
Victor Stinner04e6df32014-10-11 16:16:27 +02001591
1592 import asyncio
Victor Stinnerac577d72017-11-28 21:33:20 +01001593 from socket import socketpair
Victor Stinner04e6df32014-10-11 16:16:27 +02001594
1595 # Create a pair of connected file descriptors
Victor Stinnerccd8e342014-10-11 16:30:02 +02001596 rsock, wsock = socketpair()
Carol Willing5b7cbd62018-09-12 17:05:17 -07001597
Victor Stinner04e6df32014-10-11 16:16:27 +02001598 loop = asyncio.get_event_loop()
1599
1600 def reader():
1601 data = rsock.recv(100)
1602 print("Received:", data.decode())
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001603
Victor Stinner2cef3002014-10-23 22:38:46 +02001604 # We are done: unregister the file descriptor
Victor Stinner04e6df32014-10-11 16:16:27 +02001605 loop.remove_reader(rsock)
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001606
Victor Stinner04e6df32014-10-11 16:16:27 +02001607 # Stop the event loop
1608 loop.stop()
1609
Victor Stinner2cef3002014-10-23 22:38:46 +02001610 # Register the file descriptor for read event
Victor Stinner04e6df32014-10-11 16:16:27 +02001611 loop.add_reader(rsock, reader)
1612
1613 # Simulate the reception of data from the network
1614 loop.call_soon(wsock.send, 'abc'.encode())
1615
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001616 try:
1617 # Run the event loop
1618 loop.run_forever()
1619 finally:
Carol Willing5b7cbd62018-09-12 17:05:17 -07001620 # We are done. Close sockets and the event loop.
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001621 rsock.close()
1622 wsock.close()
1623 loop.close()
Victor Stinner04e6df32014-10-11 16:16:27 +02001624
1625.. seealso::
1626
Yury Selivanov394374e2018-09-17 15:35:24 -04001627 * A similar :ref:`example <asyncio_example_create_connection>`
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001628 using transports, protocols, and the
1629 :meth:`loop.create_connection` method.
Victor Stinner04e6df32014-10-11 16:16:27 +02001630
Yury Selivanov394374e2018-09-17 15:35:24 -04001631 * Another similar :ref:`example <asyncio_example_create_connection-streams>`
Yury Selivanov1c19d652019-09-29 22:30:17 -07001632 using the high-level :func:`asyncio.open_connection` function
1633 and streams.
Victor Stinner04e6df32014-10-11 16:16:27 +02001634
1635
Yury Selivanov394374e2018-09-17 15:35:24 -04001636.. _asyncio_example_unix_signals:
1637
Victor Stinner04e6df32014-10-11 16:16:27 +02001638Set signal handlers for SIGINT and SIGTERM
Victor Stinnera092a612015-01-09 15:58:41 +01001639^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Victor Stinner04e6df32014-10-11 16:16:27 +02001640
Elvis Pranskevichus1fa2ec42018-09-17 19:16:44 -04001641(This ``signals`` example only works on Unix.)
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001642
1643Register handlers for signals :py:data:`SIGINT` and :py:data:`SIGTERM`
1644using the :meth:`loop.add_signal_handler` method::
Victor Stinner8b863482014-01-27 10:07:50 +01001645
1646 import asyncio
1647 import functools
1648 import os
1649 import signal
1650
Alexander Vasinceb842e2019-05-03 18:25:36 +03001651 def ask_exit(signame, loop):
Victor Stinner8b863482014-01-27 10:07:50 +01001652 print("got signal %s: exit" % signame)
1653 loop.stop()
1654
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001655 async def main():
1656 loop = asyncio.get_running_loop()
Victor Stinner8b863482014-01-27 10:07:50 +01001657
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001658 for signame in {'SIGINT', 'SIGTERM'}:
1659 loop.add_signal_handler(
1660 getattr(signal, signame),
Alexander Vasinceb842e2019-05-03 18:25:36 +03001661 functools.partial(ask_exit, signame, loop))
Victor Stinner2cef3002014-10-23 22:38:46 +02001662
Yury Selivanov7c7605f2018-09-11 09:54:40 -07001663 await asyncio.sleep(3600)
1664
1665 print("Event loop running for 1 hour, press Ctrl+C to interrupt.")
1666 print(f"pid {os.getpid()}: send SIGINT or SIGTERM to exit.")
1667
1668 asyncio.run(main())