blob: d269d0b0eaa6ce09d903617af8fe0e84f067cdf5 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`os` --- Miscellaneous operating system interfaces
2=======================================================
3
4.. module:: os
5 :synopsis: Miscellaneous operating system interfaces.
6
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04007**Source code:** :source:`Lib/os.py`
8
9--------------
Georg Brandl116aa622007-08-15 14:28:22 +000010
Christian Heimesa62da1d2008-01-12 19:39:10 +000011This module provides a portable way of using operating system dependent
12functionality. If you just want to read or write a file see :func:`open`, if
13you want to manipulate paths, see the :mod:`os.path` module, and if you want to
14read all the lines in all the files on the command line see the :mod:`fileinput`
15module. For creating temporary files and directories see the :mod:`tempfile`
16module, and for high-level file and directory handling see the :mod:`shutil`
17module.
Georg Brandl116aa622007-08-15 14:28:22 +000018
Benjamin Peterson1baf4652009-12-31 03:11:23 +000019Notes on the availability of these functions:
Georg Brandl116aa622007-08-15 14:28:22 +000020
Benjamin Peterson1baf4652009-12-31 03:11:23 +000021* The design of all built-in operating system dependent modules of Python is
22 such that as long as the same functionality is available, it uses the same
23 interface; for example, the function ``os.stat(path)`` returns stat
24 information about *path* in the same format (which happens to have originated
25 with the POSIX interface).
Georg Brandl116aa622007-08-15 14:28:22 +000026
Benjamin Peterson1baf4652009-12-31 03:11:23 +000027* Extensions peculiar to a particular operating system are also available
28 through the :mod:`os` module, but using them is of course a threat to
29 portability.
Georg Brandl116aa622007-08-15 14:28:22 +000030
Benjamin Peterson1baf4652009-12-31 03:11:23 +000031* All functions accepting path or file names accept both bytes and string
32 objects, and result in an object of the same type, if a path or file name is
33 returned.
Georg Brandl76e55382008-10-08 16:34:57 +000034
Benjamin Peterson1baf4652009-12-31 03:11:23 +000035* An "Availability: Unix" note means that this function is commonly found on
36 Unix systems. It does not make any claims about its existence on a specific
37 operating system.
38
39* If not separately noted, all functions that claim "Availability: Unix" are
40 supported on Mac OS X, which builds on a Unix core.
41
Benjamin Petersonf650e462010-05-06 23:03:05 +000042.. Availability notes get their own line and occur at the end of the function
43.. documentation.
44
Georg Brandlc575c902008-09-13 17:46:05 +000045.. note::
46
Christian Heimesa62da1d2008-01-12 19:39:10 +000047 All functions in this module raise :exc:`OSError` in the case of invalid or
48 inaccessible file names and paths, or other arguments that have the correct
49 type, but are not accepted by the operating system.
Georg Brandl116aa622007-08-15 14:28:22 +000050
Georg Brandl116aa622007-08-15 14:28:22 +000051.. exception:: error
52
Christian Heimesa62da1d2008-01-12 19:39:10 +000053 An alias for the built-in :exc:`OSError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +000054
55
56.. data:: name
57
Benjamin Peterson1baf4652009-12-31 03:11:23 +000058 The name of the operating system dependent module imported. The following
Ned Deily5c867012014-06-26 23:40:06 -070059 names have currently been registered: ``'posix'``, ``'nt'``,
Larry Hastings10108a72016-09-05 15:11:23 -070060 ``'java'``.
Georg Brandl116aa622007-08-15 14:28:22 +000061
Antoine Pitroua83cdaa2011-07-09 15:54:23 +020062 .. seealso::
63 :attr:`sys.platform` has a finer granularity. :func:`os.uname` gives
64 system-dependent version information.
65
66 The :mod:`platform` module provides detailed checks for the
67 system's identity.
68
Georg Brandl116aa622007-08-15 14:28:22 +000069
Martin v. Löwis011e8422009-05-05 04:43:17 +000070.. _os-filenames:
Victor Stinner6bfd8542014-06-19 12:50:27 +020071.. _filesystem-encoding:
Martin v. Löwis011e8422009-05-05 04:43:17 +000072
73File Names, Command Line Arguments, and Environment Variables
74-------------------------------------------------------------
75
Georg Brandl67b21b72010-08-17 15:07:14 +000076In Python, file names, command line arguments, and environment variables are
77represented using the string type. On some systems, decoding these strings to
78and from bytes is necessary before passing them to the operating system. Python
79uses the file system encoding to perform this conversion (see
80:func:`sys.getfilesystemencoding`).
Martin v. Löwis011e8422009-05-05 04:43:17 +000081
82.. versionchanged:: 3.1
Georg Brandl67b21b72010-08-17 15:07:14 +000083 On some systems, conversion using the file system encoding may fail. In this
Victor Stinnerf6a271a2014-08-01 12:28:48 +020084 case, Python uses the :ref:`surrogateescape encoding error handler
85 <surrogateescape>`, which means that undecodable bytes are replaced by a
86 Unicode character U+DCxx on decoding, and these are again translated to the
87 original byte on encoding.
Martin v. Löwis011e8422009-05-05 04:43:17 +000088
89
Georg Brandl67b21b72010-08-17 15:07:14 +000090The file system encoding must guarantee to successfully decode all bytes
91below 128. If the file system encoding fails to provide this guarantee, API
92functions may raise UnicodeErrors.
Martin v. Löwis011e8422009-05-05 04:43:17 +000093
94
Georg Brandl116aa622007-08-15 14:28:22 +000095.. _os-procinfo:
96
97Process Parameters
98------------------
99
100These functions and data items provide information and operate on the current
101process and user.
102
103
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200104.. function:: ctermid()
105
106 Return the filename corresponding to the controlling terminal of the process.
107
108 Availability: Unix.
109
110
Georg Brandl116aa622007-08-15 14:28:22 +0000111.. data:: environ
112
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700113 A :term:`mapping` object representing the string environment. For example,
Georg Brandl116aa622007-08-15 14:28:22 +0000114 ``environ['HOME']`` is the pathname of your home directory (on some platforms),
115 and is equivalent to ``getenv("HOME")`` in C.
116
117 This mapping is captured the first time the :mod:`os` module is imported,
118 typically during Python startup as part of processing :file:`site.py`. Changes
119 to the environment made after this time are not reflected in ``os.environ``,
120 except for changes made by modifying ``os.environ`` directly.
121
122 If the platform supports the :func:`putenv` function, this mapping may be used
123 to modify the environment as well as query the environment. :func:`putenv` will
124 be called automatically when the mapping is modified.
125
Victor Stinner84ae1182010-05-06 22:05:07 +0000126 On Unix, keys and values use :func:`sys.getfilesystemencoding` and
127 ``'surrogateescape'`` error handler. Use :data:`environb` if you would like
128 to use a different encoding.
129
Georg Brandl116aa622007-08-15 14:28:22 +0000130 .. note::
131
132 Calling :func:`putenv` directly does not change ``os.environ``, so it's better
133 to modify ``os.environ``.
134
135 .. note::
136
Georg Brandlc575c902008-09-13 17:46:05 +0000137 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
138 cause memory leaks. Refer to the system documentation for
Georg Brandl60203b42010-10-06 10:11:56 +0000139 :c:func:`putenv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000140
141 If :func:`putenv` is not provided, a modified copy of this mapping may be
142 passed to the appropriate process-creation functions to cause child processes
143 to use a modified environment.
144
Georg Brandl9afde1c2007-11-01 20:32:30 +0000145 If the platform supports the :func:`unsetenv` function, you can delete items in
Georg Brandl116aa622007-08-15 14:28:22 +0000146 this mapping to unset environment variables. :func:`unsetenv` will be called
Georg Brandl9afde1c2007-11-01 20:32:30 +0000147 automatically when an item is deleted from ``os.environ``, and when
148 one of the :meth:`pop` or :meth:`clear` methods is called.
149
Georg Brandl116aa622007-08-15 14:28:22 +0000150
Victor Stinner84ae1182010-05-06 22:05:07 +0000151.. data:: environb
152
Chris Jerdonek11f3f172012-11-03 12:05:55 -0700153 Bytes version of :data:`environ`: a :term:`mapping` object representing the
Victor Stinner84ae1182010-05-06 22:05:07 +0000154 environment as byte strings. :data:`environ` and :data:`environb` are
155 synchronized (modify :data:`environb` updates :data:`environ`, and vice
156 versa).
157
Victor Stinnerb745a742010-05-18 17:17:23 +0000158 :data:`environb` is only available if :data:`supports_bytes_environ` is
159 True.
Victor Stinner84ae1182010-05-06 22:05:07 +0000160
Benjamin Peterson662c74f2010-05-06 22:09:03 +0000161 .. versionadded:: 3.2
162
Victor Stinner84ae1182010-05-06 22:05:07 +0000163
Georg Brandl116aa622007-08-15 14:28:22 +0000164.. function:: chdir(path)
165 fchdir(fd)
166 getcwd()
167 :noindex:
168
169 These functions are described in :ref:`os-file-dir`.
170
171
Victor Stinnere8d51452010-08-19 01:05:19 +0000172.. function:: fsencode(filename)
Victor Stinner449c4662010-05-08 11:10:09 +0000173
Brett Cannonc28592b2016-06-24 12:21:47 -0700174 Encode :term:`path-like <path-like object>` *filename* to the filesystem
175 encoding with ``'surrogateescape'`` error handler, or ``'strict'`` on
176 Windows; return :class:`bytes` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000177
Antoine Pitroua305ca72010-09-25 22:12:00 +0000178 :func:`fsdecode` is the reverse function.
Victor Stinnere8d51452010-08-19 01:05:19 +0000179
180 .. versionadded:: 3.2
181
Brett Cannonb08388d2016-06-09 15:58:06 -0700182 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700183 Support added to accept objects implementing the :class:`os.PathLike`
184 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700185
Victor Stinnere8d51452010-08-19 01:05:19 +0000186
187.. function:: fsdecode(filename)
188
Brett Cannonc28592b2016-06-24 12:21:47 -0700189 Decode the :term:`path-like <path-like object>` *filename* from the
190 filesystem encoding with ``'surrogateescape'`` error handler, or ``'strict'``
191 on Windows; return :class:`str` unchanged.
Victor Stinnere8d51452010-08-19 01:05:19 +0000192
193 :func:`fsencode` is the reverse function.
Victor Stinner449c4662010-05-08 11:10:09 +0000194
195 .. versionadded:: 3.2
196
Brett Cannonb08388d2016-06-09 15:58:06 -0700197 .. versionchanged:: 3.6
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700198 Support added to accept objects implementing the :class:`os.PathLike`
199 interface.
Brett Cannonb08388d2016-06-09 15:58:06 -0700200
Victor Stinner449c4662010-05-08 11:10:09 +0000201
Ethan Furmancdc08792016-06-02 15:06:09 -0700202.. function:: fspath(path)
203
Brett Cannon0fa1aa12016-06-09 14:37:06 -0700204 Return the file system representation of the path.
Ethan Furmancdc08792016-06-02 15:06:09 -0700205
Brett Cannonc78ca1e2016-06-24 12:03:43 -0700206 If :class:`str` or :class:`bytes` is passed in, it is returned unchanged.
207 Otherwise :meth:`~os.PathLike.__fspath__` is called and its value is
208 returned as long as it is a :class:`str` or :class:`bytes` object.
209 In all other cases, :exc:`TypeError` is raised.
Ethan Furmancdc08792016-06-02 15:06:09 -0700210
Brett Cannonb08388d2016-06-09 15:58:06 -0700211 .. versionadded:: 3.6
212
213
214.. class:: PathLike
215
216 An :term:`abstract base class` for objects representing a file system path,
217 e.g. :class:`pathlib.PurePath`.
218
Berker Peksagb18ffb42016-06-10 08:43:54 +0300219 .. versionadded:: 3.6
220
Brett Cannonb08388d2016-06-09 15:58:06 -0700221 .. abstractmethod:: __fspath__()
222
223 Return the file system path representation of the object.
224
225 The method should only return a :class:`str` or :class:`bytes` object,
226 with the preference being for :class:`str`.
227
Ethan Furmancdc08792016-06-02 15:06:09 -0700228
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200229.. function:: getenv(key, default=None)
230
231 Return the value of the environment variable *key* if it exists, or
232 *default* if it doesn't. *key*, *default* and the result are str.
233
234 On Unix, keys and values are decoded with :func:`sys.getfilesystemencoding`
235 and ``'surrogateescape'`` error handler. Use :func:`os.getenvb` if you
236 would like to use a different encoding.
237
238 Availability: most flavors of Unix, Windows.
239
240
241.. function:: getenvb(key, default=None)
242
243 Return the value of the environment variable *key* if it exists, or
244 *default* if it doesn't. *key*, *default* and the result are bytes.
245
Berker Peksag996e5f92016-09-26 22:44:07 +0300246 :func:`getenvb` is only available if :data:`supports_bytes_environ`
247 is True.
248
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200249 Availability: most flavors of Unix.
250
251 .. versionadded:: 3.2
252
253
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000254.. function:: get_exec_path(env=None)
255
256 Returns the list of directories that will be searched for a named
257 executable, similar to a shell, when launching a process.
258 *env*, when specified, should be an environment variable dictionary
259 to lookup the PATH in.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300260 By default, when *env* is ``None``, :data:`environ` is used.
Gregory P. Smithb6e8c7e2010-02-27 07:22:22 +0000261
262 .. versionadded:: 3.2
263
264
Georg Brandl116aa622007-08-15 14:28:22 +0000265.. function:: getegid()
266
267 Return the effective group id of the current process. This corresponds to the
Benjamin Petersonf650e462010-05-06 23:03:05 +0000268 "set id" bit on the file being executed in the current process.
269
270 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000271
272
273.. function:: geteuid()
274
275 .. index:: single: user; effective id
276
Benjamin Petersonf650e462010-05-06 23:03:05 +0000277 Return the current process's effective user id.
278
279 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000280
281
282.. function:: getgid()
283
284 .. index:: single: process; group
285
Benjamin Petersonf650e462010-05-06 23:03:05 +0000286 Return the real group id of the current process.
287
288 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000289
290
Ross Lagerwallb0ae53d2011-06-10 07:30:30 +0200291.. function:: getgrouplist(user, group)
292
293 Return list of group ids that *user* belongs to. If *group* is not in the
294 list, it is included; typically, *group* is specified as the group ID
295 field from the password record for *user*.
296
297 Availability: Unix.
298
299 .. versionadded:: 3.3
300
301
Georg Brandl116aa622007-08-15 14:28:22 +0000302.. function:: getgroups()
303
304 Return list of supplemental group ids associated with the current process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000305
Georg Brandl116aa622007-08-15 14:28:22 +0000306 Availability: Unix.
307
Larry Hastings3732ed22014-03-15 21:13:56 -0700308 .. note::
309
310 On Mac OS X, :func:`getgroups` behavior differs somewhat from
Ned Deily2e209682012-04-30 11:14:02 -0700311 other Unix platforms. If the Python interpreter was built with a
312 deployment target of :const:`10.5` or earlier, :func:`getgroups` returns
313 the list of effective group ids associated with the current user process;
314 this list is limited to a system-defined number of entries, typically 16,
315 and may be modified by calls to :func:`setgroups` if suitably privileged.
316 If built with a deployment target greater than :const:`10.5`,
317 :func:`getgroups` returns the current group access list for the user
318 associated with the effective user id of the process; the group access
319 list may change over the lifetime of the process, it is not affected by
320 calls to :func:`setgroups`, and its length is not limited to 16. The
321 deployment target value, :const:`MACOSX_DEPLOYMENT_TARGET`, can be
322 obtained with :func:`sysconfig.get_config_var`.
323
Georg Brandl116aa622007-08-15 14:28:22 +0000324
325.. function:: getlogin()
326
327 Return the name of the user logged in on the controlling terminal of the
Barry Warsawd4990312018-01-24 12:51:29 -0500328 process. For most purposes, it is more useful to use
329 :func:`getpass.getuser` since the latter checks the environment variables
330 :envvar:`LOGNAME` or :envvar:`USERNAME` to find out who the user is, and
331 falls back to ``pwd.getpwuid(os.getuid())[0]`` to get the login name of the
332 current real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000333
Brian Curtine8e4b3b2010-09-23 20:04:14 +0000334 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000335
336
337.. function:: getpgid(pid)
338
339 Return the process group id of the process with process id *pid*. If *pid* is 0,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000340 the process group id of the current process is returned.
Georg Brandl116aa622007-08-15 14:28:22 +0000341
Benjamin Petersonf650e462010-05-06 23:03:05 +0000342 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000343
344.. function:: getpgrp()
345
346 .. index:: single: process; group
347
Benjamin Petersonf650e462010-05-06 23:03:05 +0000348 Return the id of the current process group.
349
350 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000351
352
353.. function:: getpid()
354
355 .. index:: single: process; id
356
Benjamin Petersonf650e462010-05-06 23:03:05 +0000357 Return the current process id.
358
Georg Brandl116aa622007-08-15 14:28:22 +0000359
360.. function:: getppid()
361
362 .. index:: single: process; id of parent
363
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000364 Return the parent's process id. When the parent process has exited, on Unix
365 the id returned is the one of the init process (1), on Windows it is still
366 the same id, which may be already reused by another process.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000367
Georg Brandl8a5555f2012-06-24 13:29:09 +0200368 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000369
Amaury Forgeot d'Arc4b6fdf32010-09-07 21:31:17 +0000370 .. versionchanged:: 3.2
371 Added support for Windows.
Georg Brandl1b83a452009-11-28 11:12:26 +0000372
Georg Brandl8a5555f2012-06-24 13:29:09 +0200373
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000374.. function:: getpriority(which, who)
375
376 .. index:: single: process; scheduling priority
377
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200378 Get program scheduling priority. The value *which* is one of
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000379 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
380 is interpreted relative to *which* (a process identifier for
381 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200382 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000383 (respectively) the calling process, the process group of the calling process,
384 or the real user ID of the calling process.
385
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200386 Availability: Unix.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000387
388 .. versionadded:: 3.3
389
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200390
391.. data:: PRIO_PROCESS
392 PRIO_PGRP
393 PRIO_USER
394
395 Parameters for the :func:`getpriority` and :func:`setpriority` functions.
396
397 Availability: Unix.
398
399 .. versionadded:: 3.3
400
401
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000402.. function:: getresuid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000403
404 Return a tuple (ruid, euid, suid) denoting the current process's
Benjamin Petersonf650e462010-05-06 23:03:05 +0000405 real, effective, and saved user ids.
406
407 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000408
Georg Brandl1b83a452009-11-28 11:12:26 +0000409 .. versionadded:: 3.2
410
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000411
Gregory P. Smithcf02c6a2009-11-27 17:54:17 +0000412.. function:: getresgid()
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000413
414 Return a tuple (rgid, egid, sgid) denoting the current process's
Georg Brandla9b51d22010-09-05 17:07:12 +0000415 real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000416
417 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000418
Georg Brandl1b83a452009-11-28 11:12:26 +0000419 .. versionadded:: 3.2
420
Georg Brandl116aa622007-08-15 14:28:22 +0000421
422.. function:: getuid()
423
424 .. index:: single: user; id
425
Benjamin Peterson4bb09c82014-06-07 13:50:34 -0700426 Return the current process's real user id.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000427
428 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000429
430
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200431.. function:: initgroups(username, gid)
Georg Brandl116aa622007-08-15 14:28:22 +0000432
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200433 Call the system initgroups() to initialize the group access list with all of
434 the groups of which the specified username is a member, plus the specified
435 group id.
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000436
437 Availability: Unix.
438
Georg Brandl8ccadaa2012-06-24 12:50:06 +0200439 .. versionadded:: 3.2
440
Georg Brandl116aa622007-08-15 14:28:22 +0000441
Georg Brandl18244152009-09-02 20:34:52 +0000442.. function:: putenv(key, value)
Georg Brandl116aa622007-08-15 14:28:22 +0000443
444 .. index:: single: environment variables; setting
445
Georg Brandl18244152009-09-02 20:34:52 +0000446 Set the environment variable named *key* to the string *value*. Such
Georg Brandl116aa622007-08-15 14:28:22 +0000447 changes to the environment affect subprocesses started with :func:`os.system`,
Benjamin Petersonf650e462010-05-06 23:03:05 +0000448 :func:`popen` or :func:`fork` and :func:`execv`.
449
450 Availability: most flavors of Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000451
452 .. note::
453
Georg Brandlc575c902008-09-13 17:46:05 +0000454 On some platforms, including FreeBSD and Mac OS X, setting ``environ`` may
455 cause memory leaks. Refer to the system documentation for putenv.
Georg Brandl116aa622007-08-15 14:28:22 +0000456
457 When :func:`putenv` is supported, assignments to items in ``os.environ`` are
458 automatically translated into corresponding calls to :func:`putenv`; however,
459 calls to :func:`putenv` don't update ``os.environ``, so it is actually
460 preferable to assign to items of ``os.environ``.
461
462
463.. function:: setegid(egid)
464
Benjamin Petersonf650e462010-05-06 23:03:05 +0000465 Set the current process's effective group id.
466
467 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000468
469
470.. function:: seteuid(euid)
471
Benjamin Petersonf650e462010-05-06 23:03:05 +0000472 Set the current process's effective user id.
473
474 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000475
476
477.. function:: setgid(gid)
478
Benjamin Petersonf650e462010-05-06 23:03:05 +0000479 Set the current process' group id.
480
481 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000482
483
484.. function:: setgroups(groups)
485
486 Set the list of supplemental group ids associated with the current process to
487 *groups*. *groups* must be a sequence, and each element must be an integer
Christian Heimesfaf2f632008-01-06 16:59:19 +0000488 identifying a group. This operation is typically available only to the superuser.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000489
Georg Brandl116aa622007-08-15 14:28:22 +0000490 Availability: Unix.
491
Ned Deily2e209682012-04-30 11:14:02 -0700492 .. note:: On Mac OS X, the length of *groups* may not exceed the
493 system-defined maximum number of effective group ids, typically 16.
494 See the documentation for :func:`getgroups` for cases where it may not
495 return the same group list set by calling setgroups().
Georg Brandl116aa622007-08-15 14:28:22 +0000496
497.. function:: setpgrp()
498
Andrew Svetlova2fe3342012-08-11 21:14:08 +0300499 Call the system call :c:func:`setpgrp` or ``setpgrp(0, 0)`` depending on
Georg Brandl116aa622007-08-15 14:28:22 +0000500 which version is implemented (if any). See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000501
Georg Brandl116aa622007-08-15 14:28:22 +0000502 Availability: Unix.
503
504
505.. function:: setpgid(pid, pgrp)
506
Georg Brandl60203b42010-10-06 10:11:56 +0000507 Call the system call :c:func:`setpgid` to set the process group id of the
Georg Brandl116aa622007-08-15 14:28:22 +0000508 process with id *pid* to the process group with id *pgrp*. See the Unix manual
Benjamin Petersonf650e462010-05-06 23:03:05 +0000509 for the semantics.
510
511 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000512
513
Giampaolo Rodolà18e8bcb2011-02-25 20:57:54 +0000514.. function:: setpriority(which, who, priority)
515
516 .. index:: single: process; scheduling priority
517
518 Set program scheduling priority. The value *which* is one of
519 :const:`PRIO_PROCESS`, :const:`PRIO_PGRP`, or :const:`PRIO_USER`, and *who*
520 is interpreted relative to *which* (a process identifier for
521 :const:`PRIO_PROCESS`, process group identifier for :const:`PRIO_PGRP`, and a
522 user ID for :const:`PRIO_USER`). A zero value for *who* denotes
523 (respectively) the calling process, the process group of the calling process,
524 or the real user ID of the calling process.
525 *priority* is a value in the range -20 to 19. The default priority is 0;
526 lower priorities cause more favorable scheduling.
527
528 Availability: Unix
529
530 .. versionadded:: 3.3
531
532
Georg Brandl116aa622007-08-15 14:28:22 +0000533.. function:: setregid(rgid, egid)
534
Benjamin Petersonf650e462010-05-06 23:03:05 +0000535 Set the current process's real and effective group ids.
536
537 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000538
Georg Brandl1b83a452009-11-28 11:12:26 +0000539
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000540.. function:: setresgid(rgid, egid, sgid)
541
542 Set the current process's real, effective, and saved group ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000543
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000544 Availability: Unix.
545
Georg Brandl1b83a452009-11-28 11:12:26 +0000546 .. versionadded:: 3.2
547
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000548
549.. function:: setresuid(ruid, euid, suid)
550
551 Set the current process's real, effective, and saved user ids.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000552
Georg Brandl6faee4e2010-09-21 14:48:28 +0000553 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000554
Georg Brandl1b83a452009-11-28 11:12:26 +0000555 .. versionadded:: 3.2
556
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000557
558.. function:: setreuid(ruid, euid)
559
Benjamin Petersonf650e462010-05-06 23:03:05 +0000560 Set the current process's real and effective user ids.
561
562 Availability: Unix.
Martin v. Löwis7aed61a2009-11-27 14:09:49 +0000563
Georg Brandl116aa622007-08-15 14:28:22 +0000564
565.. function:: getsid(pid)
566
Georg Brandl60203b42010-10-06 10:11:56 +0000567 Call the system call :c:func:`getsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000568
Georg Brandl116aa622007-08-15 14:28:22 +0000569 Availability: Unix.
570
Georg Brandl116aa622007-08-15 14:28:22 +0000571
572.. function:: setsid()
573
Georg Brandl60203b42010-10-06 10:11:56 +0000574 Call the system call :c:func:`setsid`. See the Unix manual for the semantics.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000575
Georg Brandl116aa622007-08-15 14:28:22 +0000576 Availability: Unix.
577
578
579.. function:: setuid(uid)
580
581 .. index:: single: user; id, setting
582
Benjamin Petersonf650e462010-05-06 23:03:05 +0000583 Set the current process's user id.
584
585 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000586
Georg Brandl116aa622007-08-15 14:28:22 +0000587
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000588.. placed in this section since it relates to errno.... a little weak
Georg Brandl116aa622007-08-15 14:28:22 +0000589.. function:: strerror(code)
590
591 Return the error message corresponding to the error code in *code*.
Georg Brandl60203b42010-10-06 10:11:56 +0000592 On platforms where :c:func:`strerror` returns ``NULL`` when given an unknown
Benjamin Petersonf650e462010-05-06 23:03:05 +0000593 error number, :exc:`ValueError` is raised.
594
Georg Brandl116aa622007-08-15 14:28:22 +0000595
Victor Stinnerb745a742010-05-18 17:17:23 +0000596.. data:: supports_bytes_environ
597
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200598 ``True`` if the native OS type of the environment is bytes (eg. ``False`` on
Victor Stinnerb745a742010-05-18 17:17:23 +0000599 Windows).
600
Victor Stinner8fddc9e2010-05-18 17:24:09 +0000601 .. versionadded:: 3.2
602
Victor Stinnerb745a742010-05-18 17:17:23 +0000603
Georg Brandl116aa622007-08-15 14:28:22 +0000604.. function:: umask(mask)
605
Benjamin Petersonf650e462010-05-06 23:03:05 +0000606 Set the current numeric umask and return the previous umask.
607
Georg Brandl116aa622007-08-15 14:28:22 +0000608
609.. function:: uname()
610
611 .. index::
612 single: gethostname() (in module socket)
613 single: gethostbyaddr() (in module socket)
614
Larry Hastings605a62d2012-06-24 04:33:36 -0700615 Returns information identifying the current operating system.
616 The return value is an object with five attributes:
617
618 * :attr:`sysname` - operating system name
619 * :attr:`nodename` - name of machine on network (implementation-defined)
620 * :attr:`release` - operating system release
621 * :attr:`version` - operating system version
622 * :attr:`machine` - hardware identifier
623
624 For backwards compatibility, this object is also iterable, behaving
625 like a five-tuple containing :attr:`sysname`, :attr:`nodename`,
626 :attr:`release`, :attr:`version`, and :attr:`machine`
627 in that order.
628
629 Some systems truncate :attr:`nodename` to 8 characters or to the
Georg Brandl116aa622007-08-15 14:28:22 +0000630 leading component; a better way to get the hostname is
631 :func:`socket.gethostname` or even
Benjamin Petersonf650e462010-05-06 23:03:05 +0000632 ``socket.gethostbyaddr(socket.gethostname())``.
633
634 Availability: recent flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000635
Larry Hastings605a62d2012-06-24 04:33:36 -0700636 .. versionchanged:: 3.3
637 Return type changed from a tuple to a tuple-like object
638 with named attributes.
639
Georg Brandl116aa622007-08-15 14:28:22 +0000640
Georg Brandl18244152009-09-02 20:34:52 +0000641.. function:: unsetenv(key)
Georg Brandl116aa622007-08-15 14:28:22 +0000642
643 .. index:: single: environment variables; deleting
644
Georg Brandl18244152009-09-02 20:34:52 +0000645 Unset (delete) the environment variable named *key*. Such changes to the
Georg Brandl116aa622007-08-15 14:28:22 +0000646 environment affect subprocesses started with :func:`os.system`, :func:`popen` or
Benjamin Petersonf650e462010-05-06 23:03:05 +0000647 :func:`fork` and :func:`execv`.
Georg Brandl116aa622007-08-15 14:28:22 +0000648
649 When :func:`unsetenv` is supported, deletion of items in ``os.environ`` is
650 automatically translated into a corresponding call to :func:`unsetenv`; however,
651 calls to :func:`unsetenv` don't update ``os.environ``, so it is actually
652 preferable to delete items of ``os.environ``.
653
Benjamin Petersonf650e462010-05-06 23:03:05 +0000654 Availability: most flavors of Unix, Windows.
655
Georg Brandl116aa622007-08-15 14:28:22 +0000656
657.. _os-newstreams:
658
659File Object Creation
660--------------------
661
Georg Brandla570e982012-06-24 13:26:22 +0200662This function creates new :term:`file objects <file object>`. (See also
Georg Brandlb2462e22012-06-24 13:24:56 +0200663:func:`~os.open` for opening file descriptors.)
Georg Brandl116aa622007-08-15 14:28:22 +0000664
665
Petri Lehtinen1a01ebc2012-05-24 21:44:07 +0300666.. function:: fdopen(fd, *args, **kwargs)
Georg Brandl116aa622007-08-15 14:28:22 +0000667
Georg Brandlb2462e22012-06-24 13:24:56 +0200668 Return an open file object connected to the file descriptor *fd*. This is an
669 alias of the :func:`open` built-in function and accepts the same arguments.
670 The only difference is that the first argument of :func:`fdopen` must always
671 be an integer.
Georg Brandl116aa622007-08-15 14:28:22 +0000672
Georg Brandl116aa622007-08-15 14:28:22 +0000673
Georg Brandl116aa622007-08-15 14:28:22 +0000674.. _os-fd-ops:
675
676File Descriptor Operations
677--------------------------
678
679These functions operate on I/O streams referenced using file descriptors.
680
681File descriptors are small integers corresponding to a file that has been opened
682by the current process. For example, standard input is usually file descriptor
6830, standard output is 1, and standard error is 2. Further files opened by a
684process will then be assigned 3, 4, 5, and so forth. The name "file descriptor"
685is slightly deceptive; on Unix platforms, sockets and pipes are also referenced
686by file descriptors.
687
Serhiy Storchakadab83542013-10-13 20:12:43 +0300688The :meth:`~io.IOBase.fileno` method can be used to obtain the file descriptor
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000689associated with a :term:`file object` when required. Note that using the file
Benjamin Peterson08bf91c2010-04-11 16:12:57 +0000690descriptor directly will bypass the file object methods, ignoring aspects such
691as internal buffering of data.
Georg Brandl116aa622007-08-15 14:28:22 +0000692
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000693
Georg Brandl116aa622007-08-15 14:28:22 +0000694.. function:: close(fd)
695
Benjamin Petersonf650e462010-05-06 23:03:05 +0000696 Close file descriptor *fd*.
697
Georg Brandl116aa622007-08-15 14:28:22 +0000698 .. note::
699
700 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000701 descriptor as returned by :func:`os.open` or :func:`pipe`. To close a "file
Georg Brandl116aa622007-08-15 14:28:22 +0000702 object" returned by the built-in function :func:`open` or by :func:`popen` or
Serhiy Storchakadab83542013-10-13 20:12:43 +0300703 :func:`fdopen`, use its :meth:`~io.IOBase.close` method.
Georg Brandl116aa622007-08-15 14:28:22 +0000704
705
Christian Heimesfdab48e2008-01-20 09:06:41 +0000706.. function:: closerange(fd_low, fd_high)
707
708 Close all file descriptors from *fd_low* (inclusive) to *fd_high* (exclusive),
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200709 ignoring errors. Equivalent to (but much faster than)::
Christian Heimesfdab48e2008-01-20 09:06:41 +0000710
Georg Brandlc9a5a0e2009-09-01 07:34:27 +0000711 for fd in range(fd_low, fd_high):
Christian Heimesfdab48e2008-01-20 09:06:41 +0000712 try:
713 os.close(fd)
714 except OSError:
715 pass
716
Christian Heimesfdab48e2008-01-20 09:06:41 +0000717
Georg Brandl81f11302007-12-21 08:45:42 +0000718.. function:: device_encoding(fd)
719
720 Return a string describing the encoding of the device associated with *fd*
721 if it is connected to a terminal; else return :const:`None`.
722
723
Georg Brandl116aa622007-08-15 14:28:22 +0000724.. function:: dup(fd)
725
Victor Stinnerdaf45552013-08-28 00:53:59 +0200726 Return a duplicate of file descriptor *fd*. The new file descriptor is
727 :ref:`non-inheritable <fd_inheritance>`.
728
729 On Windows, when duplicating a standard stream (0: stdin, 1: stdout,
730 2: stderr), the new file descriptor is :ref:`inheritable
731 <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000732
Victor Stinnerdaf45552013-08-28 00:53:59 +0200733 .. versionchanged:: 3.4
734 The new file descriptor is now non-inheritable.
Georg Brandl116aa622007-08-15 14:28:22 +0000735
Victor Stinnerdaf45552013-08-28 00:53:59 +0200736
737.. function:: dup2(fd, fd2, inheritable=True)
Georg Brandl116aa622007-08-15 14:28:22 +0000738
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800739 Duplicate file descriptor *fd* to *fd2*, closing the latter first if
740 necessary. Return *fd2*. The new file descriptor is :ref:`inheritable
741 <fd_inheritance>` by default or non-inheritable if *inheritable*
742 is ``False``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000743
Victor Stinnerdaf45552013-08-28 00:53:59 +0200744 .. versionchanged:: 3.4
745 Add the optional *inheritable* parameter.
746
Benjamin Petersonbbdb17d2017-12-29 13:13:06 -0800747 .. versionchanged:: 3.7
748 Return *fd2* on success. Previously, ``None`` was always returned.
749
Georg Brandl116aa622007-08-15 14:28:22 +0000750
Christian Heimes4e30a842007-11-30 22:12:06 +0000751.. function:: fchmod(fd, mode)
752
Georg Brandlb9df00c2012-06-24 12:38:14 +0200753 Change the mode of the file given by *fd* to the numeric *mode*. See the
Georg Brandl4d399a42012-06-25 07:40:32 +0200754 docs for :func:`chmod` for possible values of *mode*. As of Python 3.3, this
Georg Brandlb9df00c2012-06-24 12:38:14 +0200755 is equivalent to ``os.chmod(fd, mode)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000756
757 Availability: Unix.
Christian Heimes4e30a842007-11-30 22:12:06 +0000758
759
760.. function:: fchown(fd, uid, gid)
761
762 Change the owner and group id of the file given by *fd* to the numeric *uid*
Georg Brandlb9df00c2012-06-24 12:38:14 +0200763 and *gid*. To leave one of the ids unchanged, set it to -1. See
Georg Brandl4d399a42012-06-25 07:40:32 +0200764 :func:`chown`. As of Python 3.3, this is equivalent to ``os.chown(fd, uid,
Georg Brandlb9df00c2012-06-24 12:38:14 +0200765 gid)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000766
Christian Heimes4e30a842007-11-30 22:12:06 +0000767 Availability: Unix.
768
769
Georg Brandl116aa622007-08-15 14:28:22 +0000770.. function:: fdatasync(fd)
771
772 Force write of file with filedescriptor *fd* to disk. Does not force update of
Benjamin Petersonf650e462010-05-06 23:03:05 +0000773 metadata.
774
775 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000776
Benjamin Petersonfa0d7032009-06-01 22:42:33 +0000777 .. note::
778 This function is not available on MacOS.
779
Georg Brandl116aa622007-08-15 14:28:22 +0000780
781.. function:: fpathconf(fd, name)
782
783 Return system configuration information relevant to an open file. *name*
784 specifies the configuration value to retrieve; it may be a string which is the
785 name of a defined system value; these names are specified in a number of
786 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
787 additional names as well. The names known to the host operating system are
788 given in the ``pathconf_names`` dictionary. For configuration variables not
789 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +0000790
791 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
792 specific value for *name* is not supported by the host system, even if it is
793 included in ``pathconf_names``, an :exc:`OSError` is raised with
794 :const:`errno.EINVAL` for the error number.
795
Georg Brandl4d399a42012-06-25 07:40:32 +0200796 As of Python 3.3, this is equivalent to ``os.pathconf(fd, name)``.
Georg Brandl306336b2012-06-24 12:55:33 +0200797
Senthil Kumaran2a97cee2013-09-19 00:08:56 -0700798 Availability: Unix.
799
Georg Brandl116aa622007-08-15 14:28:22 +0000800
Victor Stinner4195b5c2012-02-08 23:03:19 +0100801.. function:: fstat(fd)
Georg Brandl116aa622007-08-15 14:28:22 +0000802
Victor Stinner6d4f4fe2014-07-24 12:42:16 +0200803 Get the status of the file descriptor *fd*. Return a :class:`stat_result`
804 object.
805
806 As of Python 3.3, this is equivalent to ``os.stat(fd)``.
807
808 .. seealso::
809
Berker Peksag2034caa2015-04-27 13:53:28 +0300810 The :func:`.stat` function.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000811
Georg Brandlb1a1ac02012-06-24 11:54:07 +0200812
Georg Brandl116aa622007-08-15 14:28:22 +0000813.. function:: fstatvfs(fd)
814
Georg Brandlb9df00c2012-06-24 12:38:14 +0200815 Return information about the filesystem containing the file associated with
Georg Brandl4d399a42012-06-25 07:40:32 +0200816 file descriptor *fd*, like :func:`statvfs`. As of Python 3.3, this is
Georg Brandlb9df00c2012-06-24 12:38:14 +0200817 equivalent to ``os.statvfs(fd)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000818
819 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +0000820
821
822.. function:: fsync(fd)
823
824 Force write of file with filedescriptor *fd* to disk. On Unix, this calls the
Georg Brandl60203b42010-10-06 10:11:56 +0000825 native :c:func:`fsync` function; on Windows, the MS :c:func:`_commit` function.
Georg Brandl116aa622007-08-15 14:28:22 +0000826
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000827 If you're starting with a buffered Python :term:`file object` *f*, first do
828 ``f.flush()``, and then do ``os.fsync(f.fileno())``, to ensure that all internal
829 buffers associated with *f* are written to disk.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000830
Georg Brandl8a5555f2012-06-24 13:29:09 +0200831 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000832
833
834.. function:: ftruncate(fd, length)
835
Georg Brandl306336b2012-06-24 12:55:33 +0200836 Truncate the file corresponding to file descriptor *fd*, so that it is at
Georg Brandl4d399a42012-06-25 07:40:32 +0200837 most *length* bytes in size. As of Python 3.3, this is equivalent to
Georg Brandl306336b2012-06-24 12:55:33 +0200838 ``os.truncate(fd, length)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000839
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700840 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +0000841
Steve Dowerfe0a41a2015-03-20 19:50:46 -0700842 .. versionchanged:: 3.5
843 Added support for Windows
Georg Brandl116aa622007-08-15 14:28:22 +0000844
Victor Stinner1db9e7b2014-07-29 22:32:47 +0200845.. function:: get_blocking(fd)
846
847 Get the blocking mode of the file descriptor: ``False`` if the
848 :data:`O_NONBLOCK` flag is set, ``True`` if the flag is cleared.
849
850 See also :func:`set_blocking` and :meth:`socket.socket.setblocking`.
851
852 Availability: Unix.
853
854 .. versionadded:: 3.5
855
Georg Brandl116aa622007-08-15 14:28:22 +0000856.. function:: isatty(fd)
857
858 Return ``True`` if the file descriptor *fd* is open and connected to a
Benjamin Petersonf650e462010-05-06 23:03:05 +0000859 tty(-like) device, else ``False``.
860
Georg Brandl116aa622007-08-15 14:28:22 +0000861
Ross Lagerwall7807c352011-03-17 20:20:30 +0200862.. function:: lockf(fd, cmd, len)
863
864 Apply, test or remove a POSIX lock on an open file descriptor.
865 *fd* is an open file descriptor.
866 *cmd* specifies the command to use - one of :data:`F_LOCK`, :data:`F_TLOCK`,
867 :data:`F_ULOCK` or :data:`F_TEST`.
868 *len* specifies the section of the file to lock.
869
870 Availability: Unix.
871
872 .. versionadded:: 3.3
873
874
875.. data:: F_LOCK
876 F_TLOCK
877 F_ULOCK
878 F_TEST
879
880 Flags that specify what action :func:`lockf` will take.
881
882 Availability: Unix.
883
884 .. versionadded:: 3.3
885
Georg Brandlf62445a2012-06-24 13:31:20 +0200886
Georg Brandl116aa622007-08-15 14:28:22 +0000887.. function:: lseek(fd, pos, how)
888
Christian Heimesfaf2f632008-01-06 16:59:19 +0000889 Set the current position of file descriptor *fd* to position *pos*, modified
890 by *how*: :const:`SEEK_SET` or ``0`` to set the position relative to the
891 beginning of the file; :const:`SEEK_CUR` or ``1`` to set it relative to the
Serhiy Storchakadab83542013-10-13 20:12:43 +0300892 current position; :const:`SEEK_END` or ``2`` to set it relative to the end of
Victor Stinnere83f8992011-12-17 23:15:09 +0100893 the file. Return the new cursor position in bytes, starting from the beginning.
Benjamin Petersonf650e462010-05-06 23:03:05 +0000894
Georg Brandl116aa622007-08-15 14:28:22 +0000895
Georg Brandl8569e582010-05-19 20:57:08 +0000896.. data:: SEEK_SET
897 SEEK_CUR
898 SEEK_END
899
900 Parameters to the :func:`lseek` function. Their values are 0, 1, and 2,
Georg Brandl8a5555f2012-06-24 13:29:09 +0200901 respectively.
902
Jesus Cea94363612012-06-22 18:32:07 +0200903 .. versionadded:: 3.3
904 Some operating systems could support additional values, like
905 :data:`os.SEEK_HOLE` or :data:`os.SEEK_DATA`.
906
Georg Brandl8569e582010-05-19 20:57:08 +0000907
Martin Panterbf19d162015-09-09 01:01:13 +0000908.. function:: open(path, flags, mode=0o777, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000909
Martin Panterbf19d162015-09-09 01:01:13 +0000910 Open the file *path* and set various flags according to *flags* and possibly
Larry Hastings9cf065c2012-06-22 16:30:09 -0700911 its mode according to *mode*. When computing *mode*, the current umask value
912 is first masked out. Return the file descriptor for the newly opened file.
Victor Stinnerdaf45552013-08-28 00:53:59 +0200913 The new file descriptor is :ref:`non-inheritable <fd_inheritance>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000914
915 For a description of the flag and mode values, see the C run-time documentation;
916 flag constants (like :const:`O_RDONLY` and :const:`O_WRONLY`) are defined in
Andrew Kuchling4921a082013-06-21 11:49:57 -0400917 the :mod:`os` module. In particular, on Windows adding
Georg Brandl8569e582010-05-19 20:57:08 +0000918 :const:`O_BINARY` is needed to open files in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +0000919
Georg Brandl50c40002012-06-24 11:45:20 +0200920 This function can support :ref:`paths relative to directory descriptors
Andrew Kuchling4921a082013-06-21 11:49:57 -0400921 <dir_fd>` with the *dir_fd* parameter.
Larry Hastings9cf065c2012-06-22 16:30:09 -0700922
Victor Stinnerdaf45552013-08-28 00:53:59 +0200923 .. versionchanged:: 3.4
924 The new file descriptor is now non-inheritable.
925
Georg Brandl116aa622007-08-15 14:28:22 +0000926 .. note::
927
Georg Brandl502d9a52009-07-26 15:02:41 +0000928 This function is intended for low-level I/O. For normal usage, use the
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000929 built-in function :func:`open`, which returns a :term:`file object` with
Jeroen Ruigrok van der Werven9c558bcf2010-07-13 14:47:01 +0000930 :meth:`~file.read` and :meth:`~file.write` methods (and many more). To
Antoine Pitrou11cb9612010-09-15 11:11:28 +0000931 wrap a file descriptor in a file object, use :func:`fdopen`.
Georg Brandl116aa622007-08-15 14:28:22 +0000932
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000933 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -0700934 The *dir_fd* argument.
Antoine Pitrouf65132d2011-02-25 23:25:17 +0000935
Victor Stinnera766ddf2015-03-26 23:50:57 +0100936 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +0200937 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +0100938 exception, the function now retries the system call instead of raising an
939 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
940
Brett Cannon6fa7aad2016-09-06 15:55:02 -0700941 .. versionchanged:: 3.6
942 Accepts a :term:`path-like object`.
943
Andrew Kuchling4921a082013-06-21 11:49:57 -0400944The following constants are options for the *flags* parameter to the
945:func:`~os.open` function. They can be combined using the bitwise OR operator
946``|``. Some of them are not available on all platforms. For descriptions of
947their availability and use, consult the :manpage:`open(2)` manual page on Unix
Georg Brandl5d941342016-02-26 19:37:12 +0100948or `the MSDN <https://msdn.microsoft.com/en-us/library/z0kc8e3z.aspx>`_ on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400949
950
951.. data:: O_RDONLY
952 O_WRONLY
953 O_RDWR
954 O_APPEND
955 O_CREAT
956 O_EXCL
957 O_TRUNC
958
Vinay Sajipe4946e72016-09-11 15:15:59 +0100959 The above constants are available on Unix and Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400960
961
962.. data:: O_DSYNC
963 O_RSYNC
964 O_SYNC
965 O_NDELAY
966 O_NONBLOCK
967 O_NOCTTY
Andrew Kuchling4921a082013-06-21 11:49:57 -0400968 O_CLOEXEC
969
Vinay Sajipe4946e72016-09-11 15:15:59 +0100970 The above constants are only available on Unix.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400971
972 .. versionchanged:: 3.3
973 Add :data:`O_CLOEXEC` constant.
974
975.. data:: O_BINARY
976 O_NOINHERIT
977 O_SHORT_LIVED
978 O_TEMPORARY
979 O_RANDOM
980 O_SEQUENTIAL
981 O_TEXT
982
Vinay Sajipe4946e72016-09-11 15:15:59 +0100983 The above constants are only available on Windows.
Andrew Kuchling4921a082013-06-21 11:49:57 -0400984
985
986.. data:: O_ASYNC
987 O_DIRECT
988 O_DIRECTORY
989 O_NOFOLLOW
990 O_NOATIME
991 O_PATH
Christian Heimes177b3f92013-08-16 14:35:09 +0200992 O_TMPFILE
Vinay Sajipe4946e72016-09-11 15:15:59 +0100993 O_SHLOCK
994 O_EXLOCK
Andrew Kuchling4921a082013-06-21 11:49:57 -0400995
Vinay Sajipe4946e72016-09-11 15:15:59 +0100996 The above constants are extensions and not present if they are not defined by
Andrew Kuchling4921a082013-06-21 11:49:57 -0400997 the C library.
998
Christian Heimesd88f7352013-08-16 14:37:50 +0200999 .. versionchanged:: 3.4
Larry Hastings3732ed22014-03-15 21:13:56 -07001000 Add :data:`O_PATH` on systems that support it.
1001 Add :data:`O_TMPFILE`, only available on Linux Kernel 3.11
1002 or newer.
Christian Heimesd88f7352013-08-16 14:37:50 +02001003
Antoine Pitrouf65132d2011-02-25 23:25:17 +00001004
Georg Brandl116aa622007-08-15 14:28:22 +00001005.. function:: openpty()
1006
1007 .. index:: module: pty
1008
Victor Stinnerdaf45552013-08-28 00:53:59 +02001009 Open a new pseudo-terminal pair. Return a pair of file descriptors
1010 ``(master, slave)`` for the pty and the tty, respectively. The new file
1011 descriptors are :ref:`non-inheritable <fd_inheritance>`. For a (slightly) more
1012 portable approach, use the :mod:`pty` module.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001013
1014 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001015
Victor Stinnerdaf45552013-08-28 00:53:59 +02001016 .. versionchanged:: 3.4
1017 The new file descriptors are now non-inheritable.
1018
Georg Brandl116aa622007-08-15 14:28:22 +00001019
1020.. function:: pipe()
1021
Victor Stinnerdaf45552013-08-28 00:53:59 +02001022 Create a pipe. Return a pair of file descriptors ``(r, w)`` usable for
Victor Stinner05f31bf2013-11-06 01:48:45 +01001023 reading and writing, respectively. The new file descriptor is
Victor Stinnerdaf45552013-08-28 00:53:59 +02001024 :ref:`non-inheritable <fd_inheritance>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001025
1026 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00001027
Victor Stinnerdaf45552013-08-28 00:53:59 +02001028 .. versionchanged:: 3.4
1029 The new file descriptors are now non-inheritable.
1030
Georg Brandl116aa622007-08-15 14:28:22 +00001031
Charles-François Natali368f34b2011-06-06 19:49:47 +02001032.. function:: pipe2(flags)
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001033
1034 Create a pipe with *flags* set atomically.
Charles-François Natali368f34b2011-06-06 19:49:47 +02001035 *flags* can be constructed by ORing together one or more of these values:
1036 :data:`O_NONBLOCK`, :data:`O_CLOEXEC`.
Charles-François Natalidaafdd52011-05-29 20:07:40 +02001037 Return a pair of file descriptors ``(r, w)`` usable for reading and writing,
1038 respectively.
1039
1040 Availability: some flavors of Unix.
1041
1042 .. versionadded:: 3.3
1043
1044
Ross Lagerwall7807c352011-03-17 20:20:30 +02001045.. function:: posix_fallocate(fd, offset, len)
1046
1047 Ensures that enough disk space is allocated for the file specified by *fd*
1048 starting from *offset* and continuing for *len* bytes.
1049
1050 Availability: Unix.
1051
1052 .. versionadded:: 3.3
1053
1054
1055.. function:: posix_fadvise(fd, offset, len, advice)
1056
1057 Announces an intention to access data in a specific pattern thus allowing
1058 the kernel to make optimizations.
1059 The advice applies to the region of the file specified by *fd* starting at
1060 *offset* and continuing for *len* bytes.
1061 *advice* is one of :data:`POSIX_FADV_NORMAL`, :data:`POSIX_FADV_SEQUENTIAL`,
1062 :data:`POSIX_FADV_RANDOM`, :data:`POSIX_FADV_NOREUSE`,
1063 :data:`POSIX_FADV_WILLNEED` or :data:`POSIX_FADV_DONTNEED`.
1064
1065 Availability: Unix.
1066
1067 .. versionadded:: 3.3
1068
1069
1070.. data:: POSIX_FADV_NORMAL
1071 POSIX_FADV_SEQUENTIAL
1072 POSIX_FADV_RANDOM
1073 POSIX_FADV_NOREUSE
1074 POSIX_FADV_WILLNEED
1075 POSIX_FADV_DONTNEED
1076
1077 Flags that can be used in *advice* in :func:`posix_fadvise` that specify
1078 the access pattern that is likely to be used.
1079
1080 Availability: Unix.
1081
1082 .. versionadded:: 3.3
1083
1084
1085.. function:: pread(fd, buffersize, offset)
1086
1087 Read from a file descriptor, *fd*, at a position of *offset*. It will read up
1088 to *buffersize* number of bytes. The file offset remains unchanged.
1089
1090 Availability: Unix.
1091
1092 .. versionadded:: 3.3
1093
1094
Jesus Cea67503c52014-10-20 16:18:24 +02001095.. function:: pwrite(fd, str, offset)
Ross Lagerwall7807c352011-03-17 20:20:30 +02001096
Jesus Cea67503c52014-10-20 16:18:24 +02001097 Write *bytestring* to a file descriptor, *fd*, from *offset*,
1098 leaving the file offset unchanged.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001099
1100 Availability: Unix.
1101
1102 .. versionadded:: 3.3
1103
1104
Pablo Galindo4defba32018-01-27 16:16:37 +00001105.. function:: pwritev(fd, buffers, offset, flags=0)
1106
1107 Combines the functionality of :func:`os.writev` and :func:`os.pwrite`. It
1108 writes the contents of *buffers* to file descriptor *fd* at offset *offset*.
1109 *buffers* must be a sequence of :term:`bytes-like objects <bytes-like object>`.
1110 Buffers are processed in array order. Entire contents of first buffer is written
1111 before proceeding to second, and so on. The operating system may set a limit
1112 (sysconf() value SC_IOV_MAX) on the number of buffers that can be used.
1113 :func:`~os.pwritev` writes the contents of each object to the file descriptor
1114 and returns the total number of bytes written.
1115
1116 The *flags* argument contains a bitwise OR of zero or more of the following
1117 flags:
1118
1119 - RWF_DSYNC
1120 - RWF_SYNC
1121
1122 Using non-zero flags requires Linux 4.7 or newer.
1123
1124 Availability: Linux (version 2.6.30), FreeBSD 6.0 and newer,
1125 OpenBSD (version 2.7 and newer).
1126
1127 .. versionadded:: 3.7
1128
1129.. data:: RWF_DSYNC (since Linux 4.7)
1130 Provide a per-write equivalent of the O_DSYNC open(2) flag. This flag
1131 is meaningful only for pwritev2(), and its effect applies only to the
1132 data range written by the system call.
1133
1134 .. versionadded:: 3.7
1135
1136.. data:: RWF_SYNC (since Linux 4.7)
1137 Provide a per-write equivalent of the O_SYNC open(2) flag. This flag is
1138 meaningful only for pwritev2(), and its effect applies only to the data
1139 range written by the system call.
1140
1141 .. versionadded:: 3.7
1142
1143
Georg Brandl116aa622007-08-15 14:28:22 +00001144.. function:: read(fd, n)
1145
Georg Brandlb90be692009-07-29 16:14:16 +00001146 Read at most *n* bytes from file descriptor *fd*. Return a bytestring containing the
Georg Brandl116aa622007-08-15 14:28:22 +00001147 bytes read. If the end of the file referred to by *fd* has been reached, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001148 empty bytes object is returned.
1149
Georg Brandl116aa622007-08-15 14:28:22 +00001150 .. note::
1151
1152 This function is intended for low-level I/O and must be applied to a file
Georg Brandlb2462e22012-06-24 13:24:56 +02001153 descriptor as returned by :func:`os.open` or :func:`pipe`. To read a
1154 "file object" returned by the built-in function :func:`open` or by
1155 :func:`popen` or :func:`fdopen`, or :data:`sys.stdin`, use its
1156 :meth:`~file.read` or :meth:`~file.readline` methods.
Georg Brandl116aa622007-08-15 14:28:22 +00001157
Victor Stinnera766ddf2015-03-26 23:50:57 +01001158 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001159 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001160 exception, the function now retries the system call instead of raising an
1161 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1162
Georg Brandl116aa622007-08-15 14:28:22 +00001163
Martin Panterbf19d162015-09-09 01:01:13 +00001164.. function:: sendfile(out, in, offset, count)
Martin Panter94994132015-09-09 05:29:24 +00001165 sendfile(out, in, offset, count, [headers], [trailers], flags=0)
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001166
Martin Panterbf19d162015-09-09 01:01:13 +00001167 Copy *count* bytes from file descriptor *in* to file descriptor *out*
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001168 starting at *offset*.
1169 Return the number of bytes sent. When EOF is reached return 0.
1170
1171 The first function notation is supported by all platforms that define
1172 :func:`sendfile`.
1173
1174 On Linux, if *offset* is given as ``None``, the bytes are read from the
1175 current position of *in* and the position of *in* is updated.
1176
1177 The second case may be used on Mac OS X and FreeBSD where *headers* and
1178 *trailers* are arbitrary sequences of buffers that are written before and
1179 after the data from *in* is written. It returns the same as the first case.
1180
Martin Panterbf19d162015-09-09 01:01:13 +00001181 On Mac OS X and FreeBSD, a value of 0 for *count* specifies to send until
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001182 the end of *in* is reached.
1183
Charles-Francois Natalia771a1b2013-05-01 15:12:20 +02001184 All platforms support sockets as *out* file descriptor, and some platforms
1185 allow other types (e.g. regular file, pipe) as well.
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001186
Giampaolo Rodola'409569b2014-04-24 18:09:21 +02001187 Cross-platform applications should not use *headers*, *trailers* and *flags*
1188 arguments.
1189
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001190 Availability: Unix.
1191
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001192 .. note::
1193
Benjamin Peterson0ce95372014-06-15 18:30:27 -07001194 For a higher-level wrapper of :func:`sendfile`, see
Martin Panter3133a9f2015-09-11 23:44:18 +00001195 :meth:`socket.socket.sendfile`.
Giampaolo Rodola'915d1412014-06-11 03:54:30 +02001196
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001197 .. versionadded:: 3.3
1198
1199
Victor Stinner1db9e7b2014-07-29 22:32:47 +02001200.. function:: set_blocking(fd, blocking)
1201
1202 Set the blocking mode of the specified file descriptor. Set the
1203 :data:`O_NONBLOCK` flag if blocking is ``False``, clear the flag otherwise.
1204
1205 See also :func:`get_blocking` and :meth:`socket.socket.setblocking`.
1206
1207 Availability: Unix.
1208
1209 .. versionadded:: 3.5
1210
1211
Giampaolo Rodolàc9c2c8b2011-02-25 14:39:16 +00001212.. data:: SF_NODISKIO
1213 SF_MNOWAIT
1214 SF_SYNC
1215
1216 Parameters to the :func:`sendfile` function, if the implementation supports
1217 them.
1218
1219 Availability: Unix.
1220
1221 .. versionadded:: 3.3
1222
1223
Ross Lagerwall7807c352011-03-17 20:20:30 +02001224.. function:: readv(fd, buffers)
1225
Benjamin Petersone83ed432014-01-18 22:54:59 -05001226 Read from a file descriptor *fd* into a number of mutable :term:`bytes-like
1227 objects <bytes-like object>` *buffers*. :func:`~os.readv` will transfer data
1228 into each buffer until it is full and then move on to the next buffer in the
1229 sequence to hold the rest of the data. :func:`~os.readv` returns the total
1230 number of bytes read (which may be less than the total capacity of all the
1231 objects).
Ross Lagerwall7807c352011-03-17 20:20:30 +02001232
1233 Availability: Unix.
1234
1235 .. versionadded:: 3.3
1236
1237
Pablo Galindo4defba32018-01-27 16:16:37 +00001238.. function:: preadv(fd, buffers, offset, flags=0)
1239
1240 Combines the functionality of :func:`os.readv` and :func:`os.pread`. It
1241 reads from a file descriptor *fd* into a number of mutable :term:`bytes-like
1242 objects <bytes-like object>` *buffers*. As :func:`os.readv`, it will transfer
1243 data into each buffer until it is full and then move on to the next buffer in
1244 the sequence to hold the rest of the data. Its fourth argument, *offset*,
1245 specifies the file offset at which the input operation is to be performed.
1246 :func:`~os.preadv` return the total number of bytes read (which can be less than
1247 the total capacity of all the objects).
1248
1249 The flags argument contains a bitwise OR of zero or more of the following
1250 flags:
1251
1252 - RWF_HIPRI
1253 - RWF_NOWAIT
1254
1255 Using non-zero flags requires Linux 4.6 or newer.
1256
1257 Availability: Linux (version 2.6.30), FreeBSD 6.0 and newer,
1258 OpenBSD (version 2.7 and newer).
1259
1260 .. versionadded:: 3.7
1261
1262
1263.. data:: RWF_HIPRI (since Linux 4.6)
1264 High priority read/write. Allows block-based filesystems to use polling
1265 of the device, which provides lower latency, but may use additional
1266 resources. (Currently, this feature is usable only on a file descriptor
1267 opened using the O_DIRECT flag.)
1268
1269 .. versionadded:: 3.7
1270
1271
1272.. data:: RWF_NOWAIT (since Linux 4.14)
1273 Do not wait for data which is not immediately available. If this flag
1274 is specified, the preadv2() system call will return instantly
1275 if it would have to read data from the backing storage or wait for a lock.
1276 If some data was successfully read, it will return the number of bytes
1277 read. If no bytes were read, it will return -1 and set errno to EAGAIN.
1278 Currently, this flag is meaningful only for preadv2().
1279
1280 .. versionadded:: 3.7
1281
1282
Georg Brandl116aa622007-08-15 14:28:22 +00001283.. function:: tcgetpgrp(fd)
1284
1285 Return the process group associated with the terminal given by *fd* (an open
Benjamin Petersonf650e462010-05-06 23:03:05 +00001286 file descriptor as returned by :func:`os.open`).
1287
1288 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001289
1290
1291.. function:: tcsetpgrp(fd, pg)
1292
1293 Set the process group associated with the terminal given by *fd* (an open file
Benjamin Petersonf650e462010-05-06 23:03:05 +00001294 descriptor as returned by :func:`os.open`) to *pg*.
1295
1296 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001297
1298
1299.. function:: ttyname(fd)
1300
1301 Return a string which specifies the terminal device associated with
Georg Brandl9afde1c2007-11-01 20:32:30 +00001302 file descriptor *fd*. If *fd* is not associated with a terminal device, an
Benjamin Petersonf650e462010-05-06 23:03:05 +00001303 exception is raised.
1304
1305 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001306
1307
1308.. function:: write(fd, str)
1309
Georg Brandlb90be692009-07-29 16:14:16 +00001310 Write the bytestring in *str* to file descriptor *fd*. Return the number of
Benjamin Petersonf650e462010-05-06 23:03:05 +00001311 bytes actually written.
1312
Georg Brandl116aa622007-08-15 14:28:22 +00001313 .. note::
1314
1315 This function is intended for low-level I/O and must be applied to a file
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001316 descriptor as returned by :func:`os.open` or :func:`pipe`. To write a "file
Georg Brandl116aa622007-08-15 14:28:22 +00001317 object" returned by the built-in function :func:`open` or by :func:`popen` or
Benjamin Petersonfa0d7032009-06-01 22:42:33 +00001318 :func:`fdopen`, or :data:`sys.stdout` or :data:`sys.stderr`, use its
1319 :meth:`~file.write` method.
Georg Brandl116aa622007-08-15 14:28:22 +00001320
Victor Stinnera766ddf2015-03-26 23:50:57 +01001321 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02001322 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01001323 exception, the function now retries the system call instead of raising an
1324 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
1325
Georg Brandl8569e582010-05-19 20:57:08 +00001326
Ross Lagerwall7807c352011-03-17 20:20:30 +02001327.. function:: writev(fd, buffers)
1328
Benjamin Petersone83ed432014-01-18 22:54:59 -05001329 Write the contents of *buffers* to file descriptor *fd*. *buffers* must be a
Senthil Kumarand37de3c2016-06-18 11:21:50 -07001330 sequence of :term:`bytes-like objects <bytes-like object>`. Buffers are
1331 processed in array order. Entire contents of first buffer is written before
1332 proceeding to second, and so on. The operating system may set a limit
1333 (sysconf() value SC_IOV_MAX) on the number of buffers that can be used.
1334
Benjamin Petersone83ed432014-01-18 22:54:59 -05001335 :func:`~os.writev` writes the contents of each object to the file descriptor
1336 and returns the total number of bytes written.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001337
1338 Availability: Unix.
1339
1340 .. versionadded:: 3.3
1341
1342
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001343.. _terminal-size:
1344
1345Querying the size of a terminal
1346~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1347
1348.. versionadded:: 3.3
1349
1350.. function:: get_terminal_size(fd=STDOUT_FILENO)
1351
1352 Return the size of the terminal window as ``(columns, lines)``,
1353 tuple of type :class:`terminal_size`.
1354
1355 The optional argument ``fd`` (default ``STDOUT_FILENO``, or standard
1356 output) specifies which file descriptor should be queried.
1357
1358 If the file descriptor is not connected to a terminal, an :exc:`OSError`
Andrew Svetlov5b898402012-12-18 21:26:36 +02001359 is raised.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001360
1361 :func:`shutil.get_terminal_size` is the high-level function which
1362 should normally be used, ``os.get_terminal_size`` is the low-level
1363 implementation.
1364
1365 Availability: Unix, Windows.
1366
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001367.. class:: terminal_size
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001368
Georg Brandl6cff9ff2012-06-24 14:05:40 +02001369 A subclass of tuple, holding ``(columns, lines)`` of the terminal window size.
Antoine Pitroubcf2b592012-02-08 23:28:36 +01001370
1371 .. attribute:: columns
1372
1373 Width of the terminal window in characters.
1374
1375 .. attribute:: lines
1376
1377 Height of the terminal window in characters.
1378
1379
Victor Stinnerdaf45552013-08-28 00:53:59 +02001380.. _fd_inheritance:
1381
1382Inheritance of File Descriptors
1383~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1384
Georg Brandl5642ff92013-09-15 10:37:57 +02001385.. versionadded:: 3.4
1386
1387A file descriptor has an "inheritable" flag which indicates if the file descriptor
1388can be inherited by child processes. Since Python 3.4, file descriptors
Victor Stinnerdaf45552013-08-28 00:53:59 +02001389created by Python are non-inheritable by default.
1390
1391On UNIX, non-inheritable file descriptors are closed in child processes at the
1392execution of a new program, other file descriptors are inherited.
1393
1394On Windows, non-inheritable handles and file descriptors are closed in child
Georg Brandl5642ff92013-09-15 10:37:57 +02001395processes, except for standard streams (file descriptors 0, 1 and 2: stdin, stdout
Serhiy Storchaka690a6a92013-10-13 20:13:37 +03001396and stderr), which are always inherited. Using :func:`spawn\* <spawnl>` functions,
Victor Stinnerdaf45552013-08-28 00:53:59 +02001397all inheritable handles and all inheritable file descriptors are inherited.
1398Using the :mod:`subprocess` module, all file descriptors except standard
Georg Brandl5642ff92013-09-15 10:37:57 +02001399streams are closed, and inheritable handles are only inherited if the
1400*close_fds* parameter is ``False``.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001401
1402.. function:: get_inheritable(fd)
1403
Georg Brandl5642ff92013-09-15 10:37:57 +02001404 Get the "inheritable" flag of the specified file descriptor (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001405
1406.. function:: set_inheritable(fd, inheritable)
1407
Georg Brandl5642ff92013-09-15 10:37:57 +02001408 Set the "inheritable" flag of the specified file descriptor.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001409
1410.. function:: get_handle_inheritable(handle)
1411
Georg Brandl5642ff92013-09-15 10:37:57 +02001412 Get the "inheritable" flag of the specified handle (a boolean).
Victor Stinnerdaf45552013-08-28 00:53:59 +02001413
1414 Availability: Windows.
1415
1416.. function:: set_handle_inheritable(handle, inheritable)
1417
Georg Brandl5642ff92013-09-15 10:37:57 +02001418 Set the "inheritable" flag of the specified handle.
Victor Stinnerdaf45552013-08-28 00:53:59 +02001419
1420 Availability: Windows.
1421
1422
Georg Brandl116aa622007-08-15 14:28:22 +00001423.. _os-file-dir:
1424
1425Files and Directories
1426---------------------
1427
Georg Brandl50c40002012-06-24 11:45:20 +02001428On some Unix platforms, many of these functions support one or more of these
1429features:
1430
1431.. _path_fd:
1432
Larry Hastings77892dc2012-06-25 03:27:33 -07001433* **specifying a file descriptor:**
1434 For some functions, the *path* argument can be not only a string giving a path
Georg Brandl50c40002012-06-24 11:45:20 +02001435 name, but also a file descriptor. The function will then operate on the file
Georg Brandlaceaf902012-06-25 08:33:56 +02001436 referred to by the descriptor. (For POSIX systems, Python will call the
1437 ``f...`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001438
1439 You can check whether or not *path* can be specified as a file descriptor on
1440 your platform using :data:`os.supports_fd`. If it is unavailable, using it
1441 will raise a :exc:`NotImplementedError`.
1442
1443 If the function also supports *dir_fd* or *follow_symlinks* arguments, it is
1444 an error to specify one of those when supplying *path* as a file descriptor.
1445
1446.. _dir_fd:
1447
Larry Hastings77892dc2012-06-25 03:27:33 -07001448* **paths relative to directory descriptors:** If *dir_fd* is not ``None``, it
Georg Brandl50c40002012-06-24 11:45:20 +02001449 should be a file descriptor referring to a directory, and the path to operate
1450 on should be relative; path will then be relative to that directory. If the
Georg Brandlaceaf902012-06-25 08:33:56 +02001451 path is absolute, *dir_fd* is ignored. (For POSIX systems, Python will call
Larry Hastings77892dc2012-06-25 03:27:33 -07001452 the ``...at`` or ``f...at`` version of the function.)
Georg Brandl50c40002012-06-24 11:45:20 +02001453
1454 You can check whether or not *dir_fd* is supported on your platform using
1455 :data:`os.supports_dir_fd`. If it is unavailable, using it will raise a
1456 :exc:`NotImplementedError`.
1457
1458.. _follow_symlinks:
1459
Larry Hastings77892dc2012-06-25 03:27:33 -07001460* **not following symlinks:** If *follow_symlinks* is
Georg Brandl50c40002012-06-24 11:45:20 +02001461 ``False``, and the last element of the path to operate on is a symbolic link,
1462 the function will operate on the symbolic link itself instead of the file the
Georg Brandlaceaf902012-06-25 08:33:56 +02001463 link points to. (For POSIX systems, Python will call the ``l...`` version of
Georg Brandl50c40002012-06-24 11:45:20 +02001464 the function.)
1465
1466 You can check whether or not *follow_symlinks* is supported on your platform
1467 using :data:`os.supports_follow_symlinks`. If it is unavailable, using it
1468 will raise a :exc:`NotImplementedError`.
1469
1470
1471
Larry Hastings9cf065c2012-06-22 16:30:09 -07001472.. function:: access(path, mode, *, dir_fd=None, effective_ids=False, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001473
1474 Use the real uid/gid to test for access to *path*. Note that most operations
1475 will use the effective uid/gid, therefore this routine can be used in a
1476 suid/sgid environment to test if the invoking user has the specified access to
1477 *path*. *mode* should be :const:`F_OK` to test the existence of *path*, or it
1478 can be the inclusive OR of one or more of :const:`R_OK`, :const:`W_OK`, and
1479 :const:`X_OK` to test permissions. Return :const:`True` if access is allowed,
1480 :const:`False` if not. See the Unix man page :manpage:`access(2)` for more
Benjamin Petersonf650e462010-05-06 23:03:05 +00001481 information.
1482
Georg Brandl50c40002012-06-24 11:45:20 +02001483 This function can support specifying :ref:`paths relative to directory
1484 descriptors <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001485
1486 If *effective_ids* is ``True``, :func:`access` will perform its access
1487 checks using the effective uid/gid instead of the real uid/gid.
1488 *effective_ids* may not be supported on your platform; you can check whether
1489 or not it is available using :data:`os.supports_effective_ids`. If it is
1490 unavailable, using it will raise a :exc:`NotImplementedError`.
1491
Georg Brandl116aa622007-08-15 14:28:22 +00001492 .. note::
1493
Georg Brandl502d9a52009-07-26 15:02:41 +00001494 Using :func:`access` to check if a user is authorized to e.g. open a file
1495 before actually doing so using :func:`open` creates a security hole,
1496 because the user might exploit the short time interval between checking
Benjamin Peterson249b5082011-05-20 11:41:13 -05001497 and opening the file to manipulate it. It's preferable to use :term:`EAFP`
1498 techniques. For example::
1499
1500 if os.access("myfile", os.R_OK):
1501 with open("myfile") as fp:
1502 return fp.read()
1503 return "some default data"
1504
1505 is better written as::
1506
1507 try:
1508 fp = open("myfile")
Antoine Pitrou62ab10a02011-10-12 20:10:51 +02001509 except PermissionError:
1510 return "some default data"
Benjamin Peterson249b5082011-05-20 11:41:13 -05001511 else:
1512 with fp:
1513 return fp.read()
Georg Brandl116aa622007-08-15 14:28:22 +00001514
1515 .. note::
1516
1517 I/O operations may fail even when :func:`access` indicates that they would
1518 succeed, particularly for operations on network filesystems which may have
1519 permissions semantics beyond the usual POSIX permission-bit model.
1520
Larry Hastings9cf065c2012-06-22 16:30:09 -07001521 .. versionchanged:: 3.3
1522 Added the *dir_fd*, *effective_ids*, and *follow_symlinks* parameters.
1523
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001524 .. versionchanged:: 3.6
1525 Accepts a :term:`path-like object`.
1526
Georg Brandl116aa622007-08-15 14:28:22 +00001527
1528.. data:: F_OK
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001529 R_OK
1530 W_OK
1531 X_OK
Georg Brandl116aa622007-08-15 14:28:22 +00001532
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001533 Values to pass as the *mode* parameter of :func:`access` to test the
1534 existence, readability, writability and executability of *path*,
1535 respectively.
Georg Brandl116aa622007-08-15 14:28:22 +00001536
1537
1538.. function:: chdir(path)
1539
1540 .. index:: single: directory; changing
1541
Benjamin Petersonf650e462010-05-06 23:03:05 +00001542 Change the current working directory to *path*.
1543
Larry Hastings77892dc2012-06-25 03:27:33 -07001544 This function can support :ref:`specifying a file descriptor <path_fd>`. The
Georg Brandl50c40002012-06-24 11:45:20 +02001545 descriptor must refer to an opened directory, not an open file.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001546
Larry Hastings9cf065c2012-06-22 16:30:09 -07001547 .. versionadded:: 3.3
1548 Added support for specifying *path* as a file descriptor
Georg Brandl50c40002012-06-24 11:45:20 +02001549 on some platforms.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001550
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001551 .. versionchanged:: 3.6
1552 Accepts a :term:`path-like object`.
1553
Georg Brandl116aa622007-08-15 14:28:22 +00001554
Larry Hastings9cf065c2012-06-22 16:30:09 -07001555.. function:: chflags(path, flags, *, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001556
1557 Set the flags of *path* to the numeric *flags*. *flags* may take a combination
1558 (bitwise OR) of the following values (as defined in the :mod:`stat` module):
1559
R David Murray30178062011-03-10 17:18:33 -05001560 * :data:`stat.UF_NODUMP`
1561 * :data:`stat.UF_IMMUTABLE`
1562 * :data:`stat.UF_APPEND`
1563 * :data:`stat.UF_OPAQUE`
1564 * :data:`stat.UF_NOUNLINK`
Ned Deily3eb67d52011-06-28 00:00:28 -07001565 * :data:`stat.UF_COMPRESSED`
1566 * :data:`stat.UF_HIDDEN`
R David Murray30178062011-03-10 17:18:33 -05001567 * :data:`stat.SF_ARCHIVED`
1568 * :data:`stat.SF_IMMUTABLE`
1569 * :data:`stat.SF_APPEND`
1570 * :data:`stat.SF_NOUNLINK`
1571 * :data:`stat.SF_SNAPSHOT`
Georg Brandl116aa622007-08-15 14:28:22 +00001572
Georg Brandl50c40002012-06-24 11:45:20 +02001573 This function can support :ref:`not following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001574
Georg Brandlc575c902008-09-13 17:46:05 +00001575 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001576
Larry Hastings9cf065c2012-06-22 16:30:09 -07001577 .. versionadded:: 3.3
1578 The *follow_symlinks* argument.
1579
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001580 .. versionchanged:: 3.6
1581 Accepts a :term:`path-like object`.
1582
Georg Brandl116aa622007-08-15 14:28:22 +00001583
Larry Hastings9cf065c2012-06-22 16:30:09 -07001584.. function:: chmod(path, mode, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001585
1586 Change the mode of *path* to the numeric *mode*. *mode* may take one of the
Christian Heimesfaf2f632008-01-06 16:59:19 +00001587 following values (as defined in the :mod:`stat` module) or bitwise ORed
Georg Brandl116aa622007-08-15 14:28:22 +00001588 combinations of them:
1589
Alexandre Vassalottic22c6f22009-07-21 00:51:58 +00001590 * :data:`stat.S_ISUID`
1591 * :data:`stat.S_ISGID`
1592 * :data:`stat.S_ENFMT`
1593 * :data:`stat.S_ISVTX`
1594 * :data:`stat.S_IREAD`
1595 * :data:`stat.S_IWRITE`
1596 * :data:`stat.S_IEXEC`
1597 * :data:`stat.S_IRWXU`
1598 * :data:`stat.S_IRUSR`
1599 * :data:`stat.S_IWUSR`
1600 * :data:`stat.S_IXUSR`
1601 * :data:`stat.S_IRWXG`
1602 * :data:`stat.S_IRGRP`
1603 * :data:`stat.S_IWGRP`
1604 * :data:`stat.S_IXGRP`
1605 * :data:`stat.S_IRWXO`
1606 * :data:`stat.S_IROTH`
1607 * :data:`stat.S_IWOTH`
1608 * :data:`stat.S_IXOTH`
Georg Brandl116aa622007-08-15 14:28:22 +00001609
Georg Brandl50c40002012-06-24 11:45:20 +02001610 This function can support :ref:`specifying a file descriptor <path_fd>`,
1611 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1612 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001613
Georg Brandl116aa622007-08-15 14:28:22 +00001614 .. note::
1615
Georg Brandl50c40002012-06-24 11:45:20 +02001616 Although Windows supports :func:`chmod`, you can only set the file's
1617 read-only flag with it (via the ``stat.S_IWRITE`` and ``stat.S_IREAD``
1618 constants or a corresponding integer value). All other bits are ignored.
Georg Brandl116aa622007-08-15 14:28:22 +00001619
Larry Hastings9cf065c2012-06-22 16:30:09 -07001620 .. versionadded:: 3.3
1621 Added support for specifying *path* as an open file descriptor,
1622 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001623
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001624 .. versionchanged:: 3.6
1625 Accepts a :term:`path-like object`.
1626
Larry Hastings9cf065c2012-06-22 16:30:09 -07001627
1628.. function:: chown(path, uid, gid, *, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00001629
Georg Brandl50c40002012-06-24 11:45:20 +02001630 Change the owner and group id of *path* to the numeric *uid* and *gid*. To
1631 leave one of the ids unchanged, set it to -1.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001632
Georg Brandl50c40002012-06-24 11:45:20 +02001633 This function can support :ref:`specifying a file descriptor <path_fd>`,
1634 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
1635 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001636
Sandro Tosid902a142011-08-22 23:28:27 +02001637 See :func:`shutil.chown` for a higher-level function that accepts names in
1638 addition to numeric ids.
1639
Benjamin Petersonf650e462010-05-06 23:03:05 +00001640 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001641
Larry Hastings9cf065c2012-06-22 16:30:09 -07001642 .. versionadded:: 3.3
1643 Added support for specifying an open file descriptor for *path*,
1644 and the *dir_fd* and *follow_symlinks* arguments.
Georg Brandl116aa622007-08-15 14:28:22 +00001645
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001646 .. versionchanged:: 3.6
1647 Supports a :term:`path-like object`.
1648
Benjamin Peterson799bd802011-08-31 22:15:17 -04001649
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001650.. function:: chroot(path)
1651
Georg Brandl8a5555f2012-06-24 13:29:09 +02001652 Change the root directory of the current process to *path*.
1653
1654 Availability: Unix.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001655
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001656 .. versionchanged:: 3.6
1657 Accepts a :term:`path-like object`.
1658
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001659
1660.. function:: fchdir(fd)
1661
1662 Change the current working directory to the directory represented by the file
1663 descriptor *fd*. The descriptor must refer to an opened directory, not an
Georg Brandl4d399a42012-06-25 07:40:32 +02001664 open file. As of Python 3.3, this is equivalent to ``os.chdir(fd)``.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001665
1666 Availability: Unix.
1667
1668
1669.. function:: getcwd()
1670
1671 Return a string representing the current working directory.
1672
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001673
1674.. function:: getcwdb()
1675
1676 Return a bytestring representing the current working directory.
1677
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001678
Georg Brandl116aa622007-08-15 14:28:22 +00001679.. function:: lchflags(path, flags)
1680
Georg Brandl50c40002012-06-24 11:45:20 +02001681 Set the flags of *path* to the numeric *flags*, like :func:`chflags`, but do
Georg Brandl4d399a42012-06-25 07:40:32 +02001682 not follow symbolic links. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001683 ``os.chflags(path, flags, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001684
1685 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001686
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001687 .. versionchanged:: 3.6
1688 Accepts a :term:`path-like object`.
1689
Georg Brandl116aa622007-08-15 14:28:22 +00001690
Christian Heimes93852662007-12-01 12:22:32 +00001691.. function:: lchmod(path, mode)
1692
1693 Change the mode of *path* to the numeric *mode*. If path is a symlink, this
Georg Brandl50c40002012-06-24 11:45:20 +02001694 affects the symlink rather than the target. See the docs for :func:`chmod`
Georg Brandl4d399a42012-06-25 07:40:32 +02001695 for possible values of *mode*. As of Python 3.3, this is equivalent to
Georg Brandlb9df00c2012-06-24 12:38:14 +02001696 ``os.chmod(path, mode, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001697
1698 Availability: Unix.
Christian Heimes93852662007-12-01 12:22:32 +00001699
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001700 .. versionchanged:: 3.6
1701 Accepts a :term:`path-like object`.
Christian Heimes93852662007-12-01 12:22:32 +00001702
Georg Brandl116aa622007-08-15 14:28:22 +00001703.. function:: lchown(path, uid, gid)
1704
Georg Brandl50c40002012-06-24 11:45:20 +02001705 Change the owner and group id of *path* to the numeric *uid* and *gid*. This
Georg Brandl4d399a42012-06-25 07:40:32 +02001706 function will not follow symbolic links. As of Python 3.3, this is equivalent
Georg Brandlb9df00c2012-06-24 12:38:14 +02001707 to ``os.chown(path, uid, gid, follow_symlinks=False)``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001708
1709 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001710
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001711 .. versionchanged:: 3.6
1712 Accepts a :term:`path-like object`.
1713
Georg Brandl116aa622007-08-15 14:28:22 +00001714
Larry Hastings9cf065c2012-06-22 16:30:09 -07001715.. function:: link(src, dst, *, src_dir_fd=None, dst_dir_fd=None, follow_symlinks=True)
Benjamin Peterson799bd802011-08-31 22:15:17 -04001716
Larry Hastings9cf065c2012-06-22 16:30:09 -07001717 Create a hard link pointing to *src* named *dst*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001718
Georg Brandlaceaf902012-06-25 08:33:56 +02001719 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
1720 supply :ref:`paths relative to directory descriptors <dir_fd>`, and :ref:`not
1721 following symlinks <follow_symlinks>`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00001722
Brian Curtin1b9df392010-11-24 20:24:31 +00001723 Availability: Unix, Windows.
1724
1725 .. versionchanged:: 3.2
1726 Added Windows support.
Georg Brandl116aa622007-08-15 14:28:22 +00001727
Larry Hastings9cf065c2012-06-22 16:30:09 -07001728 .. versionadded:: 3.3
1729 Added the *src_dir_fd*, *dst_dir_fd*, and *follow_symlinks* arguments.
1730
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001731 .. versionchanged:: 3.6
1732 Accepts a :term:`path-like object` for *src* and *dst*.
1733
Georg Brandl116aa622007-08-15 14:28:22 +00001734
Martin v. Löwis9c71f902010-07-24 10:09:11 +00001735.. function:: listdir(path='.')
Georg Brandl116aa622007-08-15 14:28:22 +00001736
Benjamin Peterson4469d0c2008-11-30 22:46:23 +00001737 Return a list containing the names of the entries in the directory given by
Larry Hastingsfdaea062012-06-25 04:42:23 -07001738 *path*. The list is in arbitrary order, and does not include the special
1739 entries ``'.'`` and ``'..'`` even if they are present in the directory.
Georg Brandl116aa622007-08-15 14:28:22 +00001740
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001741 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
1742 (directly or indirectly through the :class:`PathLike` interface),
1743 the filenames returned will also be of type ``bytes``;
Larry Hastingsfdaea062012-06-25 04:42:23 -07001744 in all other circumstances, they will be of type ``str``.
Georg Brandl116aa622007-08-15 14:28:22 +00001745
Larry Hastings77892dc2012-06-25 03:27:33 -07001746 This function can also support :ref:`specifying a file descriptor
1747 <path_fd>`; the file descriptor must refer to a directory.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001748
Larry Hastingsfdaea062012-06-25 04:42:23 -07001749 .. note::
1750 To encode ``str`` filenames to ``bytes``, use :func:`~os.fsencode`.
1751
Victor Stinner6036e442015-03-08 01:58:04 +01001752 .. seealso::
1753
Victor Stinner51b58322015-05-15 09:12:58 +02001754 The :func:`scandir` function returns directory entries along with
1755 file attribute information, giving better performance for many
1756 common use cases.
Victor Stinner6036e442015-03-08 01:58:04 +01001757
Martin v. Löwisc9e1c7d2010-07-23 12:16:41 +00001758 .. versionchanged:: 3.2
1759 The *path* parameter became optional.
Georg Brandl116aa622007-08-15 14:28:22 +00001760
Larry Hastings9cf065c2012-06-22 16:30:09 -07001761 .. versionadded:: 3.3
1762 Added support for specifying an open file descriptor for *path*.
Benjamin Peterson799bd802011-08-31 22:15:17 -04001763
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001764 .. versionchanged:: 3.6
1765 Accepts a :term:`path-like object`.
1766
Georg Brandl50c40002012-06-24 11:45:20 +02001767
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001768.. function:: lstat(path, \*, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001769
R. David Murray7b1aae92011-01-24 19:34:58 +00001770 Perform the equivalent of an :c:func:`lstat` system call on the given path.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001771 Similar to :func:`~os.stat`, but does not follow symbolic links. Return a
1772 :class:`stat_result` object.
1773
1774 On platforms that do not support symbolic links, this is an alias for
1775 :func:`~os.stat`.
1776
1777 As of Python 3.3, this is equivalent to ``os.stat(path, dir_fd=dir_fd,
1778 follow_symlinks=False)``.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001779
Georg Brandl50c40002012-06-24 11:45:20 +02001780 This function can also support :ref:`paths relative to directory descriptors
1781 <dir_fd>`.
Brian Curtinc7395692010-07-09 15:15:09 +00001782
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001783 .. seealso::
1784
Berker Peksag2034caa2015-04-27 13:53:28 +03001785 The :func:`.stat` function.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02001786
Georg Brandlb3823372010-07-10 08:58:37 +00001787 .. versionchanged:: 3.2
1788 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001789
Larry Hastings9cf065c2012-06-22 16:30:09 -07001790 .. versionchanged:: 3.3
1791 Added the *dir_fd* parameter.
Ross Lagerwall7807c352011-03-17 20:20:30 +02001792
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001793 .. versionchanged:: 3.6
1794 Accepts a :term:`path-like object` for *src* and *dst*.
1795
Ross Lagerwall7807c352011-03-17 20:20:30 +02001796
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001797.. function:: mkdir(path, mode=0o777, *, dir_fd=None)
1798
1799 Create a directory named *path* with numeric mode *mode*.
1800
Tommy Beadle63b91e52016-06-02 15:41:20 -04001801 If the directory already exists, :exc:`FileExistsError` is raised.
1802
1803 .. _mkdir_modebits:
1804
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001805 On some systems, *mode* is ignored. Where it is used, the current umask
Tommy Beadle63b91e52016-06-02 15:41:20 -04001806 value is first masked out. If bits other than the last 9 (i.e. the last 3
1807 digits of the octal representation of the *mode*) are set, their meaning is
1808 platform-dependent. On some platforms, they are ignored and you should call
1809 :func:`chmod` explicitly to set them.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001810
1811 This function can also support :ref:`paths relative to directory descriptors
1812 <dir_fd>`.
1813
1814 It is also possible to create temporary directories; see the
1815 :mod:`tempfile` module's :func:`tempfile.mkdtemp` function.
1816
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001817 .. versionadded:: 3.3
1818 The *dir_fd* argument.
1819
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001820 .. versionchanged:: 3.6
1821 Accepts a :term:`path-like object`.
1822
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001823
Zachary Warea22ae212014-03-20 09:42:01 -05001824.. function:: makedirs(name, mode=0o777, exist_ok=False)
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001825
1826 .. index::
1827 single: directory; creating
1828 single: UNC paths; and os.makedirs()
1829
1830 Recursive directory creation function. Like :func:`mkdir`, but makes all
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001831 intermediate-level directories needed to contain the leaf directory.
1832
Serhiy Storchakae304e332017-03-24 13:27:42 +02001833 The *mode* parameter is passed to :func:`mkdir` for creating the leaf
1834 directory; see :ref:`the mkdir() description <mkdir_modebits>` for how it
1835 is interpreted. To set the file permission bits of any newly-created parent
1836 directories you can set the umask before invoking :func:`makedirs`. The
1837 file permission bits of existing parent directories are not changed.
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001838
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001839 If *exist_ok* is ``False`` (the default), an :exc:`OSError` is raised if the
1840 target directory already exists.
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001841
1842 .. note::
1843
1844 :func:`makedirs` will become confused if the path elements to create
Hynek Schlawack0230b6a2012-10-07 18:04:38 +02001845 include :data:`pardir` (eg. ".." on UNIX systems).
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001846
1847 This function handles UNC paths correctly.
1848
1849 .. versionadded:: 3.2
1850 The *exist_ok* parameter.
1851
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001852 .. versionchanged:: 3.4.1
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001853
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001854 Before Python 3.4.1, if *exist_ok* was ``True`` and the directory existed,
Benjamin Petersonee5f1c12014-04-01 19:13:18 -04001855 :func:`makedirs` would still raise an error if *mode* did not match the
1856 mode of the existing directory. Since this behavior was impossible to
Benjamin Peterson1acc69c2014-04-01 19:22:06 -04001857 implement safely, it was removed in Python 3.4.1. See :issue:`21082`.
Benjamin Peterson4717e212014-04-01 19:17:57 -04001858
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001859 .. versionchanged:: 3.6
1860 Accepts a :term:`path-like object`.
1861
Serhiy Storchakae304e332017-03-24 13:27:42 +02001862 .. versionchanged:: 3.7
1863 The *mode* argument no longer affects the file permission bits of
1864 newly-created intermediate-level directories.
1865
Georg Brandl8ccadaa2012-06-24 12:50:06 +02001866
Larry Hastings9cf065c2012-06-22 16:30:09 -07001867.. function:: mkfifo(path, mode=0o666, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001868
Larry Hastings9cf065c2012-06-22 16:30:09 -07001869 Create a FIFO (a named pipe) named *path* with numeric mode *mode*.
1870 The current umask value is first masked out from the mode.
1871
Georg Brandl50c40002012-06-24 11:45:20 +02001872 This function can also support :ref:`paths relative to directory descriptors
1873 <dir_fd>`.
Georg Brandl116aa622007-08-15 14:28:22 +00001874
1875 FIFOs are pipes that can be accessed like regular files. FIFOs exist until they
1876 are deleted (for example with :func:`os.unlink`). Generally, FIFOs are used as
1877 rendezvous between "client" and "server" type processes: the server opens the
1878 FIFO for reading, and the client opens it for writing. Note that :func:`mkfifo`
1879 doesn't open the FIFO --- it just creates the rendezvous point.
1880
Benjamin Petersonf650e462010-05-06 23:03:05 +00001881 Availability: Unix.
1882
Larry Hastings9cf065c2012-06-22 16:30:09 -07001883 .. versionadded:: 3.3
1884 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001885
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001886 .. versionchanged:: 3.6
1887 Accepts a :term:`path-like object`.
1888
Larry Hastings9cf065c2012-06-22 16:30:09 -07001889
Martin Panterbf19d162015-09-09 01:01:13 +00001890.. function:: mknod(path, mode=0o600, device=0, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001891
1892 Create a filesystem node (file, device special file or named pipe) named
Martin Panterbf19d162015-09-09 01:01:13 +00001893 *path*. *mode* specifies both the permissions to use and the type of node
Georg Brandl18244152009-09-02 20:34:52 +00001894 to be created, being combined (bitwise OR) with one of ``stat.S_IFREG``,
1895 ``stat.S_IFCHR``, ``stat.S_IFBLK``, and ``stat.S_IFIFO`` (those constants are
1896 available in :mod:`stat`). For ``stat.S_IFCHR`` and ``stat.S_IFBLK``,
1897 *device* defines the newly created device special file (probably using
Georg Brandl116aa622007-08-15 14:28:22 +00001898 :func:`os.makedev`), otherwise it is ignored.
1899
Georg Brandl50c40002012-06-24 11:45:20 +02001900 This function can also support :ref:`paths relative to directory descriptors
1901 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001902
Berker Peksag6129e142016-09-26 22:50:11 +03001903 Availability: Unix.
1904
Larry Hastings9cf065c2012-06-22 16:30:09 -07001905 .. versionadded:: 3.3
1906 The *dir_fd* argument.
1907
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001908 .. versionchanged:: 3.6
1909 Accepts a :term:`path-like object`.
1910
Georg Brandl116aa622007-08-15 14:28:22 +00001911
1912.. function:: major(device)
1913
Christian Heimesfaf2f632008-01-06 16:59:19 +00001914 Extract the device major number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001915 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001916
Georg Brandl116aa622007-08-15 14:28:22 +00001917
1918.. function:: minor(device)
1919
Christian Heimesfaf2f632008-01-06 16:59:19 +00001920 Extract the device minor number from a raw device number (usually the
Georg Brandl60203b42010-10-06 10:11:56 +00001921 :attr:`st_dev` or :attr:`st_rdev` field from :c:type:`stat`).
Georg Brandl116aa622007-08-15 14:28:22 +00001922
Georg Brandl116aa622007-08-15 14:28:22 +00001923
1924.. function:: makedev(major, minor)
1925
Christian Heimesfaf2f632008-01-06 16:59:19 +00001926 Compose a raw device number from the major and minor device numbers.
Georg Brandl116aa622007-08-15 14:28:22 +00001927
Georg Brandl116aa622007-08-15 14:28:22 +00001928
Georg Brandl116aa622007-08-15 14:28:22 +00001929.. function:: pathconf(path, name)
1930
1931 Return system configuration information relevant to a named file. *name*
1932 specifies the configuration value to retrieve; it may be a string which is the
1933 name of a defined system value; these names are specified in a number of
1934 standards (POSIX.1, Unix 95, Unix 98, and others). Some platforms define
1935 additional names as well. The names known to the host operating system are
1936 given in the ``pathconf_names`` dictionary. For configuration variables not
1937 included in that mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00001938
1939 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
1940 specific value for *name* is not supported by the host system, even if it is
1941 included in ``pathconf_names``, an :exc:`OSError` is raised with
1942 :const:`errno.EINVAL` for the error number.
1943
Larry Hastings77892dc2012-06-25 03:27:33 -07001944 This function can support :ref:`specifying a file descriptor
Georg Brandl306336b2012-06-24 12:55:33 +02001945 <path_fd>`.
1946
Benjamin Petersonf650e462010-05-06 23:03:05 +00001947 Availability: Unix.
1948
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001949 .. versionchanged:: 3.6
1950 Accepts a :term:`path-like object`.
1951
Georg Brandl116aa622007-08-15 14:28:22 +00001952
1953.. data:: pathconf_names
1954
1955 Dictionary mapping names accepted by :func:`pathconf` and :func:`fpathconf` to
1956 the integer values defined for those names by the host operating system. This
Georg Brandl8a5555f2012-06-24 13:29:09 +02001957 can be used to determine the set of names known to the system.
1958
1959 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00001960
1961
Larry Hastings9cf065c2012-06-22 16:30:09 -07001962.. function:: readlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001963
1964 Return a string representing the path to which the symbolic link points. The
Georg Brandl50c40002012-06-24 11:45:20 +02001965 result may be either an absolute or relative pathname; if it is relative, it
1966 may be converted to an absolute pathname using
1967 ``os.path.join(os.path.dirname(path), result)``.
Georg Brandl116aa622007-08-15 14:28:22 +00001968
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001969 If the *path* is a string object (directly or indirectly through a
1970 :class:`PathLike` interface), the result will also be a string object,
Martin Panter6245cb32016-04-15 02:14:19 +00001971 and the call may raise a UnicodeDecodeError. If the *path* is a bytes
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001972 object (direct or indirectly), the result will be a bytes object.
Georg Brandl116aa622007-08-15 14:28:22 +00001973
Georg Brandl50c40002012-06-24 11:45:20 +02001974 This function can also support :ref:`paths relative to directory descriptors
1975 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001976
Brian Curtinc7395692010-07-09 15:15:09 +00001977 Availability: Unix, Windows
1978
Georg Brandlb3823372010-07-10 08:58:37 +00001979 .. versionchanged:: 3.2
1980 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00001981
Larry Hastings9cf065c2012-06-22 16:30:09 -07001982 .. versionadded:: 3.3
1983 The *dir_fd* argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001984
Brett Cannon6fa7aad2016-09-06 15:55:02 -07001985 .. versionchanged:: 3.6
1986 Accepts a :term:`path-like object`.
1987
Georg Brandl116aa622007-08-15 14:28:22 +00001988
Larry Hastingsb698d8e2012-06-23 16:55:07 -07001989.. function:: remove(path, *, dir_fd=None)
Larry Hastings9cf065c2012-06-22 16:30:09 -07001990
Georg Brandl50c40002012-06-24 11:45:20 +02001991 Remove (delete) the file *path*. If *path* is a directory, :exc:`OSError` is
1992 raised. Use :func:`rmdir` to remove directories.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001993
Georg Brandl50c40002012-06-24 11:45:20 +02001994 This function can support :ref:`paths relative to directory descriptors
1995 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07001996
1997 On Windows, attempting to remove a file that is in use causes an exception to
1998 be raised; on Unix, the directory entry is removed but the storage allocated
1999 to the file is not made available until the original file is no longer in use.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002000
Brett Cannon05039172015-12-28 17:28:19 -08002001 This function is semantically identical to :func:`unlink`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002002
Larry Hastings9cf065c2012-06-22 16:30:09 -07002003 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002004 The *dir_fd* argument.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002005
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002006 .. versionchanged:: 3.6
2007 Accepts a :term:`path-like object`.
2008
Georg Brandl116aa622007-08-15 14:28:22 +00002009
Zachary Warea22ae212014-03-20 09:42:01 -05002010.. function:: removedirs(name)
Georg Brandl116aa622007-08-15 14:28:22 +00002011
2012 .. index:: single: directory; deleting
2013
Christian Heimesfaf2f632008-01-06 16:59:19 +00002014 Remove directories recursively. Works like :func:`rmdir` except that, if the
Georg Brandl116aa622007-08-15 14:28:22 +00002015 leaf directory is successfully removed, :func:`removedirs` tries to
2016 successively remove every parent directory mentioned in *path* until an error
2017 is raised (which is ignored, because it generally means that a parent directory
2018 is not empty). For example, ``os.removedirs('foo/bar/baz')`` will first remove
2019 the directory ``'foo/bar/baz'``, and then remove ``'foo/bar'`` and ``'foo'`` if
2020 they are empty. Raises :exc:`OSError` if the leaf directory could not be
2021 successfully removed.
2022
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002023 .. versionchanged:: 3.6
2024 Accepts a :term:`path-like object`.
2025
Georg Brandl116aa622007-08-15 14:28:22 +00002026
Larry Hastings9cf065c2012-06-22 16:30:09 -07002027.. function:: rename(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002028
2029 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2030 :exc:`OSError` will be raised. On Unix, if *dst* exists and is a file, it will
Christian Heimesfaf2f632008-01-06 16:59:19 +00002031 be replaced silently if the user has permission. The operation may fail on some
Georg Brandl116aa622007-08-15 14:28:22 +00002032 Unix flavors if *src* and *dst* are on different filesystems. If successful,
2033 the renaming will be an atomic operation (this is a POSIX requirement). On
2034 Windows, if *dst* already exists, :exc:`OSError` will be raised even if it is a
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002035 file.
2036
Georg Brandlaceaf902012-06-25 08:33:56 +02002037 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2038 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002039
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002040 If you want cross-platform overwriting of the destination, use :func:`replace`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002041
Larry Hastings9cf065c2012-06-22 16:30:09 -07002042 .. versionadded:: 3.3
2043 The *src_dir_fd* and *dst_dir_fd* arguments.
2044
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002045 .. versionchanged:: 3.6
2046 Accepts a :term:`path-like object` for *src* and *dst*.
2047
Georg Brandl116aa622007-08-15 14:28:22 +00002048
2049.. function:: renames(old, new)
2050
2051 Recursive directory or file renaming function. Works like :func:`rename`, except
2052 creation of any intermediate directories needed to make the new pathname good is
2053 attempted first. After the rename, directories corresponding to rightmost path
2054 segments of the old name will be pruned away using :func:`removedirs`.
2055
Georg Brandl116aa622007-08-15 14:28:22 +00002056 .. note::
2057
2058 This function can fail with the new directory structure made if you lack
2059 permissions needed to remove the leaf directory or file.
2060
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002061 .. versionchanged:: 3.6
2062 Accepts a :term:`path-like object` for *old* and *new*.
2063
Georg Brandl116aa622007-08-15 14:28:22 +00002064
Larry Hastings9cf065c2012-06-22 16:30:09 -07002065.. function:: replace(src, dst, *, src_dir_fd=None, dst_dir_fd=None)
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002066
2067 Rename the file or directory *src* to *dst*. If *dst* is a directory,
2068 :exc:`OSError` will be raised. If *dst* exists and is a file, it will
2069 be replaced silently if the user has permission. The operation may fail
2070 if *src* and *dst* are on different filesystems. If successful,
2071 the renaming will be an atomic operation (this is a POSIX requirement).
2072
Georg Brandlaceaf902012-06-25 08:33:56 +02002073 This function can support specifying *src_dir_fd* and/or *dst_dir_fd* to
2074 supply :ref:`paths relative to directory descriptors <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002075
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002076 .. versionadded:: 3.3
2077
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002078 .. versionchanged:: 3.6
2079 Accepts a :term:`path-like object` for *src* and *dst*.
2080
Antoine Pitrouf3b2d882012-01-30 22:08:52 +01002081
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002082.. function:: rmdir(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002083
Georg Brandla6053b42009-09-01 08:11:14 +00002084 Remove (delete) the directory *path*. Only works when the directory is
2085 empty, otherwise, :exc:`OSError` is raised. In order to remove whole
Benjamin Petersonf650e462010-05-06 23:03:05 +00002086 directory trees, :func:`shutil.rmtree` can be used.
2087
Georg Brandl50c40002012-06-24 11:45:20 +02002088 This function can support :ref:`paths relative to directory descriptors
2089 <dir_fd>`.
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002090
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002091 .. versionadded:: 3.3
2092 The *dir_fd* parameter.
2093
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002094 .. versionchanged:: 3.6
2095 Accepts a :term:`path-like object`.
2096
Georg Brandl116aa622007-08-15 14:28:22 +00002097
Victor Stinner6036e442015-03-08 01:58:04 +01002098.. function:: scandir(path='.')
2099
Brett Cannona32c4d02016-06-24 14:14:44 -07002100 Return an iterator of :class:`os.DirEntry` objects corresponding to the
2101 entries in the directory given by *path*. The entries are yielded in
2102 arbitrary order, and the special entries ``'.'`` and ``'..'`` are not
2103 included.
Victor Stinner6036e442015-03-08 01:58:04 +01002104
Victor Stinner51b58322015-05-15 09:12:58 +02002105 Using :func:`scandir` instead of :func:`listdir` can significantly
2106 increase the performance of code that also needs file type or file
Brett Cannona32c4d02016-06-24 14:14:44 -07002107 attribute information, because :class:`os.DirEntry` objects expose this
Victor Stinner51b58322015-05-15 09:12:58 +02002108 information if the operating system provides it when scanning a directory.
Brett Cannona32c4d02016-06-24 14:14:44 -07002109 All :class:`os.DirEntry` methods may perform a system call, but
2110 :func:`~os.DirEntry.is_dir` and :func:`~os.DirEntry.is_file` usually only
2111 require a system call for symbolic links; :func:`os.DirEntry.stat`
Victor Stinner51b58322015-05-15 09:12:58 +02002112 always requires a system call on Unix but only requires one for
2113 symbolic links on Windows.
Victor Stinner6036e442015-03-08 01:58:04 +01002114
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002115 *path* may be a :term:`path-like object`. If *path* is of type ``bytes``
2116 (directly or indirectly through the :class:`PathLike` interface),
2117 the type of the :attr:`~os.DirEntry.name` and :attr:`~os.DirEntry.path`
2118 attributes of each :class:`os.DirEntry` will be ``bytes``; in all other
2119 circumstances, they will be of type ``str``.
Victor Stinner6036e442015-03-08 01:58:04 +01002120
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002121 This function can also support :ref:`specifying a file descriptor
2122 <path_fd>`; the file descriptor must refer to a directory.
2123
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002124 The :func:`scandir` iterator supports the :term:`context manager` protocol
2125 and has the following method:
2126
2127 .. method:: scandir.close()
2128
2129 Close the iterator and free acquired resources.
2130
2131 This is called automatically when the iterator is exhausted or garbage
2132 collected, or when an error happens during iterating. However it
2133 is advisable to call it explicitly or use the :keyword:`with`
2134 statement.
2135
2136 .. versionadded:: 3.6
2137
Victor Stinner6036e442015-03-08 01:58:04 +01002138 The following example shows a simple use of :func:`scandir` to display all
Victor Stinner51b58322015-05-15 09:12:58 +02002139 the files (excluding directories) in the given *path* that don't start with
2140 ``'.'``. The ``entry.is_file()`` call will generally not make an additional
2141 system call::
Victor Stinner6036e442015-03-08 01:58:04 +01002142
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002143 with os.scandir(path) as it:
2144 for entry in it:
2145 if not entry.name.startswith('.') and entry.is_file():
2146 print(entry.name)
Victor Stinner6036e442015-03-08 01:58:04 +01002147
2148 .. note::
2149
2150 On Unix-based systems, :func:`scandir` uses the system's
2151 `opendir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/opendir.html>`_
2152 and
2153 `readdir() <http://pubs.opengroup.org/onlinepubs/009695399/functions/readdir_r.html>`_
2154 functions. On Windows, it uses the Win32
Georg Brandl5d941342016-02-26 19:37:12 +01002155 `FindFirstFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364418(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002156 and
Georg Brandl5d941342016-02-26 19:37:12 +01002157 `FindNextFileW <https://msdn.microsoft.com/en-us/library/windows/desktop/aa364428(v=vs.85).aspx>`_
Victor Stinner6036e442015-03-08 01:58:04 +01002158 functions.
2159
Victor Stinner6036e442015-03-08 01:58:04 +01002160 .. versionadded:: 3.5
2161
Serhiy Storchakaffe96ae2016-02-11 13:21:30 +02002162 .. versionadded:: 3.6
2163 Added support for the :term:`context manager` protocol and the
2164 :func:`~scandir.close()` method. If a :func:`scandir` iterator is neither
2165 exhausted nor explicitly closed a :exc:`ResourceWarning` will be emitted
2166 in its destructor.
2167
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002168 The function accepts a :term:`path-like object`.
2169
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002170 .. versionchanged:: 3.7
2171 Added support for :ref:`file descriptors <path_fd>` on Unix.
2172
Victor Stinner6036e442015-03-08 01:58:04 +01002173
2174.. class:: DirEntry
2175
2176 Object yielded by :func:`scandir` to expose the file path and other file
2177 attributes of a directory entry.
2178
2179 :func:`scandir` will provide as much of this information as possible without
2180 making additional system calls. When a ``stat()`` or ``lstat()`` system call
Brett Cannona32c4d02016-06-24 14:14:44 -07002181 is made, the ``os.DirEntry`` object will cache the result.
Victor Stinner6036e442015-03-08 01:58:04 +01002182
Brett Cannona32c4d02016-06-24 14:14:44 -07002183 ``os.DirEntry`` instances are not intended to be stored in long-lived data
Victor Stinner6036e442015-03-08 01:58:04 +01002184 structures; if you know the file metadata has changed or if a long time has
2185 elapsed since calling :func:`scandir`, call ``os.stat(entry.path)`` to fetch
2186 up-to-date information.
2187
Brett Cannona32c4d02016-06-24 14:14:44 -07002188 Because the ``os.DirEntry`` methods can make operating system calls, they may
Victor Stinner51b58322015-05-15 09:12:58 +02002189 also raise :exc:`OSError`. If you need very fine-grained
Victor Stinner6036e442015-03-08 01:58:04 +01002190 control over errors, you can catch :exc:`OSError` when calling one of the
Brett Cannona32c4d02016-06-24 14:14:44 -07002191 ``os.DirEntry`` methods and handle as appropriate.
Victor Stinner6036e442015-03-08 01:58:04 +01002192
Brett Cannona32c4d02016-06-24 14:14:44 -07002193 To be directly usable as a :term:`path-like object`, ``os.DirEntry``
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002194 implements the :class:`PathLike` interface.
Brett Cannon96881cd2016-06-10 14:37:21 -07002195
Brett Cannona32c4d02016-06-24 14:14:44 -07002196 Attributes and methods on a ``os.DirEntry`` instance are as follows:
Victor Stinner6036e442015-03-08 01:58:04 +01002197
2198 .. attribute:: name
2199
2200 The entry's base filename, relative to the :func:`scandir` *path*
2201 argument.
2202
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002203 The :attr:`name` attribute will be ``bytes`` if the :func:`scandir`
2204 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002205 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002206
2207 .. attribute:: path
2208
2209 The entry's full path name: equivalent to ``os.path.join(scandir_path,
2210 entry.name)`` where *scandir_path* is the :func:`scandir` *path*
2211 argument. The path is only absolute if the :func:`scandir` *path*
Serhiy Storchakaea720fe2017-03-30 09:12:31 +03002212 argument was absolute. If the :func:`scandir` *path*
2213 argument was a :ref:`file descriptor <path_fd>`, the :attr:`path`
2214 attribute is the same as the :attr:`name` attribute.
Victor Stinner6036e442015-03-08 01:58:04 +01002215
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002216 The :attr:`path` attribute will be ``bytes`` if the :func:`scandir`
2217 *path* argument is of type ``bytes`` and ``str`` otherwise. Use
Victor Stinner51b58322015-05-15 09:12:58 +02002218 :func:`~os.fsdecode` to decode byte filenames.
Victor Stinner6036e442015-03-08 01:58:04 +01002219
2220 .. method:: inode()
2221
2222 Return the inode number of the entry.
2223
Brett Cannona32c4d02016-06-24 14:14:44 -07002224 The result is cached on the ``os.DirEntry`` object. Use
2225 ``os.stat(entry.path, follow_symlinks=False).st_ino`` to fetch up-to-date
2226 information.
Victor Stinner6036e442015-03-08 01:58:04 +01002227
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002228 On the first, uncached call, a system call is required on Windows but
2229 not on Unix.
Victor Stinner6036e442015-03-08 01:58:04 +01002230
2231 .. method:: is_dir(\*, follow_symlinks=True)
2232
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002233 Return ``True`` if this entry is a directory or a symbolic link pointing
2234 to a directory; return ``False`` if the entry is or points to any other
2235 kind of file, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002236
2237 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002238 is a directory (without following symlinks); return ``False`` if the
2239 entry is any other kind of file or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002240
Brett Cannona32c4d02016-06-24 14:14:44 -07002241 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002242 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` along
2243 with :func:`stat.S_ISDIR` to fetch up-to-date information.
2244
2245 On the first, uncached call, no system call is required in most cases.
2246 Specifically, for non-symlinks, neither Windows or Unix require a system
2247 call, except on certain Unix file systems, such as network file systems,
2248 that return ``dirent.d_type == DT_UNKNOWN``. If the entry is a symlink,
2249 a system call will be required to follow the symlink unless
2250 *follow_symlinks* is ``False``.
Victor Stinner6036e442015-03-08 01:58:04 +01002251
Victor Stinner51b58322015-05-15 09:12:58 +02002252 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2253 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002254
Victor Stinner6036e442015-03-08 01:58:04 +01002255 .. method:: is_file(\*, follow_symlinks=True)
2256
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002257 Return ``True`` if this entry is a file or a symbolic link pointing to a
2258 file; return ``False`` if the entry is or points to a directory or other
2259 non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002260
2261 If *follow_symlinks* is ``False``, return ``True`` only if this entry
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002262 is a file (without following symlinks); return ``False`` if the entry is
2263 a directory or other non-file entry, or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002264
Brett Cannona32c4d02016-06-24 14:14:44 -07002265 The result is cached on the ``os.DirEntry`` object. Caching, system calls
2266 made, and exceptions raised are as per :func:`~os.DirEntry.is_dir`.
Victor Stinner6036e442015-03-08 01:58:04 +01002267
2268 .. method:: is_symlink()
2269
Victor Stinner51b58322015-05-15 09:12:58 +02002270 Return ``True`` if this entry is a symbolic link (even if broken);
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002271 return ``False`` if the entry points to a directory or any kind of file,
Victor Stinner51b58322015-05-15 09:12:58 +02002272 or if it doesn't exist anymore.
Victor Stinner6036e442015-03-08 01:58:04 +01002273
Brett Cannona32c4d02016-06-24 14:14:44 -07002274 The result is cached on the ``os.DirEntry`` object. Call
Victor Stinner51b58322015-05-15 09:12:58 +02002275 :func:`os.path.islink` to fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002276
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002277 On the first, uncached call, no system call is required in most cases.
2278 Specifically, neither Windows or Unix require a system call, except on
2279 certain Unix file systems, such as network file systems, that return
2280 ``dirent.d_type == DT_UNKNOWN``.
Victor Stinner6036e442015-03-08 01:58:04 +01002281
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002282 This method can raise :exc:`OSError`, such as :exc:`PermissionError`,
2283 but :exc:`FileNotFoundError` is caught and not raised.
Victor Stinner6036e442015-03-08 01:58:04 +01002284
2285 .. method:: stat(\*, follow_symlinks=True)
2286
Victor Stinner51b58322015-05-15 09:12:58 +02002287 Return a :class:`stat_result` object for this entry. This method
2288 follows symbolic links by default; to stat a symbolic link add the
2289 ``follow_symlinks=False`` argument.
2290
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002291 On Unix, this method always requires a system call. On Windows, it
2292 only requires a system call if *follow_symlinks* is ``True`` and the
2293 entry is a symbolic link.
Victor Stinner6036e442015-03-08 01:58:04 +01002294
2295 On Windows, the ``st_ino``, ``st_dev`` and ``st_nlink`` attributes of the
2296 :class:`stat_result` are always set to zero. Call :func:`os.stat` to
2297 get these attributes.
2298
Brett Cannona32c4d02016-06-24 14:14:44 -07002299 The result is cached on the ``os.DirEntry`` object, with a separate cache
Victor Stinner5f0c5d92016-01-31 18:36:41 +01002300 for *follow_symlinks* ``True`` and ``False``. Call :func:`os.stat` to
2301 fetch up-to-date information.
Victor Stinner6036e442015-03-08 01:58:04 +01002302
Guido van Rossum1469d742016-01-06 11:36:03 -08002303 Note that there is a nice correspondence between several attributes
Brett Cannona32c4d02016-06-24 14:14:44 -07002304 and methods of ``os.DirEntry`` and of :class:`pathlib.Path`. In
Brett Cannonc28592b2016-06-24 12:21:47 -07002305 particular, the ``name`` attribute has the same
Guido van Rossum1469d742016-01-06 11:36:03 -08002306 meaning, as do the ``is_dir()``, ``is_file()``, ``is_symlink()``
2307 and ``stat()`` methods.
2308
Victor Stinner6036e442015-03-08 01:58:04 +01002309 .. versionadded:: 3.5
2310
Brett Cannon96881cd2016-06-10 14:37:21 -07002311 .. versionchanged:: 3.6
Serhiy Storchaka3c38e062016-11-20 08:23:07 +02002312 Added support for the :class:`~os.PathLike` interface. Added support
2313 for :class:`bytes` paths on Windows.
Brett Cannon96881cd2016-06-10 14:37:21 -07002314
Victor Stinner6036e442015-03-08 01:58:04 +01002315
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002316.. function:: stat(path, \*, dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002317
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002318 Get the status of a file or a file descriptor. Perform the equivalent of a
2319 :c:func:`stat` system call on the given path. *path* may be specified as
Xiang Zhang4459e002017-01-22 13:04:17 +08002320 either a string or bytes -- directly or indirectly through the :class:`PathLike`
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002321 interface -- or as an open file descriptor. Return a :class:`stat_result`
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002322 object.
Georg Brandl116aa622007-08-15 14:28:22 +00002323
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002324 This function normally follows symlinks; to stat a symlink add the argument
2325 ``follow_symlinks=False``, or use :func:`lstat`.
R. David Murray7b1aae92011-01-24 19:34:58 +00002326
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002327 This function can support :ref:`specifying a file descriptor <path_fd>` and
2328 :ref:`not following symlinks <follow_symlinks>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002329
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002330 .. index:: module: stat
R. David Murray7b1aae92011-01-24 19:34:58 +00002331
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002332 Example::
Georg Brandl116aa622007-08-15 14:28:22 +00002333
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002334 >>> import os
2335 >>> statinfo = os.stat('somefile.txt')
2336 >>> statinfo
2337 os.stat_result(st_mode=33188, st_ino=7876932, st_dev=234881026,
2338 st_nlink=1, st_uid=501, st_gid=501, st_size=264, st_atime=1297230295,
2339 st_mtime=1297230027, st_ctime=1297230027)
2340 >>> statinfo.st_size
2341 264
R. David Murray7b1aae92011-01-24 19:34:58 +00002342
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002343 .. seealso::
Zachary Ware63f277b2014-06-19 09:46:37 -05002344
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002345 :func:`fstat` and :func:`lstat` functions.
2346
2347 .. versionadded:: 3.3
2348 Added the *dir_fd* and *follow_symlinks* arguments, specifying a file
2349 descriptor instead of a path.
2350
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002351 .. versionchanged:: 3.6
2352 Accepts a :term:`path-like object`.
2353
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002354
2355.. class:: stat_result
2356
2357 Object whose attributes correspond roughly to the members of the
2358 :c:type:`stat` structure. It is used for the result of :func:`os.stat`,
2359 :func:`os.fstat` and :func:`os.lstat`.
2360
2361 Attributes:
2362
2363 .. attribute:: st_mode
2364
2365 File mode: file type and file mode bits (permissions).
2366
2367 .. attribute:: st_ino
2368
2369 Inode number.
2370
2371 .. attribute:: st_dev
2372
2373 Identifier of the device on which this file resides.
2374
2375 .. attribute:: st_nlink
2376
2377 Number of hard links.
2378
2379 .. attribute:: st_uid
2380
2381 User identifier of the file owner.
2382
2383 .. attribute:: st_gid
2384
2385 Group identifier of the file owner.
2386
2387 .. attribute:: st_size
2388
2389 Size of the file in bytes, if it is a regular file or a symbolic link.
2390 The size of a symbolic link is the length of the pathname it contains,
2391 without a terminating null byte.
2392
2393 Timestamps:
2394
2395 .. attribute:: st_atime
2396
2397 Time of most recent access expressed in seconds.
2398
2399 .. attribute:: st_mtime
2400
2401 Time of most recent content modification expressed in seconds.
2402
2403 .. attribute:: st_ctime
2404
2405 Platform dependent:
2406
2407 * the time of most recent metadata change on Unix,
2408 * the time of creation on Windows, expressed in seconds.
2409
2410 .. attribute:: st_atime_ns
2411
2412 Time of most recent access expressed in nanoseconds as an integer.
2413
2414 .. attribute:: st_mtime_ns
2415
2416 Time of most recent content modification expressed in nanoseconds as an
2417 integer.
2418
2419 .. attribute:: st_ctime_ns
2420
2421 Platform dependent:
2422
2423 * the time of most recent metadata change on Unix,
2424 * the time of creation on Windows, expressed in nanoseconds as an
2425 integer.
2426
Georg Brandl116aa622007-08-15 14:28:22 +00002427 .. note::
2428
Senthil Kumaran3aac1792011-07-04 11:43:51 -07002429 The exact meaning and resolution of the :attr:`st_atime`,
Senthil Kumarana6bac952011-07-04 11:28:30 -07002430 :attr:`st_mtime`, and :attr:`st_ctime` attributes depend on the operating
2431 system and the file system. For example, on Windows systems using the FAT
2432 or FAT32 file systems, :attr:`st_mtime` has 2-second resolution, and
2433 :attr:`st_atime` has only 1-day resolution. See your operating system
2434 documentation for details.
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002435
Larry Hastings6fe20b32012-04-19 15:07:49 -07002436 Similarly, although :attr:`st_atime_ns`, :attr:`st_mtime_ns`,
2437 and :attr:`st_ctime_ns` are always expressed in nanoseconds, many
2438 systems do not provide nanosecond precision. On systems that do
2439 provide nanosecond precision, the floating-point object used to
2440 store :attr:`st_atime`, :attr:`st_mtime`, and :attr:`st_ctime`
2441 cannot preserve all of it, and as such will be slightly inexact.
2442 If you need the exact timestamps you should always use
2443 :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and :attr:`st_ctime_ns`.
Georg Brandl116aa622007-08-15 14:28:22 +00002444
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002445 On some Unix systems (such as Linux), the following attributes may also be
2446 available:
2447
2448 .. attribute:: st_blocks
2449
2450 Number of 512-byte blocks allocated for file.
2451 This may be smaller than :attr:`st_size`/512 when the file has holes.
2452
2453 .. attribute:: st_blksize
2454
2455 "Preferred" blocksize for efficient file system I/O. Writing to a file in
2456 smaller chunks may cause an inefficient read-modify-rewrite.
2457
2458 .. attribute:: st_rdev
2459
2460 Type of device if an inode device.
2461
2462 .. attribute:: st_flags
2463
2464 User defined flags for file.
2465
2466 On other Unix systems (such as FreeBSD), the following attributes may be
2467 available (but may be only filled out if root tries to use them):
2468
2469 .. attribute:: st_gen
2470
2471 File generation number.
2472
2473 .. attribute:: st_birthtime
2474
2475 Time of file creation.
2476
jcea6c51d512018-01-28 14:00:08 +01002477 On Solaris and derivatives, the following attributes may also be
2478 available:
2479
2480 .. attribute:: st_fstype
2481
2482 String that uniquely identifies the type of the filesystem that
2483 contains the file.
2484
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002485 On Mac OS systems, the following attributes may also be available:
2486
2487 .. attribute:: st_rsize
2488
2489 Real size of the file.
2490
2491 .. attribute:: st_creator
2492
2493 Creator of the file.
2494
2495 .. attribute:: st_type
2496
2497 File type.
2498
Victor Stinnere1d24f72014-07-24 12:44:07 +02002499 On Windows systems, the following attribute is also available:
2500
2501 .. attribute:: st_file_attributes
2502
2503 Windows file attributes: ``dwFileAttributes`` member of the
2504 ``BY_HANDLE_FILE_INFORMATION`` structure returned by
2505 :c:func:`GetFileInformationByHandle`. See the ``FILE_ATTRIBUTE_*``
2506 constants in the :mod:`stat` module.
2507
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002508 The standard module :mod:`stat` defines functions and constants that are
2509 useful for extracting information from a :c:type:`stat` structure. (On
2510 Windows, some items are filled with dummy values.)
2511
2512 For backward compatibility, a :class:`stat_result` instance is also
Georg Brandl50c40002012-06-24 11:45:20 +02002513 accessible as a tuple of at least 10 integers giving the most important (and
2514 portable) members of the :c:type:`stat` structure, in the order
2515 :attr:`st_mode`, :attr:`st_ino`, :attr:`st_dev`, :attr:`st_nlink`,
2516 :attr:`st_uid`, :attr:`st_gid`, :attr:`st_size`, :attr:`st_atime`,
2517 :attr:`st_mtime`, :attr:`st_ctime`. More items may be added at the end by
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002518 some implementations. For compatibility with older Python versions,
2519 accessing :class:`stat_result` as a tuple always returns integers.
Georg Brandl116aa622007-08-15 14:28:22 +00002520
Larry Hastings6fe20b32012-04-19 15:07:49 -07002521 .. versionadded:: 3.3
Victor Stinner6d4f4fe2014-07-24 12:42:16 +02002522 Added the :attr:`st_atime_ns`, :attr:`st_mtime_ns`, and
2523 :attr:`st_ctime_ns` members.
Larry Hastings6fe20b32012-04-19 15:07:49 -07002524
Zachary Ware63f277b2014-06-19 09:46:37 -05002525 .. versionadded:: 3.5
2526 Added the :attr:`st_file_attributes` member on Windows.
2527
jcea6c51d512018-01-28 14:00:08 +01002528 .. versionadded:: 3.7
2529 Added the :attr:`st_fstype` member to Solaris/derivatives.
Georg Brandl116aa622007-08-15 14:28:22 +00002530
Georg Brandl116aa622007-08-15 14:28:22 +00002531.. function:: statvfs(path)
2532
Georg Brandl60203b42010-10-06 10:11:56 +00002533 Perform a :c:func:`statvfs` system call on the given path. The return value is
Georg Brandl116aa622007-08-15 14:28:22 +00002534 an object whose attributes describe the filesystem on the given path, and
Georg Brandl60203b42010-10-06 10:11:56 +00002535 correspond to the members of the :c:type:`statvfs` structure, namely:
Georg Brandl116aa622007-08-15 14:28:22 +00002536 :attr:`f_bsize`, :attr:`f_frsize`, :attr:`f_blocks`, :attr:`f_bfree`,
2537 :attr:`f_bavail`, :attr:`f_files`, :attr:`f_ffree`, :attr:`f_favail`,
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002538 :attr:`f_flag`, :attr:`f_namemax`, :attr:`f_fsid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002539
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002540 Two module-level constants are defined for the :attr:`f_flag` attribute's
2541 bit-flags: if :const:`ST_RDONLY` is set, the filesystem is mounted
2542 read-only, and if :const:`ST_NOSUID` is set, the semantics of
2543 setuid/setgid bits are disabled or not supported.
2544
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002545 Additional module-level constants are defined for GNU/glibc based systems.
2546 These are :const:`ST_NODEV` (disallow access to device special files),
2547 :const:`ST_NOEXEC` (disallow program execution), :const:`ST_SYNCHRONOUS`
2548 (writes are synced at once), :const:`ST_MANDLOCK` (allow mandatory locks on an FS),
2549 :const:`ST_WRITE` (write on file/directory/symlink), :const:`ST_APPEND`
2550 (append-only file), :const:`ST_IMMUTABLE` (immutable file), :const:`ST_NOATIME`
2551 (do not update access times), :const:`ST_NODIRATIME` (do not update directory access
2552 times), :const:`ST_RELATIME` (update atime relative to mtime/ctime).
2553
Georg Brandl50c40002012-06-24 11:45:20 +02002554 This function can support :ref:`specifying a file descriptor <path_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002555
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002556 Availability: Unix.
2557
Andrew M. Kuchling4ea04a32010-08-18 22:30:34 +00002558 .. versionchanged:: 3.2
2559 The :const:`ST_RDONLY` and :const:`ST_NOSUID` constants were added.
2560
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002561 .. versionadded:: 3.3
2562 Added support for specifying an open file descriptor for *path*.
2563
doko@ubuntu.comca616a22013-12-08 15:23:07 +01002564 .. versionchanged:: 3.4
2565 The :const:`ST_NODEV`, :const:`ST_NOEXEC`, :const:`ST_SYNCHRONOUS`,
2566 :const:`ST_MANDLOCK`, :const:`ST_WRITE`, :const:`ST_APPEND`,
2567 :const:`ST_IMMUTABLE`, :const:`ST_NOATIME`, :const:`ST_NODIRATIME`,
2568 and :const:`ST_RELATIME` constants were added.
2569
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002570 .. versionchanged:: 3.6
2571 Accepts a :term:`path-like object`.
Georg Brandl116aa622007-08-15 14:28:22 +00002572
Giuseppe Scrivano96a5e502017-12-14 23:46:46 +01002573 .. versionadded:: 3.7
2574 Added :attr:`f_fsid`.
2575
Larry Hastings9cf065c2012-06-22 16:30:09 -07002576
2577.. data:: supports_dir_fd
2578
Serhiy Storchakadab83542013-10-13 20:12:43 +03002579 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002580 :mod:`os` module permit use of their *dir_fd* parameter. Different platforms
Larry Hastings9cf065c2012-06-22 16:30:09 -07002581 provide different functionality, and an option that might work on one might
2582 be unsupported on another. For consistency's sakes, functions that support
Andrew Svetlov5b898402012-12-18 21:26:36 +02002583 *dir_fd* always allow specifying the parameter, but will raise an exception
Larry Hastings9cf065c2012-06-22 16:30:09 -07002584 if the functionality is not actually available.
2585
2586 To check whether a particular function permits use of its *dir_fd*
2587 parameter, use the ``in`` operator on ``supports_dir_fd``. As an example,
2588 this expression determines whether the *dir_fd* parameter of :func:`os.stat`
2589 is locally available::
2590
2591 os.stat in os.supports_dir_fd
2592
Georg Brandlf62445a2012-06-24 13:31:20 +02002593 Currently *dir_fd* parameters only work on Unix platforms; none of them work
2594 on Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002595
2596 .. versionadded:: 3.3
2597
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002598
Larry Hastings9cf065c2012-06-22 16:30:09 -07002599.. data:: supports_effective_ids
2600
Serhiy Storchakadab83542013-10-13 20:12:43 +03002601 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002602 :mod:`os` module permit use of the *effective_ids* parameter for
2603 :func:`os.access`. If the local platform supports it, the collection will
2604 contain :func:`os.access`, otherwise it will be empty.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002605
Georg Brandl50c40002012-06-24 11:45:20 +02002606 To check whether you can use the *effective_ids* parameter for
Berker Peksag4d6c6062015-02-16 03:36:10 +02002607 :func:`os.access`, use the ``in`` operator on ``supports_effective_ids``,
2608 like so::
Larry Hastings9cf065c2012-06-22 16:30:09 -07002609
2610 os.access in os.supports_effective_ids
2611
Georg Brandl50c40002012-06-24 11:45:20 +02002612 Currently *effective_ids* only works on Unix platforms; it does not work on
2613 Windows.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002614
2615 .. versionadded:: 3.3
2616
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002617
Larry Hastings9cf065c2012-06-22 16:30:09 -07002618.. data:: supports_fd
2619
Serhiy Storchakadab83542013-10-13 20:12:43 +03002620 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002621 :mod:`os` module permit specifying their *path* parameter as an open file
Larry Hastings9cf065c2012-06-22 16:30:09 -07002622 descriptor. Different platforms provide different functionality, and an
2623 option that might work on one might be unsupported on another. For
2624 consistency's sakes, functions that support *fd* always allow specifying
Andrew Svetlov5b898402012-12-18 21:26:36 +02002625 the parameter, but will raise an exception if the functionality is not
Larry Hastings9cf065c2012-06-22 16:30:09 -07002626 actually available.
2627
2628 To check whether a particular function permits specifying an open file
2629 descriptor for its *path* parameter, use the ``in`` operator on
2630 ``supports_fd``. As an example, this expression determines whether
2631 :func:`os.chdir` accepts open file descriptors when called on your local
2632 platform::
2633
2634 os.chdir in os.supports_fd
2635
2636 .. versionadded:: 3.3
2637
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002638
Larry Hastings9cf065c2012-06-22 16:30:09 -07002639.. data:: supports_follow_symlinks
2640
Serhiy Storchakadab83542013-10-13 20:12:43 +03002641 A :class:`~collections.abc.Set` object indicating which functions in the
Georg Brandlaceaf902012-06-25 08:33:56 +02002642 :mod:`os` module permit use of their *follow_symlinks* parameter. Different
Larry Hastings9cf065c2012-06-22 16:30:09 -07002643 platforms provide different functionality, and an option that might work on
2644 one might be unsupported on another. For consistency's sakes, functions that
2645 support *follow_symlinks* always allow specifying the parameter, but will
Andrew Svetlov5b898402012-12-18 21:26:36 +02002646 raise an exception if the functionality is not actually available.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002647
2648 To check whether a particular function permits use of its *follow_symlinks*
2649 parameter, use the ``in`` operator on ``supports_follow_symlinks``. As an
2650 example, this expression determines whether the *follow_symlinks* parameter
2651 of :func:`os.stat` is locally available::
2652
2653 os.stat in os.supports_follow_symlinks
2654
2655 .. versionadded:: 3.3
2656
Georg Brandl8ccadaa2012-06-24 12:50:06 +02002657
Martin Panterbf19d162015-09-09 01:01:13 +00002658.. function:: symlink(src, dst, target_is_directory=False, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002659
Martin Panterbf19d162015-09-09 01:01:13 +00002660 Create a symbolic link pointing to *src* named *dst*.
Brian Curtinc7395692010-07-09 15:15:09 +00002661
Larry Hastings9cf065c2012-06-22 16:30:09 -07002662 On Windows, a symlink represents either a file or a directory, and does not
Jason R. Coombs3a092862013-05-27 23:21:28 -04002663 morph to the target dynamically. If the target is present, the type of the
2664 symlink will be created to match. Otherwise, the symlink will be created
2665 as a directory if *target_is_directory* is ``True`` or a file symlink (the
2666 default) otherwise. On non-Window platforms, *target_is_directory* is ignored.
Brian Curtind40e6f72010-07-08 21:39:08 +00002667
Georg Brandl64a41ed2010-10-06 08:52:48 +00002668 Symbolic link support was introduced in Windows 6.0 (Vista). :func:`symlink`
2669 will raise a :exc:`NotImplementedError` on Windows versions earlier than 6.0.
Brian Curtin52173d42010-12-02 18:29:18 +00002670
Georg Brandl50c40002012-06-24 11:45:20 +02002671 This function can support :ref:`paths relative to directory descriptors
2672 <dir_fd>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002673
Brian Curtin52173d42010-12-02 18:29:18 +00002674 .. note::
2675
Larry Hastings9cf065c2012-06-22 16:30:09 -07002676 On Windows, the *SeCreateSymbolicLinkPrivilege* is required in order to
2677 successfully create symlinks. This privilege is not typically granted to
2678 regular users but is available to accounts which can escalate privileges
2679 to the administrator level. Either obtaining the privilege or running your
Brian Curtin96245592010-12-28 17:08:22 +00002680 application as an administrator are ways to successfully create symlinks.
2681
Jason R. Coombs3a092862013-05-27 23:21:28 -04002682
Brian Curtin96245592010-12-28 17:08:22 +00002683 :exc:`OSError` is raised when the function is called by an unprivileged
2684 user.
Brian Curtind40e6f72010-07-08 21:39:08 +00002685
Georg Brandl64a41ed2010-10-06 08:52:48 +00002686 Availability: Unix, Windows.
Brian Curtinc7395692010-07-09 15:15:09 +00002687
Georg Brandlb3823372010-07-10 08:58:37 +00002688 .. versionchanged:: 3.2
2689 Added support for Windows 6.0 (Vista) symbolic links.
Georg Brandl116aa622007-08-15 14:28:22 +00002690
Larry Hastings9cf065c2012-06-22 16:30:09 -07002691 .. versionadded:: 3.3
2692 Added the *dir_fd* argument, and now allow *target_is_directory*
2693 on non-Windows platforms.
2694
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002695 .. versionchanged:: 3.6
2696 Accepts a :term:`path-like object` for *src* and *dst*.
2697
Georg Brandl116aa622007-08-15 14:28:22 +00002698
Ross Lagerwall7807c352011-03-17 20:20:30 +02002699.. function:: sync()
2700
2701 Force write of everything to disk.
2702
2703 Availability: Unix.
2704
2705 .. versionadded:: 3.3
2706
2707
2708.. function:: truncate(path, length)
2709
2710 Truncate the file corresponding to *path*, so that it is at most
2711 *length* bytes in size.
2712
Georg Brandl306336b2012-06-24 12:55:33 +02002713 This function can support :ref:`specifying a file descriptor <path_fd>`.
2714
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002715 Availability: Unix, Windows.
Ross Lagerwall7807c352011-03-17 20:20:30 +02002716
2717 .. versionadded:: 3.3
2718
Steve Dowerfe0a41a2015-03-20 19:50:46 -07002719 .. versionchanged:: 3.5
2720 Added support for Windows
Ross Lagerwall7807c352011-03-17 20:20:30 +02002721
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002722 .. versionchanged:: 3.6
2723 Accepts a :term:`path-like object`.
2724
2725
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002726.. function:: unlink(path, *, dir_fd=None)
Georg Brandl116aa622007-08-15 14:28:22 +00002727
Brett Cannon05039172015-12-28 17:28:19 -08002728 Remove (delete) the file *path*. This function is semantically
2729 identical to :func:`remove`; the ``unlink`` name is its
2730 traditional Unix name. Please see the documentation for
2731 :func:`remove` for further information.
Benjamin Petersonf650e462010-05-06 23:03:05 +00002732
Larry Hastings9cf065c2012-06-22 16:30:09 -07002733 .. versionadded:: 3.3
Larry Hastingsb698d8e2012-06-23 16:55:07 -07002734 The *dir_fd* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +00002735
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002736 .. versionchanged:: 3.6
2737 Accepts a :term:`path-like object`.
2738
Larry Hastings9cf065c2012-06-22 16:30:09 -07002739
Martin Panterbf19d162015-09-09 01:01:13 +00002740.. function:: utime(path, times=None, *[, ns], dir_fd=None, follow_symlinks=True)
Georg Brandl116aa622007-08-15 14:28:22 +00002741
Larry Hastings76ad59b2012-05-03 00:30:07 -07002742 Set the access and modified times of the file specified by *path*.
2743
2744 :func:`utime` takes two optional parameters, *times* and *ns*.
2745 These specify the times set on *path* and are used as follows:
2746
Martin Panterbf19d162015-09-09 01:01:13 +00002747 - If *ns* is specified,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002748 it must be a 2-tuple of the form ``(atime_ns, mtime_ns)``
2749 where each member is an int expressing nanoseconds.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002750 - If *times* is not ``None``,
Larry Hastings76ad59b2012-05-03 00:30:07 -07002751 it must be a 2-tuple of the form ``(atime, mtime)``
2752 where each member is an int or float expressing seconds.
Martin Panterbf19d162015-09-09 01:01:13 +00002753 - If *times* is ``None`` and *ns* is unspecified,
Larry Hastings9cf065c2012-06-22 16:30:09 -07002754 this is equivalent to specifying ``ns=(atime_ns, mtime_ns)``
Larry Hastings76ad59b2012-05-03 00:30:07 -07002755 where both times are the current time.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002756
Larry Hastings9cf065c2012-06-22 16:30:09 -07002757 It is an error to specify tuples for both *times* and *ns*.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002758
2759 Whether a directory can be given for *path*
Brian Curtin52fbea12011-11-06 13:41:17 -06002760 depends on whether the operating system implements directories as files
2761 (for example, Windows does not). Note that the exact times you set here may
2762 not be returned by a subsequent :func:`~os.stat` call, depending on the
2763 resolution with which your operating system records access and modification
Larry Hastings76ad59b2012-05-03 00:30:07 -07002764 times; see :func:`~os.stat`. The best way to preserve exact times is to
2765 use the *st_atime_ns* and *st_mtime_ns* fields from the :func:`os.stat`
2766 result object with the *ns* parameter to `utime`.
Georg Brandl116aa622007-08-15 14:28:22 +00002767
Georg Brandl50c40002012-06-24 11:45:20 +02002768 This function can support :ref:`specifying a file descriptor <path_fd>`,
2769 :ref:`paths relative to directory descriptors <dir_fd>` and :ref:`not
2770 following symlinks <follow_symlinks>`.
Larry Hastings9cf065c2012-06-22 16:30:09 -07002771
Larry Hastings76ad59b2012-05-03 00:30:07 -07002772 .. versionadded:: 3.3
Larry Hastings9cf065c2012-06-22 16:30:09 -07002773 Added support for specifying an open file descriptor for *path*,
2774 and the *dir_fd*, *follow_symlinks*, and *ns* parameters.
Larry Hastings76ad59b2012-05-03 00:30:07 -07002775
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002776 .. versionchanged:: 3.6
2777 Accepts a :term:`path-like object`.
2778
Georg Brandl116aa622007-08-15 14:28:22 +00002779
Georg Brandl18244152009-09-02 20:34:52 +00002780.. function:: walk(top, topdown=True, onerror=None, followlinks=False)
Georg Brandl116aa622007-08-15 14:28:22 +00002781
2782 .. index::
2783 single: directory; walking
2784 single: directory; traversal
2785
Christian Heimesfaf2f632008-01-06 16:59:19 +00002786 Generate the file names in a directory tree by walking the tree
2787 either top-down or bottom-up. For each directory in the tree rooted at directory
Georg Brandl116aa622007-08-15 14:28:22 +00002788 *top* (including *top* itself), it yields a 3-tuple ``(dirpath, dirnames,
2789 filenames)``.
2790
2791 *dirpath* is a string, the path to the directory. *dirnames* is a list of the
2792 names of the subdirectories in *dirpath* (excluding ``'.'`` and ``'..'``).
2793 *filenames* is a list of the names of the non-directory files in *dirpath*.
2794 Note that the names in the lists contain no path components. To get a full path
2795 (which begins with *top*) to a file or directory in *dirpath*, do
2796 ``os.path.join(dirpath, name)``.
2797
Christian Heimesfaf2f632008-01-06 16:59:19 +00002798 If optional argument *topdown* is ``True`` or not specified, the triple for a
Georg Brandl116aa622007-08-15 14:28:22 +00002799 directory is generated before the triples for any of its subdirectories
Benjamin Petersone58e0c72014-06-15 20:51:12 -07002800 (directories are generated top-down). If *topdown* is ``False``, the triple
2801 for a directory is generated after the triples for all of its subdirectories
2802 (directories are generated bottom-up). No matter the value of *topdown*, the
2803 list of subdirectories is retrieved before the tuples for the directory and
2804 its subdirectories are generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002805
Christian Heimesfaf2f632008-01-06 16:59:19 +00002806 When *topdown* is ``True``, the caller can modify the *dirnames* list in-place
Georg Brandl116aa622007-08-15 14:28:22 +00002807 (perhaps using :keyword:`del` or slice assignment), and :func:`walk` will only
2808 recurse into the subdirectories whose names remain in *dirnames*; this can be
2809 used to prune the search, impose a specific order of visiting, or even to inform
2810 :func:`walk` about directories the caller creates or renames before it resumes
Victor Stinner0e316f62015-10-23 12:38:11 +02002811 :func:`walk` again. Modifying *dirnames* when *topdown* is ``False`` has
2812 no effect on the behavior of the walk, because in bottom-up mode the directories
2813 in *dirnames* are generated before *dirpath* itself is generated.
Georg Brandl116aa622007-08-15 14:28:22 +00002814
Andrés Delfinobadb8942018-04-02 23:48:54 -03002815 By default, errors from the :func:`scandir` call are ignored. If optional
Georg Brandl116aa622007-08-15 14:28:22 +00002816 argument *onerror* is specified, it should be a function; it will be called with
2817 one argument, an :exc:`OSError` instance. It can report the error to continue
2818 with the walk, or raise the exception to abort the walk. Note that the filename
2819 is available as the ``filename`` attribute of the exception object.
2820
2821 By default, :func:`walk` will not walk down into symbolic links that resolve to
Christian Heimesfaf2f632008-01-06 16:59:19 +00002822 directories. Set *followlinks* to ``True`` to visit directories pointed to by
Georg Brandl116aa622007-08-15 14:28:22 +00002823 symlinks, on systems that support them.
2824
Georg Brandl116aa622007-08-15 14:28:22 +00002825 .. note::
2826
Georg Brandl50c40002012-06-24 11:45:20 +02002827 Be aware that setting *followlinks* to ``True`` can lead to infinite
2828 recursion if a link points to a parent directory of itself. :func:`walk`
2829 does not keep track of the directories it visited already.
Georg Brandl116aa622007-08-15 14:28:22 +00002830
2831 .. note::
2832
2833 If you pass a relative pathname, don't change the current working directory
2834 between resumptions of :func:`walk`. :func:`walk` never changes the current
2835 directory, and assumes that its caller doesn't either.
2836
2837 This example displays the number of bytes taken by non-directory files in each
2838 directory under the starting directory, except that it doesn't look under any
2839 CVS subdirectory::
2840
2841 import os
2842 from os.path import join, getsize
2843 for root, dirs, files in os.walk('python/Lib/email'):
Georg Brandl6911e3c2007-09-04 07:15:32 +00002844 print(root, "consumes", end=" ")
2845 print(sum(getsize(join(root, name)) for name in files), end=" ")
2846 print("bytes in", len(files), "non-directory files")
Georg Brandl116aa622007-08-15 14:28:22 +00002847 if 'CVS' in dirs:
2848 dirs.remove('CVS') # don't visit CVS directories
2849
Victor Stinner47c41b42015-03-10 13:31:47 +01002850 In the next example (simple implementation of :func:`shutil.rmtree`),
2851 walking the tree bottom-up is essential, :func:`rmdir` doesn't allow
2852 deleting a directory before the directory is empty::
Georg Brandl116aa622007-08-15 14:28:22 +00002853
Christian Heimesfaf2f632008-01-06 16:59:19 +00002854 # Delete everything reachable from the directory named in "top",
Georg Brandl116aa622007-08-15 14:28:22 +00002855 # assuming there are no symbolic links.
2856 # CAUTION: This is dangerous! For example, if top == '/', it
2857 # could delete all your disk files.
2858 import os
2859 for root, dirs, files in os.walk(top, topdown=False):
2860 for name in files:
2861 os.remove(os.path.join(root, name))
2862 for name in dirs:
2863 os.rmdir(os.path.join(root, name))
2864
Victor Stinner524a5ba2015-03-10 13:20:34 +01002865 .. versionchanged:: 3.5
Victor Stinner51b58322015-05-15 09:12:58 +02002866 This function now calls :func:`os.scandir` instead of :func:`os.listdir`,
2867 making it faster by reducing the number of calls to :func:`os.stat`.
Victor Stinner524a5ba2015-03-10 13:20:34 +01002868
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002869 .. versionchanged:: 3.6
2870 Accepts a :term:`path-like object`.
2871
Georg Brandl116aa622007-08-15 14:28:22 +00002872
Larry Hastingsb4038062012-07-15 10:57:38 -07002873.. function:: fwalk(top='.', topdown=True, onerror=None, *, follow_symlinks=False, dir_fd=None)
Charles-François Natali7372b062012-02-05 15:15:38 +01002874
2875 .. index::
2876 single: directory; walking
2877 single: directory; traversal
2878
Eli Benderskyd049d5c2012-02-11 09:52:29 +02002879 This behaves exactly like :func:`walk`, except that it yields a 4-tuple
Larry Hastingsc48fe982012-06-25 04:49:05 -07002880 ``(dirpath, dirnames, filenames, dirfd)``, and it supports ``dir_fd``.
Charles-François Natali7372b062012-02-05 15:15:38 +01002881
2882 *dirpath*, *dirnames* and *filenames* are identical to :func:`walk` output,
2883 and *dirfd* is a file descriptor referring to the directory *dirpath*.
2884
Larry Hastingsc48fe982012-06-25 04:49:05 -07002885 This function always supports :ref:`paths relative to directory descriptors
Larry Hastingsb4038062012-07-15 10:57:38 -07002886 <dir_fd>` and :ref:`not following symlinks <follow_symlinks>`. Note however
Larry Hastings950b76a2012-07-15 17:32:36 -07002887 that, unlike other functions, the :func:`fwalk` default value for
Larry Hastingsb4038062012-07-15 10:57:38 -07002888 *follow_symlinks* is ``False``.
Larry Hastingsc48fe982012-06-25 04:49:05 -07002889
Charles-François Natali7372b062012-02-05 15:15:38 +01002890 .. note::
2891
2892 Since :func:`fwalk` yields file descriptors, those are only valid until
2893 the next iteration step, so you should duplicate them (e.g. with
2894 :func:`dup`) if you want to keep them longer.
2895
2896 This example displays the number of bytes taken by non-directory files in each
2897 directory under the starting directory, except that it doesn't look under any
2898 CVS subdirectory::
2899
2900 import os
2901 for root, dirs, files, rootfd in os.fwalk('python/Lib/email'):
2902 print(root, "consumes", end="")
Hynek Schlawack1729b8f2012-06-24 16:11:08 +02002903 print(sum([os.stat(name, dir_fd=rootfd).st_size for name in files]),
Charles-François Natali7372b062012-02-05 15:15:38 +01002904 end="")
2905 print("bytes in", len(files), "non-directory files")
2906 if 'CVS' in dirs:
2907 dirs.remove('CVS') # don't visit CVS directories
2908
2909 In the next example, walking the tree bottom-up is essential:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002910 :func:`rmdir` doesn't allow deleting a directory before the directory is
Charles-François Natali7372b062012-02-05 15:15:38 +01002911 empty::
2912
2913 # Delete everything reachable from the directory named in "top",
2914 # assuming there are no symbolic links.
2915 # CAUTION: This is dangerous! For example, if top == '/', it
2916 # could delete all your disk files.
2917 import os
2918 for root, dirs, files, rootfd in os.fwalk(top, topdown=False):
2919 for name in files:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002920 os.unlink(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002921 for name in dirs:
Victor Stinner69a6ca52012-08-05 15:18:02 +02002922 os.rmdir(name, dir_fd=rootfd)
Charles-François Natali7372b062012-02-05 15:15:38 +01002923
2924 Availability: Unix.
2925
2926 .. versionadded:: 3.3
2927
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002928 .. versionchanged:: 3.6
2929 Accepts a :term:`path-like object`.
2930
Serhiy Storchaka8f6b3442017-03-07 14:33:21 +02002931 .. versionchanged:: 3.7
2932 Added support for :class:`bytes` paths.
2933
Charles-François Natali7372b062012-02-05 15:15:38 +01002934
Georg Brandlb9831ab2012-06-24 11:57:07 +02002935Linux extended attributes
2936~~~~~~~~~~~~~~~~~~~~~~~~~
2937
2938.. versionadded:: 3.3
2939
2940These functions are all available on Linux only.
2941
2942.. function:: getxattr(path, attribute, *, follow_symlinks=True)
2943
2944 Return the value of the extended filesystem attribute *attribute* for
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002945 *path*. *attribute* can be bytes or str (directly or indirectly through the
2946 :class:`PathLike` interface). If it is str, it is encoded with the filesystem
2947 encoding.
Georg Brandlb9831ab2012-06-24 11:57:07 +02002948
2949 This function can support :ref:`specifying a file descriptor <path_fd>` and
2950 :ref:`not following symlinks <follow_symlinks>`.
2951
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002952 .. versionchanged:: 3.6
Berker Peksagd4d48742017-02-19 03:17:35 +03002953 Accepts a :term:`path-like object` for *path* and *attribute*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002954
Georg Brandlb9831ab2012-06-24 11:57:07 +02002955
2956.. function:: listxattr(path=None, *, follow_symlinks=True)
2957
2958 Return a list of the extended filesystem attributes on *path*. The
2959 attributes in the list are represented as strings decoded with the filesystem
2960 encoding. If *path* is ``None``, :func:`listxattr` will examine the current
2961 directory.
2962
2963 This function can support :ref:`specifying a file descriptor <path_fd>` and
2964 :ref:`not following symlinks <follow_symlinks>`.
2965
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002966 .. versionchanged:: 3.6
2967 Accepts a :term:`path-like object`.
2968
Georg Brandlb9831ab2012-06-24 11:57:07 +02002969
2970.. function:: removexattr(path, attribute, *, follow_symlinks=True)
2971
2972 Removes the extended filesystem attribute *attribute* from *path*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002973 *attribute* should be bytes or str (directly or indirectly through the
2974 :class:`PathLike` interface). If it is a string, it is encoded
Georg Brandlb9831ab2012-06-24 11:57:07 +02002975 with the filesystem encoding.
2976
2977 This function can support :ref:`specifying a file descriptor <path_fd>` and
2978 :ref:`not following symlinks <follow_symlinks>`.
2979
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002980 .. versionchanged:: 3.6
2981 Accepts a :term:`path-like object` for *path* and *attribute*.
2982
Georg Brandlb9831ab2012-06-24 11:57:07 +02002983
2984.. function:: setxattr(path, attribute, value, flags=0, *, follow_symlinks=True)
2985
2986 Set the extended filesystem attribute *attribute* on *path* to *value*.
Brett Cannon6fa7aad2016-09-06 15:55:02 -07002987 *attribute* must be a bytes or str with no embedded NULs (directly or
2988 indirectly through the :class:`PathLike` interface). If it is a str,
Georg Brandlb9831ab2012-06-24 11:57:07 +02002989 it is encoded with the filesystem encoding. *flags* may be
2990 :data:`XATTR_REPLACE` or :data:`XATTR_CREATE`. If :data:`XATTR_REPLACE` is
2991 given and the attribute does not exist, ``EEXISTS`` will be raised.
2992 If :data:`XATTR_CREATE` is given and the attribute already exists, the
2993 attribute will not be created and ``ENODATA`` will be raised.
2994
2995 This function can support :ref:`specifying a file descriptor <path_fd>` and
2996 :ref:`not following symlinks <follow_symlinks>`.
2997
2998 .. note::
2999
3000 A bug in Linux kernel versions less than 2.6.39 caused the flags argument
3001 to be ignored on some filesystems.
3002
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003003 .. versionchanged:: 3.6
3004 Accepts a :term:`path-like object` for *path* and *attribute*.
3005
Georg Brandlb9831ab2012-06-24 11:57:07 +02003006
3007.. data:: XATTR_SIZE_MAX
3008
3009 The maximum size the value of an extended attribute can be. Currently, this
Serhiy Storchakaf8def282013-02-16 17:29:56 +02003010 is 64 KiB on Linux.
Georg Brandlb9831ab2012-06-24 11:57:07 +02003011
3012
3013.. data:: XATTR_CREATE
3014
3015 This is a possible value for the flags argument in :func:`setxattr`. It
3016 indicates the operation must create an attribute.
3017
3018
3019.. data:: XATTR_REPLACE
3020
3021 This is a possible value for the flags argument in :func:`setxattr`. It
3022 indicates the operation must replace an existing attribute.
3023
3024
Georg Brandl116aa622007-08-15 14:28:22 +00003025.. _os-process:
3026
3027Process Management
3028------------------
3029
3030These functions may be used to create and manage processes.
3031
Serhiy Storchakadab83542013-10-13 20:12:43 +03003032The various :func:`exec\* <execl>` functions take a list of arguments for the new
Georg Brandl116aa622007-08-15 14:28:22 +00003033program loaded into the process. In each case, the first of these arguments is
3034passed to the new program as its own name rather than as an argument a user may
3035have typed on a command line. For the C programmer, this is the ``argv[0]``
Georg Brandl60203b42010-10-06 10:11:56 +00003036passed to a program's :c:func:`main`. For example, ``os.execv('/bin/echo',
Georg Brandl116aa622007-08-15 14:28:22 +00003037['foo', 'bar'])`` will only print ``bar`` on standard output; ``foo`` will seem
3038to be ignored.
3039
3040
3041.. function:: abort()
3042
3043 Generate a :const:`SIGABRT` signal to the current process. On Unix, the default
3044 behavior is to produce a core dump; on Windows, the process immediately returns
Victor Stinner6e2e3b92011-07-08 02:26:39 +02003045 an exit code of ``3``. Be aware that calling this function will not call the
3046 Python signal handler registered for :const:`SIGABRT` with
3047 :func:`signal.signal`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003048
Georg Brandl116aa622007-08-15 14:28:22 +00003049
3050.. function:: execl(path, arg0, arg1, ...)
3051 execle(path, arg0, arg1, ..., env)
3052 execlp(file, arg0, arg1, ...)
3053 execlpe(file, arg0, arg1, ..., env)
3054 execv(path, args)
3055 execve(path, args, env)
3056 execvp(file, args)
3057 execvpe(file, args, env)
3058
3059 These functions all execute a new program, replacing the current process; they
3060 do not return. On Unix, the new executable is loaded into the current process,
Christian Heimesfaf2f632008-01-06 16:59:19 +00003061 and will have the same process id as the caller. Errors will be reported as
Georg Brandl48310cd2009-01-03 21:18:54 +00003062 :exc:`OSError` exceptions.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003063
3064 The current process is replaced immediately. Open file objects and
3065 descriptors are not flushed, so if there may be data buffered
3066 on these open files, you should flush them using
3067 :func:`sys.stdout.flush` or :func:`os.fsync` before calling an
Serhiy Storchakadab83542013-10-13 20:12:43 +03003068 :func:`exec\* <execl>` function.
Georg Brandl116aa622007-08-15 14:28:22 +00003069
Serhiy Storchakadab83542013-10-13 20:12:43 +03003070 The "l" and "v" variants of the :func:`exec\* <execl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003071 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003072 to work with if the number of parameters is fixed when the code is written; the
3073 individual parameters simply become additional parameters to the :func:`execl\*`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003074 functions. The "v" variants are good when the number of parameters is
Georg Brandl116aa622007-08-15 14:28:22 +00003075 variable, with the arguments being passed in a list or tuple as the *args*
3076 parameter. In either case, the arguments to the child process should start with
3077 the name of the command being run, but this is not enforced.
3078
Christian Heimesfaf2f632008-01-06 16:59:19 +00003079 The variants which include a "p" near the end (:func:`execlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003080 :func:`execlpe`, :func:`execvp`, and :func:`execvpe`) will use the
3081 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003082 environment is being replaced (using one of the :func:`exec\*e <execl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003083 discussed in the next paragraph), the new environment is used as the source of
3084 the :envvar:`PATH` variable. The other variants, :func:`execl`, :func:`execle`,
3085 :func:`execv`, and :func:`execve`, will not use the :envvar:`PATH` variable to
3086 locate the executable; *path* must contain an appropriate absolute or relative
3087 path.
3088
3089 For :func:`execle`, :func:`execlpe`, :func:`execve`, and :func:`execvpe` (note
Christian Heimesfaf2f632008-01-06 16:59:19 +00003090 that these all end in "e"), the *env* parameter must be a mapping which is
Christian Heimesa342c012008-04-20 21:01:16 +00003091 used to define the environment variables for the new process (these are used
3092 instead of the current process' environment); the functions :func:`execl`,
Georg Brandl116aa622007-08-15 14:28:22 +00003093 :func:`execlp`, :func:`execv`, and :func:`execvp` all cause the new process to
Georg Brandl48310cd2009-01-03 21:18:54 +00003094 inherit the environment of the current process.
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003095
Larry Hastings9cf065c2012-06-22 16:30:09 -07003096 For :func:`execve` on some platforms, *path* may also be specified as an open
3097 file descriptor. This functionality may not be supported on your platform;
3098 you can check whether or not it is available using :data:`os.supports_fd`.
3099 If it is unavailable, using it will raise a :exc:`NotImplementedError`.
3100
Benjamin Petersone9bbc8b2008-09-28 02:06:32 +00003101 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003102
Larry Hastings9cf065c2012-06-22 16:30:09 -07003103 .. versionadded:: 3.3
3104 Added support for specifying an open file descriptor for *path*
3105 for :func:`execve`.
Georg Brandl116aa622007-08-15 14:28:22 +00003106
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003107 .. versionchanged:: 3.6
3108 Accepts a :term:`path-like object`.
3109
Georg Brandl116aa622007-08-15 14:28:22 +00003110.. function:: _exit(n)
3111
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003112 Exit the process with status *n*, without calling cleanup handlers, flushing
Benjamin Petersonf650e462010-05-06 23:03:05 +00003113 stdio buffers, etc.
3114
Georg Brandl116aa622007-08-15 14:28:22 +00003115 .. note::
3116
Georg Brandl6f4e68d2010-10-17 10:51:45 +00003117 The standard way to exit is ``sys.exit(n)``. :func:`_exit` should
3118 normally only be used in the child process after a :func:`fork`.
Georg Brandl116aa622007-08-15 14:28:22 +00003119
Christian Heimesfaf2f632008-01-06 16:59:19 +00003120The following exit codes are defined and can be used with :func:`_exit`,
Georg Brandl116aa622007-08-15 14:28:22 +00003121although they are not required. These are typically used for system programs
3122written in Python, such as a mail server's external command delivery program.
3123
3124.. note::
3125
3126 Some of these may not be available on all Unix platforms, since there is some
3127 variation. These constants are defined where they are defined by the underlying
3128 platform.
3129
3130
3131.. data:: EX_OK
3132
Benjamin Petersonf650e462010-05-06 23:03:05 +00003133 Exit code that means no error occurred.
3134
3135 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003136
Georg Brandl116aa622007-08-15 14:28:22 +00003137
3138.. data:: EX_USAGE
3139
3140 Exit code that means the command was used incorrectly, such as when the wrong
Benjamin Petersonf650e462010-05-06 23:03:05 +00003141 number of arguments are given.
3142
3143 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003144
Georg Brandl116aa622007-08-15 14:28:22 +00003145
3146.. data:: EX_DATAERR
3147
Benjamin Petersonf650e462010-05-06 23:03:05 +00003148 Exit code that means the input data was incorrect.
3149
3150 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003151
Georg Brandl116aa622007-08-15 14:28:22 +00003152
3153.. data:: EX_NOINPUT
3154
3155 Exit code that means an input file did not exist or was not readable.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003156
Georg Brandlc575c902008-09-13 17:46:05 +00003157 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003158
Georg Brandl116aa622007-08-15 14:28:22 +00003159
3160.. data:: EX_NOUSER
3161
Benjamin Petersonf650e462010-05-06 23:03:05 +00003162 Exit code that means a specified user did not exist.
3163
3164 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003165
Georg Brandl116aa622007-08-15 14:28:22 +00003166
3167.. data:: EX_NOHOST
3168
Benjamin Petersonf650e462010-05-06 23:03:05 +00003169 Exit code that means a specified host did not exist.
3170
3171 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003172
Georg Brandl116aa622007-08-15 14:28:22 +00003173
3174.. data:: EX_UNAVAILABLE
3175
Benjamin Petersonf650e462010-05-06 23:03:05 +00003176 Exit code that means that a required service is unavailable.
3177
3178 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003179
Georg Brandl116aa622007-08-15 14:28:22 +00003180
3181.. data:: EX_SOFTWARE
3182
Benjamin Petersonf650e462010-05-06 23:03:05 +00003183 Exit code that means an internal software error was detected.
3184
3185 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003186
Georg Brandl116aa622007-08-15 14:28:22 +00003187
3188.. data:: EX_OSERR
3189
3190 Exit code that means an operating system error was detected, such as the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003191 inability to fork or create a pipe.
3192
3193 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003194
Georg Brandl116aa622007-08-15 14:28:22 +00003195
3196.. data:: EX_OSFILE
3197
3198 Exit code that means some system file did not exist, could not be opened, or had
Benjamin Petersonf650e462010-05-06 23:03:05 +00003199 some other kind of error.
3200
3201 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003202
Georg Brandl116aa622007-08-15 14:28:22 +00003203
3204.. data:: EX_CANTCREAT
3205
3206 Exit code that means a user specified output file could not be created.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003207
Georg Brandlc575c902008-09-13 17:46:05 +00003208 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003209
Georg Brandl116aa622007-08-15 14:28:22 +00003210
3211.. data:: EX_IOERR
3212
3213 Exit code that means that an error occurred while doing I/O on some file.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003214
Georg Brandlc575c902008-09-13 17:46:05 +00003215 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003216
Georg Brandl116aa622007-08-15 14:28:22 +00003217
3218.. data:: EX_TEMPFAIL
3219
3220 Exit code that means a temporary failure occurred. This indicates something
3221 that may not really be an error, such as a network connection that couldn't be
Benjamin Petersonf650e462010-05-06 23:03:05 +00003222 made during a retryable operation.
3223
3224 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003225
Georg Brandl116aa622007-08-15 14:28:22 +00003226
3227.. data:: EX_PROTOCOL
3228
3229 Exit code that means that a protocol exchange was illegal, invalid, or not
Benjamin Petersonf650e462010-05-06 23:03:05 +00003230 understood.
3231
3232 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003233
Georg Brandl116aa622007-08-15 14:28:22 +00003234
3235.. data:: EX_NOPERM
3236
3237 Exit code that means that there were insufficient permissions to perform the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003238 operation (but not intended for file system problems).
3239
3240 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003241
Georg Brandl116aa622007-08-15 14:28:22 +00003242
3243.. data:: EX_CONFIG
3244
3245 Exit code that means that some kind of configuration error occurred.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003246
Georg Brandlc575c902008-09-13 17:46:05 +00003247 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003248
Georg Brandl116aa622007-08-15 14:28:22 +00003249
3250.. data:: EX_NOTFOUND
3251
Benjamin Petersonf650e462010-05-06 23:03:05 +00003252 Exit code that means something like "an entry was not found".
3253
3254 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003255
Georg Brandl116aa622007-08-15 14:28:22 +00003256
3257.. function:: fork()
3258
Christian Heimesfaf2f632008-01-06 16:59:19 +00003259 Fork a child process. Return ``0`` in the child and the child's process id in the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003260 parent. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003261
Larry Hastings3732ed22014-03-15 21:13:56 -07003262 Note that some platforms including FreeBSD <= 6.3 and Cygwin have
Benjamin Petersonbcd8ac32008-10-10 22:20:52 +00003263 known issues when using fork() from a thread.
3264
Christian Heimes3046fe42013-10-29 21:08:56 +01003265 .. warning::
3266
3267 See :mod:`ssl` for applications that use the SSL module with fork().
3268
Georg Brandlc575c902008-09-13 17:46:05 +00003269 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003270
3271
3272.. function:: forkpty()
3273
3274 Fork a child process, using a new pseudo-terminal as the child's controlling
3275 terminal. Return a pair of ``(pid, fd)``, where *pid* is ``0`` in the child, the
3276 new child's process id in the parent, and *fd* is the file descriptor of the
3277 master end of the pseudo-terminal. For a more portable approach, use the
Christian Heimesdd15f6c2008-03-16 00:07:10 +00003278 :mod:`pty` module. If an error occurs :exc:`OSError` is raised.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003279
Georg Brandlc575c902008-09-13 17:46:05 +00003280 Availability: some flavors of Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003281
3282
3283.. function:: kill(pid, sig)
3284
3285 .. index::
3286 single: process; killing
3287 single: process; signalling
3288
3289 Send signal *sig* to the process *pid*. Constants for the specific signals
3290 available on the host platform are defined in the :mod:`signal` module.
Brian Curtineb24d742010-04-12 17:16:38 +00003291
3292 Windows: The :data:`signal.CTRL_C_EVENT` and
3293 :data:`signal.CTRL_BREAK_EVENT` signals are special signals which can
3294 only be sent to console processes which share a common console window,
3295 e.g., some subprocesses. Any other value for *sig* will cause the process
3296 to be unconditionally killed by the TerminateProcess API, and the exit code
3297 will be set to *sig*. The Windows version of :func:`kill` additionally takes
3298 process handles to be killed.
Georg Brandl116aa622007-08-15 14:28:22 +00003299
Victor Stinnerb3e72192011-05-08 01:46:11 +02003300 See also :func:`signal.pthread_kill`.
3301
Georg Brandl67b21b72010-08-17 15:07:14 +00003302 .. versionadded:: 3.2
3303 Windows support.
Brian Curtin904bd392010-04-20 15:28:06 +00003304
Georg Brandl116aa622007-08-15 14:28:22 +00003305
3306.. function:: killpg(pgid, sig)
3307
3308 .. index::
3309 single: process; killing
3310 single: process; signalling
3311
Benjamin Petersonf650e462010-05-06 23:03:05 +00003312 Send the signal *sig* to the process group *pgid*.
3313
3314 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003315
Georg Brandl116aa622007-08-15 14:28:22 +00003316
3317.. function:: nice(increment)
3318
3319 Add *increment* to the process's "niceness". Return the new niceness.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003320
Georg Brandlc575c902008-09-13 17:46:05 +00003321 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003322
3323
3324.. function:: plock(op)
3325
3326 Lock program segments into memory. The value of *op* (defined in
Benjamin Petersonf650e462010-05-06 23:03:05 +00003327 ``<sys/lock.h>``) determines which segments are locked.
3328
3329 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003330
3331
Martin Panterbf19d162015-09-09 01:01:13 +00003332.. function:: popen(cmd, mode='r', buffering=-1)
Georg Brandl116aa622007-08-15 14:28:22 +00003333
Martin Panterbf19d162015-09-09 01:01:13 +00003334 Open a pipe to or from command *cmd*.
3335 The return value is an open file object
Andrew Kuchlingf5a42922014-04-16 09:10:53 -04003336 connected to the pipe, which can be read or written depending on whether *mode*
3337 is ``'r'`` (default) or ``'w'``. The *buffering* argument has the same meaning as
3338 the corresponding argument to the built-in :func:`open` function. The
3339 returned file object reads or writes text strings rather than bytes.
3340
3341 The ``close`` method returns :const:`None` if the subprocess exited
3342 successfully, or the subprocess's return code if there was an
3343 error. On POSIX systems, if the return code is positive it
3344 represents the return value of the process left-shifted by one
3345 byte. If the return code is negative, the process was terminated
3346 by the signal given by the negated value of the return code. (For
3347 example, the return value might be ``- signal.SIGKILL`` if the
3348 subprocess was killed.) On Windows systems, the return value
3349 contains the signed integer return code from the child process.
3350
3351 This is implemented using :class:`subprocess.Popen`; see that class's
3352 documentation for more powerful ways to manage and communicate with
3353 subprocesses.
Georg Brandl116aa622007-08-15 14:28:22 +00003354
3355
Gregory P. Smith79760ed2018-04-01 12:01:48 -07003356.. function:: posix_spawn(path, argv, env, file_actions=None)
3357
3358 Wraps the posix_spawn() C library API for use from Python.
3359
3360 Most users should use :class:`subprocess.run` instead of posix_spawn.
3361
3362 The *path*, *args*, and *env* arguments are similar to :func:`execve`.
3363
3364 The *file_actions* argument may be a sequence of tuples describing actions
3365 to take on specific file descriptors in the child process between the C
3366 library implementation's fork and exec steps. The first item in each tuple
3367 must be one of the three type indicator listed below describing the
3368 remaining tuple elements:
3369
3370 (os.POSIX_SPAWN_OPEN, fd, path, open flags, mode)
3371 (os.POSIX_SPAWN_CLOSE, fd)
3372 (os.POSIX_SPAWN_DUP2, fd, new_fd)
3373
3374 These tuples correspond to the C library posix_spawn_file_actions_addopen,
3375 posix_spawn_file_actions_addclose, and posix_spawn_file_actions_adddup2 API
3376 calls used to prepare for the posix_spawn call itself.
3377
3378 .. versionadded:: 3.7
3379
3380
Gregory P. Smith163468a2017-05-29 10:03:41 -07003381.. function:: register_at_fork(*, before=None, after_in_parent=None, \
3382 after_in_child=None)
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003383
Gregory P. Smith163468a2017-05-29 10:03:41 -07003384 Register callables to be executed when a new child process is forked
3385 using :func:`os.fork` or similar process cloning APIs.
3386 The parameters are optional and keyword-only.
3387 Each specifies a different call point.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003388
Gregory P. Smith163468a2017-05-29 10:03:41 -07003389 * *before* is a function called before forking a child process.
3390 * *after_in_parent* is a function called from the parent process
3391 after forking a child process.
3392 * *after_in_child* is a function called from the child process.
3393
3394 These calls are only made if control is expected to return to the
3395 Python interpreter. A typical :mod:`subprocess` launch will not
3396 trigger them as the child is not going to re-enter the interpreter.
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003397
3398 Functions registered for execution before forking are called in
3399 reverse registration order. Functions registered for execution
3400 after forking (either in the parent or in the child) are called
3401 in registration order.
3402
3403 Note that :c:func:`fork` calls made by third-party C code may not
3404 call those functions, unless it explicitly calls :c:func:`PyOS_BeforeFork`,
3405 :c:func:`PyOS_AfterFork_Parent` and :c:func:`PyOS_AfterFork_Child`.
3406
Gregory P. Smith163468a2017-05-29 10:03:41 -07003407 There is no way to unregister a function.
3408
Antoine Pitrou346cbd32017-05-27 17:50:54 +02003409 Availability: Unix.
3410
3411 .. versionadded:: 3.7
3412
3413
Georg Brandl116aa622007-08-15 14:28:22 +00003414.. function:: spawnl(mode, path, ...)
3415 spawnle(mode, path, ..., env)
3416 spawnlp(mode, file, ...)
3417 spawnlpe(mode, file, ..., env)
3418 spawnv(mode, path, args)
3419 spawnve(mode, path, args, env)
3420 spawnvp(mode, file, args)
3421 spawnvpe(mode, file, args, env)
3422
3423 Execute the program *path* in a new process.
3424
3425 (Note that the :mod:`subprocess` module provides more powerful facilities for
3426 spawning new processes and retrieving their results; using that module is
Benjamin Peterson87c8d872009-06-11 22:54:11 +00003427 preferable to using these functions. Check especially the
3428 :ref:`subprocess-replacements` section.)
Georg Brandl116aa622007-08-15 14:28:22 +00003429
Christian Heimesfaf2f632008-01-06 16:59:19 +00003430 If *mode* is :const:`P_NOWAIT`, this function returns the process id of the new
Georg Brandl116aa622007-08-15 14:28:22 +00003431 process; if *mode* is :const:`P_WAIT`, returns the process's exit code if it
3432 exits normally, or ``-signal``, where *signal* is the signal that killed the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003433 process. On Windows, the process id will actually be the process handle, so can
Georg Brandl116aa622007-08-15 14:28:22 +00003434 be used with the :func:`waitpid` function.
3435
Serhiy Storchakadab83542013-10-13 20:12:43 +03003436 The "l" and "v" variants of the :func:`spawn\* <spawnl>` functions differ in how
Christian Heimesfaf2f632008-01-06 16:59:19 +00003437 command-line arguments are passed. The "l" variants are perhaps the easiest
Georg Brandl116aa622007-08-15 14:28:22 +00003438 to work with if the number of parameters is fixed when the code is written; the
3439 individual parameters simply become additional parameters to the
Christian Heimesfaf2f632008-01-06 16:59:19 +00003440 :func:`spawnl\*` functions. The "v" variants are good when the number of
Georg Brandl116aa622007-08-15 14:28:22 +00003441 parameters is variable, with the arguments being passed in a list or tuple as
3442 the *args* parameter. In either case, the arguments to the child process must
3443 start with the name of the command being run.
3444
Christian Heimesfaf2f632008-01-06 16:59:19 +00003445 The variants which include a second "p" near the end (:func:`spawnlp`,
Georg Brandl116aa622007-08-15 14:28:22 +00003446 :func:`spawnlpe`, :func:`spawnvp`, and :func:`spawnvpe`) will use the
3447 :envvar:`PATH` environment variable to locate the program *file*. When the
Serhiy Storchakadab83542013-10-13 20:12:43 +03003448 environment is being replaced (using one of the :func:`spawn\*e <spawnl>` variants,
Georg Brandl116aa622007-08-15 14:28:22 +00003449 discussed in the next paragraph), the new environment is used as the source of
3450 the :envvar:`PATH` variable. The other variants, :func:`spawnl`,
3451 :func:`spawnle`, :func:`spawnv`, and :func:`spawnve`, will not use the
3452 :envvar:`PATH` variable to locate the executable; *path* must contain an
3453 appropriate absolute or relative path.
3454
3455 For :func:`spawnle`, :func:`spawnlpe`, :func:`spawnve`, and :func:`spawnvpe`
Christian Heimesfaf2f632008-01-06 16:59:19 +00003456 (note that these all end in "e"), the *env* parameter must be a mapping
Christian Heimesa342c012008-04-20 21:01:16 +00003457 which is used to define the environment variables for the new process (they are
3458 used instead of the current process' environment); the functions
Georg Brandl116aa622007-08-15 14:28:22 +00003459 :func:`spawnl`, :func:`spawnlp`, :func:`spawnv`, and :func:`spawnvp` all cause
Benjamin Petersond23f8222009-04-05 19:13:16 +00003460 the new process to inherit the environment of the current process. Note that
3461 keys and values in the *env* dictionary must be strings; invalid keys or
3462 values will cause the function to fail, with a return value of ``127``.
Georg Brandl116aa622007-08-15 14:28:22 +00003463
3464 As an example, the following calls to :func:`spawnlp` and :func:`spawnvpe` are
3465 equivalent::
3466
3467 import os
3468 os.spawnlp(os.P_WAIT, 'cp', 'cp', 'index.html', '/dev/null')
3469
3470 L = ['cp', 'index.html', '/dev/null']
3471 os.spawnvpe(os.P_WAIT, 'cp', L, os.environ)
3472
3473 Availability: Unix, Windows. :func:`spawnlp`, :func:`spawnlpe`, :func:`spawnvp`
Antoine Pitrou0e752dd2011-07-19 01:26:58 +02003474 and :func:`spawnvpe` are not available on Windows. :func:`spawnle` and
3475 :func:`spawnve` are not thread-safe on Windows; we advise you to use the
3476 :mod:`subprocess` module instead.
Georg Brandl116aa622007-08-15 14:28:22 +00003477
Brett Cannon6fa7aad2016-09-06 15:55:02 -07003478 .. versionchanged:: 3.6
3479 Accepts a :term:`path-like object`.
3480
Georg Brandl116aa622007-08-15 14:28:22 +00003481
3482.. data:: P_NOWAIT
3483 P_NOWAITO
3484
Serhiy Storchakadab83542013-10-13 20:12:43 +03003485 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003486 functions. If either of these values is given, the :func:`spawn\*` functions
Christian Heimesfaf2f632008-01-06 16:59:19 +00003487 will return as soon as the new process has been created, with the process id as
Benjamin Petersonf650e462010-05-06 23:03:05 +00003488 the return value.
3489
3490 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003491
Georg Brandl116aa622007-08-15 14:28:22 +00003492
3493.. data:: P_WAIT
3494
Serhiy Storchakadab83542013-10-13 20:12:43 +03003495 Possible value for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003496 functions. If this is given as *mode*, the :func:`spawn\*` functions will not
3497 return until the new process has run to completion and will return the exit code
3498 of the process the run is successful, or ``-signal`` if a signal kills the
Benjamin Petersonf650e462010-05-06 23:03:05 +00003499 process.
3500
3501 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003502
Georg Brandl116aa622007-08-15 14:28:22 +00003503
3504.. data:: P_DETACH
3505 P_OVERLAY
3506
Serhiy Storchakadab83542013-10-13 20:12:43 +03003507 Possible values for the *mode* parameter to the :func:`spawn\* <spawnl>` family of
Georg Brandl116aa622007-08-15 14:28:22 +00003508 functions. These are less portable than those listed above. :const:`P_DETACH`
3509 is similar to :const:`P_NOWAIT`, but the new process is detached from the
3510 console of the calling process. If :const:`P_OVERLAY` is used, the current
Serhiy Storchakadab83542013-10-13 20:12:43 +03003511 process will be replaced; the :func:`spawn\* <spawnl>` function will not return.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003512
Georg Brandl116aa622007-08-15 14:28:22 +00003513 Availability: Windows.
3514
Georg Brandl116aa622007-08-15 14:28:22 +00003515
3516.. function:: startfile(path[, operation])
3517
3518 Start a file with its associated application.
3519
3520 When *operation* is not specified or ``'open'``, this acts like double-clicking
3521 the file in Windows Explorer, or giving the file name as an argument to the
3522 :program:`start` command from the interactive command shell: the file is opened
3523 with whatever application (if any) its extension is associated.
3524
3525 When another *operation* is given, it must be a "command verb" that specifies
3526 what should be done with the file. Common verbs documented by Microsoft are
3527 ``'print'`` and ``'edit'`` (to be used on files) as well as ``'explore'`` and
3528 ``'find'`` (to be used on directories).
3529
3530 :func:`startfile` returns as soon as the associated application is launched.
3531 There is no option to wait for the application to close, and no way to retrieve
3532 the application's exit status. The *path* parameter is relative to the current
3533 directory. If you want to use an absolute path, make sure the first character
Georg Brandl60203b42010-10-06 10:11:56 +00003534 is not a slash (``'/'``); the underlying Win32 :c:func:`ShellExecute` function
Georg Brandl116aa622007-08-15 14:28:22 +00003535 doesn't work if it is. Use the :func:`os.path.normpath` function to ensure that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003536 the path is properly encoded for Win32.
3537
Steve Dower7d0e0c92015-01-24 08:18:24 -08003538 To reduce interpreter startup overhead, the Win32 :c:func:`ShellExecute`
3539 function is not resolved until this function is first called. If the function
3540 cannot be resolved, :exc:`NotImplementedError` will be raised.
3541
Benjamin Petersonf650e462010-05-06 23:03:05 +00003542 Availability: Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003543
Georg Brandl116aa622007-08-15 14:28:22 +00003544
3545.. function:: system(command)
3546
3547 Execute the command (a string) in a subshell. This is implemented by calling
Georg Brandl60203b42010-10-06 10:11:56 +00003548 the Standard C function :c:func:`system`, and has the same limitations.
Georg Brandl8f7b4272010-10-14 06:35:53 +00003549 Changes to :data:`sys.stdin`, etc. are not reflected in the environment of
3550 the executed command. If *command* generates any output, it will be sent to
3551 the interpreter standard output stream.
Georg Brandl116aa622007-08-15 14:28:22 +00003552
3553 On Unix, the return value is the exit status of the process encoded in the
Georg Brandl8f7b4272010-10-14 06:35:53 +00003554 format specified for :func:`wait`. Note that POSIX does not specify the
3555 meaning of the return value of the C :c:func:`system` function, so the return
3556 value of the Python function is system-dependent.
Georg Brandl116aa622007-08-15 14:28:22 +00003557
Georg Brandl8f7b4272010-10-14 06:35:53 +00003558 On Windows, the return value is that returned by the system shell after
3559 running *command*. The shell is given by the Windows environment variable
3560 :envvar:`COMSPEC`: it is usually :program:`cmd.exe`, which returns the exit
3561 status of the command run; on systems using a non-native shell, consult your
3562 shell documentation.
Georg Brandl116aa622007-08-15 14:28:22 +00003563
Georg Brandl8f7b4272010-10-14 06:35:53 +00003564 The :mod:`subprocess` module provides more powerful facilities for spawning
3565 new processes and retrieving their results; using that module is preferable
3566 to using this function. See the :ref:`subprocess-replacements` section in
3567 the :mod:`subprocess` documentation for some helpful recipes.
Georg Brandl116aa622007-08-15 14:28:22 +00003568
Benjamin Petersonf650e462010-05-06 23:03:05 +00003569 Availability: Unix, Windows.
3570
Georg Brandl116aa622007-08-15 14:28:22 +00003571
3572.. function:: times()
3573
Larry Hastings605a62d2012-06-24 04:33:36 -07003574 Returns the current global process times.
3575 The return value is an object with five attributes:
3576
3577 * :attr:`user` - user time
3578 * :attr:`system` - system time
3579 * :attr:`children_user` - user time of all child processes
3580 * :attr:`children_system` - system time of all child processes
3581 * :attr:`elapsed` - elapsed real time since a fixed point in the past
3582
3583 For backwards compatibility, this object also behaves like a five-tuple
3584 containing :attr:`user`, :attr:`system`, :attr:`children_user`,
3585 :attr:`children_system`, and :attr:`elapsed` in that order.
3586
3587 See the Unix manual page
Benjamin Petersonf650e462010-05-06 23:03:05 +00003588 :manpage:`times(2)` or the corresponding Windows Platform API documentation.
Larry Hastings605a62d2012-06-24 04:33:36 -07003589 On Windows, only :attr:`user` and :attr:`system` are known; the other
3590 attributes are zero.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003591
Georg Brandl8a5555f2012-06-24 13:29:09 +02003592 Availability: Unix, Windows.
Georg Brandl116aa622007-08-15 14:28:22 +00003593
Larry Hastings605a62d2012-06-24 04:33:36 -07003594 .. versionchanged:: 3.3
3595 Return type changed from a tuple to a tuple-like object
3596 with named attributes.
3597
Georg Brandl116aa622007-08-15 14:28:22 +00003598
3599.. function:: wait()
3600
3601 Wait for completion of a child process, and return a tuple containing its pid
3602 and exit status indication: a 16-bit number, whose low byte is the signal number
3603 that killed the process, and whose high byte is the exit status (if the signal
3604 number is zero); the high bit of the low byte is set if a core file was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003605 produced.
3606
3607 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003608
Ross Lagerwall7807c352011-03-17 20:20:30 +02003609.. function:: waitid(idtype, id, options)
3610
3611 Wait for the completion of one or more child processes.
3612 *idtype* can be :data:`P_PID`, :data:`P_PGID` or :data:`P_ALL`.
3613 *id* specifies the pid to wait on.
3614 *options* is constructed from the ORing of one or more of :data:`WEXITED`,
3615 :data:`WSTOPPED` or :data:`WCONTINUED` and additionally may be ORed with
3616 :data:`WNOHANG` or :data:`WNOWAIT`. The return value is an object
3617 representing the data contained in the :c:type:`siginfo_t` structure, namely:
3618 :attr:`si_pid`, :attr:`si_uid`, :attr:`si_signo`, :attr:`si_status`,
3619 :attr:`si_code` or ``None`` if :data:`WNOHANG` is specified and there are no
3620 children in a waitable state.
3621
3622 Availability: Unix.
3623
3624 .. versionadded:: 3.3
3625
3626.. data:: P_PID
3627 P_PGID
3628 P_ALL
3629
3630 These are the possible values for *idtype* in :func:`waitid`. They affect
3631 how *id* is interpreted.
3632
3633 Availability: Unix.
3634
3635 .. versionadded:: 3.3
3636
3637.. data:: WEXITED
3638 WSTOPPED
3639 WNOWAIT
3640
3641 Flags that can be used in *options* in :func:`waitid` that specify what
3642 child signal to wait for.
3643
3644 Availability: Unix.
3645
3646 .. versionadded:: 3.3
3647
3648
3649.. data:: CLD_EXITED
3650 CLD_DUMPED
3651 CLD_TRAPPED
3652 CLD_CONTINUED
3653
3654 These are the possible values for :attr:`si_code` in the result returned by
3655 :func:`waitid`.
3656
3657 Availability: Unix.
3658
3659 .. versionadded:: 3.3
3660
Georg Brandl116aa622007-08-15 14:28:22 +00003661
3662.. function:: waitpid(pid, options)
3663
3664 The details of this function differ on Unix and Windows.
3665
3666 On Unix: Wait for completion of a child process given by process id *pid*, and
3667 return a tuple containing its process id and exit status indication (encoded as
3668 for :func:`wait`). The semantics of the call are affected by the value of the
3669 integer *options*, which should be ``0`` for normal operation.
3670
3671 If *pid* is greater than ``0``, :func:`waitpid` requests status information for
3672 that specific process. If *pid* is ``0``, the request is for the status of any
3673 child in the process group of the current process. If *pid* is ``-1``, the
3674 request pertains to any child of the current process. If *pid* is less than
3675 ``-1``, status is requested for any process in the process group ``-pid`` (the
3676 absolute value of *pid*).
3677
Benjamin Peterson4cd6a952008-08-17 20:23:46 +00003678 An :exc:`OSError` is raised with the value of errno when the syscall
3679 returns -1.
3680
Georg Brandl116aa622007-08-15 14:28:22 +00003681 On Windows: Wait for completion of a process given by process handle *pid*, and
3682 return a tuple containing *pid*, and its exit status shifted left by 8 bits
3683 (shifting makes cross-platform use of the function easier). A *pid* less than or
3684 equal to ``0`` has no special meaning on Windows, and raises an exception. The
3685 value of integer *options* has no effect. *pid* can refer to any process whose
Serhiy Storchakadab83542013-10-13 20:12:43 +03003686 id is known, not necessarily a child process. The :func:`spawn\* <spawnl>`
3687 functions called with :const:`P_NOWAIT` return suitable process handles.
Georg Brandl116aa622007-08-15 14:28:22 +00003688
Victor Stinnera766ddf2015-03-26 23:50:57 +01003689 .. versionchanged:: 3.5
Victor Stinner708d9ba2015-04-02 11:49:42 +02003690 If the system call is interrupted and the signal handler does not raise an
Victor Stinnera766ddf2015-03-26 23:50:57 +01003691 exception, the function now retries the system call instead of raising an
3692 :exc:`InterruptedError` exception (see :pep:`475` for the rationale).
3693
Georg Brandl116aa622007-08-15 14:28:22 +00003694
Ezio Melottiba4d8ed2012-11-23 19:45:52 +02003695.. function:: wait3(options)
Georg Brandl116aa622007-08-15 14:28:22 +00003696
3697 Similar to :func:`waitpid`, except no process id argument is given and a
3698 3-element tuple containing the child's process id, exit status indication, and
3699 resource usage information is returned. Refer to :mod:`resource`.\
Serhiy Storchakadab83542013-10-13 20:12:43 +03003700 :func:`~resource.getrusage` for details on resource usage information. The
3701 option argument is the same as that provided to :func:`waitpid` and
3702 :func:`wait4`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003703
Georg Brandl116aa622007-08-15 14:28:22 +00003704 Availability: Unix.
3705
Georg Brandl116aa622007-08-15 14:28:22 +00003706
Victor Stinner4195b5c2012-02-08 23:03:19 +01003707.. function:: wait4(pid, options)
Georg Brandl116aa622007-08-15 14:28:22 +00003708
3709 Similar to :func:`waitpid`, except a 3-element tuple, containing the child's
3710 process id, exit status indication, and resource usage information is returned.
Serhiy Storchakadab83542013-10-13 20:12:43 +03003711 Refer to :mod:`resource`.\ :func:`~resource.getrusage` for details on
3712 resource usage information. The arguments to :func:`wait4` are the same
3713 as those provided to :func:`waitpid`.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003714
3715 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003716
Georg Brandl116aa622007-08-15 14:28:22 +00003717
3718.. data:: WNOHANG
3719
3720 The option for :func:`waitpid` to return immediately if no child process status
3721 is available immediately. The function returns ``(0, 0)`` in this case.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003722
Georg Brandlc575c902008-09-13 17:46:05 +00003723 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003724
3725
3726.. data:: WCONTINUED
3727
3728 This option causes child processes to be reported if they have been continued
Benjamin Petersonf650e462010-05-06 23:03:05 +00003729 from a job control stop since their status was last reported.
3730
Georg Brandl8a5555f2012-06-24 13:29:09 +02003731 Availability: some Unix systems.
Georg Brandl116aa622007-08-15 14:28:22 +00003732
Georg Brandl116aa622007-08-15 14:28:22 +00003733
3734.. data:: WUNTRACED
3735
3736 This option causes child processes to be reported if they have been stopped but
Benjamin Petersonf650e462010-05-06 23:03:05 +00003737 their current state has not been reported since they were stopped.
3738
3739 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003740
Georg Brandl116aa622007-08-15 14:28:22 +00003741
3742The following functions take a process status code as returned by
3743:func:`system`, :func:`wait`, or :func:`waitpid` as a parameter. They may be
3744used to determine the disposition of a process.
3745
Georg Brandl116aa622007-08-15 14:28:22 +00003746.. function:: WCOREDUMP(status)
3747
Christian Heimesfaf2f632008-01-06 16:59:19 +00003748 Return ``True`` if a core dump was generated for the process, otherwise
Benjamin Petersonf650e462010-05-06 23:03:05 +00003749 return ``False``.
3750
3751 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003752
Georg Brandl116aa622007-08-15 14:28:22 +00003753
3754.. function:: WIFCONTINUED(status)
3755
Christian Heimesfaf2f632008-01-06 16:59:19 +00003756 Return ``True`` if the process has been continued from a job control stop,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003757 otherwise return ``False``.
3758
3759 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003760
Georg Brandl116aa622007-08-15 14:28:22 +00003761
3762.. function:: WIFSTOPPED(status)
3763
Christian Heimesfaf2f632008-01-06 16:59:19 +00003764 Return ``True`` if the process has been stopped, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003765 ``False``.
3766
3767 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003768
3769
3770.. function:: WIFSIGNALED(status)
3771
Christian Heimesfaf2f632008-01-06 16:59:19 +00003772 Return ``True`` if the process exited due to a signal, otherwise return
Benjamin Petersonf650e462010-05-06 23:03:05 +00003773 ``False``.
3774
3775 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003776
3777
3778.. function:: WIFEXITED(status)
3779
Christian Heimesfaf2f632008-01-06 16:59:19 +00003780 Return ``True`` if the process exited using the :manpage:`exit(2)` system call,
Benjamin Petersonf650e462010-05-06 23:03:05 +00003781 otherwise return ``False``.
3782
3783 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003784
3785
3786.. function:: WEXITSTATUS(status)
3787
3788 If ``WIFEXITED(status)`` is true, return the integer parameter to the
3789 :manpage:`exit(2)` system call. Otherwise, the return value is meaningless.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003790
Georg Brandlc575c902008-09-13 17:46:05 +00003791 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003792
3793
3794.. function:: WSTOPSIG(status)
3795
Benjamin Petersonf650e462010-05-06 23:03:05 +00003796 Return the signal which caused the process to stop.
3797
3798 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003799
3800
3801.. function:: WTERMSIG(status)
3802
Benjamin Petersonf650e462010-05-06 23:03:05 +00003803 Return the signal which caused the process to exit.
3804
3805 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003806
3807
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003808Interface to the scheduler
3809--------------------------
3810
3811These functions control how a process is allocated CPU time by the operating
3812system. They are only available on some Unix platforms. For more detailed
3813information, consult your Unix manpages.
3814
3815.. versionadded:: 3.3
3816
Andrew Kuchling4921a082013-06-21 11:49:57 -04003817The following scheduling policies are exposed if they are supported by the
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003818operating system.
3819
3820.. data:: SCHED_OTHER
3821
3822 The default scheduling policy.
3823
3824.. data:: SCHED_BATCH
3825
3826 Scheduling policy for CPU-intensive processes that tries to preserve
3827 interactivity on the rest of the computer.
3828
3829.. data:: SCHED_IDLE
3830
3831 Scheduling policy for extremely low priority background tasks.
3832
3833.. data:: SCHED_SPORADIC
3834
3835 Scheduling policy for sporadic server programs.
3836
3837.. data:: SCHED_FIFO
3838
3839 A First In First Out scheduling policy.
3840
3841.. data:: SCHED_RR
3842
3843 A round-robin scheduling policy.
3844
3845.. data:: SCHED_RESET_ON_FORK
3846
Martin Panter8d56c022016-05-29 04:13:35 +00003847 This flag can be OR'ed with any other scheduling policy. When a process with
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003848 this flag set forks, its child's scheduling policy and priority are reset to
3849 the default.
3850
3851
3852.. class:: sched_param(sched_priority)
3853
3854 This class represents tunable scheduling parameters used in
3855 :func:`sched_setparam`, :func:`sched_setscheduler`, and
3856 :func:`sched_getparam`. It is immutable.
3857
3858 At the moment, there is only one possible parameter:
3859
3860 .. attribute:: sched_priority
3861
3862 The scheduling priority for a scheduling policy.
3863
3864
3865.. function:: sched_get_priority_min(policy)
3866
3867 Get the minimum priority value for *policy*. *policy* is one of the
3868 scheduling policy constants above.
3869
3870
3871.. function:: sched_get_priority_max(policy)
3872
3873 Get the maximum priority value for *policy*. *policy* is one of the
3874 scheduling policy constants above.
3875
3876
3877.. function:: sched_setscheduler(pid, policy, param)
3878
3879 Set the scheduling policy for the process with PID *pid*. A *pid* of 0 means
3880 the calling process. *policy* is one of the scheduling policy constants
3881 above. *param* is a :class:`sched_param` instance.
3882
3883
3884.. function:: sched_getscheduler(pid)
3885
3886 Return the scheduling policy for the process with PID *pid*. A *pid* of 0
3887 means the calling process. The result is one of the scheduling policy
3888 constants above.
3889
3890
3891.. function:: sched_setparam(pid, param)
3892
3893 Set a scheduling parameters for the process with PID *pid*. A *pid* of 0 means
3894 the calling process. *param* is a :class:`sched_param` instance.
3895
3896
3897.. function:: sched_getparam(pid)
3898
3899 Return the scheduling parameters as a :class:`sched_param` instance for the
3900 process with PID *pid*. A *pid* of 0 means the calling process.
3901
3902
3903.. function:: sched_rr_get_interval(pid)
3904
3905 Return the round-robin quantum in seconds for the process with PID *pid*. A
3906 *pid* of 0 means the calling process.
3907
3908
3909.. function:: sched_yield()
3910
3911 Voluntarily relinquish the CPU.
3912
3913
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003914.. function:: sched_setaffinity(pid, mask)
3915
Antoine Pitrou84869872012-08-04 16:16:35 +02003916 Restrict the process with PID *pid* (or the current process if zero) to a
3917 set of CPUs. *mask* is an iterable of integers representing the set of
3918 CPUs to which the process should be restricted.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003919
3920
Antoine Pitrou84869872012-08-04 16:16:35 +02003921.. function:: sched_getaffinity(pid)
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003922
Antoine Pitrou84869872012-08-04 16:16:35 +02003923 Return the set of CPUs the process with PID *pid* (or the current process
3924 if zero) is restricted to.
Benjamin Peterson94b580d2011-08-02 17:30:04 -05003925
3926
Georg Brandl116aa622007-08-15 14:28:22 +00003927.. _os-path:
3928
3929Miscellaneous System Information
3930--------------------------------
3931
3932
3933.. function:: confstr(name)
3934
3935 Return string-valued system configuration values. *name* specifies the
3936 configuration value to retrieve; it may be a string which is the name of a
3937 defined system value; these names are specified in a number of standards (POSIX,
3938 Unix 95, Unix 98, and others). Some platforms define additional names as well.
3939 The names known to the host operating system are given as the keys of the
3940 ``confstr_names`` dictionary. For configuration variables not included in that
Benjamin Petersonf650e462010-05-06 23:03:05 +00003941 mapping, passing an integer for *name* is also accepted.
Georg Brandl116aa622007-08-15 14:28:22 +00003942
3943 If the configuration value specified by *name* isn't defined, ``None`` is
3944 returned.
3945
3946 If *name* is a string and is not known, :exc:`ValueError` is raised. If a
3947 specific value for *name* is not supported by the host system, even if it is
3948 included in ``confstr_names``, an :exc:`OSError` is raised with
3949 :const:`errno.EINVAL` for the error number.
3950
Georg Brandl8a5555f2012-06-24 13:29:09 +02003951 Availability: Unix.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003952
Georg Brandl116aa622007-08-15 14:28:22 +00003953
3954.. data:: confstr_names
3955
3956 Dictionary mapping names accepted by :func:`confstr` to the integer values
3957 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00003958 determine the set of names known to the system.
3959
3960 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003961
3962
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003963.. function:: cpu_count()
3964
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03003965 Return the number of CPUs in the system. Returns ``None`` if undetermined.
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003966
Charles-François Natalidc87e4b2015-07-13 21:01:39 +01003967 This number is not equivalent to the number of CPUs the current process can
3968 use. The number of usable CPUs can be obtained with
3969 ``len(os.sched_getaffinity(0))``
3970
3971
Charles-Francois Natali44feda32013-05-20 14:40:46 +02003972 .. versionadded:: 3.4
3973
3974
Georg Brandl116aa622007-08-15 14:28:22 +00003975.. function:: getloadavg()
3976
Christian Heimesa62da1d2008-01-12 19:39:10 +00003977 Return the number of processes in the system run queue averaged over the last
3978 1, 5, and 15 minutes or raises :exc:`OSError` if the load average was
Benjamin Petersonf650e462010-05-06 23:03:05 +00003979 unobtainable.
3980
3981 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003982
Georg Brandl116aa622007-08-15 14:28:22 +00003983
3984.. function:: sysconf(name)
3985
3986 Return integer-valued system configuration values. If the configuration value
3987 specified by *name* isn't defined, ``-1`` is returned. The comments regarding
3988 the *name* parameter for :func:`confstr` apply here as well; the dictionary that
3989 provides information on the known names is given by ``sysconf_names``.
Benjamin Petersonf650e462010-05-06 23:03:05 +00003990
Georg Brandlc575c902008-09-13 17:46:05 +00003991 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00003992
3993
3994.. data:: sysconf_names
3995
3996 Dictionary mapping names accepted by :func:`sysconf` to the integer values
3997 defined for those names by the host operating system. This can be used to
Benjamin Petersonf650e462010-05-06 23:03:05 +00003998 determine the set of names known to the system.
3999
4000 Availability: Unix.
Georg Brandl116aa622007-08-15 14:28:22 +00004001
Christian Heimesfaf2f632008-01-06 16:59:19 +00004002The following data values are used to support path manipulation operations. These
Georg Brandl116aa622007-08-15 14:28:22 +00004003are defined for all platforms.
4004
4005Higher-level operations on pathnames are defined in the :mod:`os.path` module.
4006
4007
4008.. data:: curdir
4009
4010 The constant string used by the operating system to refer to the current
Georg Brandlc575c902008-09-13 17:46:05 +00004011 directory. This is ``'.'`` for Windows and POSIX. Also available via
4012 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004013
4014
4015.. data:: pardir
4016
4017 The constant string used by the operating system to refer to the parent
Georg Brandlc575c902008-09-13 17:46:05 +00004018 directory. This is ``'..'`` for Windows and POSIX. Also available via
4019 :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004020
4021
4022.. data:: sep
4023
Georg Brandlc575c902008-09-13 17:46:05 +00004024 The character used by the operating system to separate pathname components.
4025 This is ``'/'`` for POSIX and ``'\\'`` for Windows. Note that knowing this
4026 is not sufficient to be able to parse or concatenate pathnames --- use
Georg Brandl116aa622007-08-15 14:28:22 +00004027 :func:`os.path.split` and :func:`os.path.join` --- but it is occasionally
4028 useful. Also available via :mod:`os.path`.
4029
4030
4031.. data:: altsep
4032
4033 An alternative character used by the operating system to separate pathname
4034 components, or ``None`` if only one separator character exists. This is set to
4035 ``'/'`` on Windows systems where ``sep`` is a backslash. Also available via
4036 :mod:`os.path`.
4037
4038
4039.. data:: extsep
4040
4041 The character which separates the base filename from the extension; for example,
4042 the ``'.'`` in :file:`os.py`. Also available via :mod:`os.path`.
4043
Georg Brandl116aa622007-08-15 14:28:22 +00004044
4045.. data:: pathsep
4046
4047 The character conventionally used by the operating system to separate search
4048 path components (as in :envvar:`PATH`), such as ``':'`` for POSIX or ``';'`` for
4049 Windows. Also available via :mod:`os.path`.
4050
4051
4052.. data:: defpath
4053
Serhiy Storchakadab83542013-10-13 20:12:43 +03004054 The default search path used by :func:`exec\*p\* <execl>` and
4055 :func:`spawn\*p\* <spawnl>` if the environment doesn't have a ``'PATH'``
4056 key. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004057
4058
4059.. data:: linesep
4060
4061 The string used to separate (or, rather, terminate) lines on the current
Georg Brandlc575c902008-09-13 17:46:05 +00004062 platform. This may be a single character, such as ``'\n'`` for POSIX, or
4063 multiple characters, for example, ``'\r\n'`` for Windows. Do not use
4064 *os.linesep* as a line terminator when writing files opened in text mode (the
4065 default); use a single ``'\n'`` instead, on all platforms.
Georg Brandl116aa622007-08-15 14:28:22 +00004066
4067
4068.. data:: devnull
4069
Georg Brandl850a9902010-05-21 22:04:32 +00004070 The file path of the null device. For example: ``'/dev/null'`` for
4071 POSIX, ``'nul'`` for Windows. Also available via :mod:`os.path`.
Georg Brandl116aa622007-08-15 14:28:22 +00004072
Andrew Kuchling4921a082013-06-21 11:49:57 -04004073.. data:: RTLD_LAZY
4074 RTLD_NOW
4075 RTLD_GLOBAL
4076 RTLD_LOCAL
4077 RTLD_NODELETE
4078 RTLD_NOLOAD
4079 RTLD_DEEPBIND
4080
4081 Flags for use with the :func:`~sys.setdlopenflags` and
4082 :func:`~sys.getdlopenflags` functions. See the Unix manual page
4083 :manpage:`dlopen(3)` for what the different flags mean.
4084
4085 .. versionadded:: 3.3
Georg Brandl116aa622007-08-15 14:28:22 +00004086
Georg Brandl116aa622007-08-15 14:28:22 +00004087
Victor Stinner9b1f4742016-09-06 16:18:52 -07004088Random numbers
4089--------------
Georg Brandl116aa622007-08-15 14:28:22 +00004090
4091
Victor Stinner9b1f4742016-09-06 16:18:52 -07004092.. function:: getrandom(size, flags=0)
Georg Brandl116aa622007-08-15 14:28:22 +00004093
Victor Stinner9b1f4742016-09-06 16:18:52 -07004094 Get up to *size* random bytes. The function can return less bytes than
4095 requested.
4096
4097 These bytes can be used to seed user-space random number generators or for
4098 cryptographic purposes.
4099
4100 ``getrandom()`` relies on entropy gathered from device drivers and other
4101 sources of environmental noise. Unnecessarily reading large quantities of
4102 data will have a negative impact on other users of the ``/dev/random`` and
4103 ``/dev/urandom`` devices.
4104
4105 The flags argument is a bit mask that can contain zero or more of the
4106 following values ORed together: :py:data:`os.GRND_RANDOM` and
4107 :py:data:`GRND_NONBLOCK`.
4108
4109 See also the `Linux getrandom() manual page
4110 <http://man7.org/linux/man-pages/man2/getrandom.2.html>`_.
4111
4112 Availability: Linux 3.17 and newer.
4113
4114 .. versionadded:: 3.6
4115
4116.. function:: urandom(size)
4117
4118 Return a string of *size* random bytes suitable for cryptographic use.
Georg Brandl116aa622007-08-15 14:28:22 +00004119
4120 This function returns random bytes from an OS-specific randomness source. The
4121 returned data should be unpredictable enough for cryptographic applications,
Victor Stinnerdddf4842016-06-07 11:21:42 +02004122 though its exact quality depends on the OS implementation.
4123
Victor Stinnere66987e2016-09-06 16:33:52 -07004124 On Linux, if the ``getrandom()`` syscall is available, it is used in
4125 blocking mode: block until the system urandom entropy pool is initialized
4126 (128 bits of entropy are collected by the kernel). See the :pep:`524` for
4127 the rationale. On Linux, the :func:`getrandom` function can be used to get
4128 random bytes in non-blocking mode (using the :data:`GRND_NONBLOCK` flag) or
4129 to poll until the system urandom entropy pool is initialized.
Andrew Svetlov03cb99c2012-10-16 13:15:06 +03004130
Victor Stinnere66987e2016-09-06 16:33:52 -07004131 On a Unix-like system, random bytes are read from the ``/dev/urandom``
4132 device. If the ``/dev/urandom`` device is not available or not readable, the
4133 :exc:`NotImplementedError` exception is raised.
4134
4135 On Windows, it will use ``CryptGenRandom()``.
4136
4137 .. seealso::
4138 The :mod:`secrets` module provides higher level functions. For an
4139 easy-to-use interface to the random number generator provided by your
4140 platform, please see :class:`random.SystemRandom`.
4141
4142 .. versionchanged:: 3.6.0
4143 On Linux, ``getrandom()`` is now used in blocking mode to increase the
4144 security.
Victor Stinnerace88482015-07-29 02:28:32 +02004145
Victor Stinnerdddf4842016-06-07 11:21:42 +02004146 .. versionchanged:: 3.5.2
Victor Stinner9b1f4742016-09-06 16:18:52 -07004147 On Linux, if the ``getrandom()`` syscall blocks (the urandom entropy pool
4148 is not initialized yet), fall back on reading ``/dev/urandom``.
Victor Stinnerdddf4842016-06-07 11:21:42 +02004149
Victor Stinnerace88482015-07-29 02:28:32 +02004150 .. versionchanged:: 3.5
4151 On Linux 3.17 and newer, the ``getrandom()`` syscall is now used
4152 when available. On OpenBSD 5.6 and newer, the C ``getentropy()``
4153 function is now used. These functions avoid the usage of an internal file
4154 descriptor.
Victor Stinner9b1f4742016-09-06 16:18:52 -07004155
4156.. data:: GRND_NONBLOCK
4157
4158 By default, when reading from ``/dev/random``, :func:`getrandom` blocks if
4159 no random bytes are available, and when reading from ``/dev/urandom``, it blocks
4160 if the entropy pool has not yet been initialized.
4161
4162 If the :py:data:`GRND_NONBLOCK` flag is set, then :func:`getrandom` does not
4163 block in these cases, but instead immediately raises :exc:`BlockingIOError`.
4164
4165 .. versionadded:: 3.6
4166
4167.. data:: GRND_RANDOM
4168
4169 If this bit is set, then random bytes are drawn from the
4170 ``/dev/random`` pool instead of the ``/dev/urandom`` pool.
4171
4172 .. versionadded:: 3.6