blob: 486c18da4826825f4306ac0779bfd1f32889e2f3 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`tempfile` --- Generate temporary files and directories
2============================================================
3
4.. sectionauthor:: Zack Weinberg <zack@codesourcery.com>
5
6
7.. module:: tempfile
8 :synopsis: Generate temporary files and directories.
9
10
11.. index::
12 pair: temporary; file name
13 pair: temporary; file
14
Raymond Hettingera1993682011-01-27 01:20:32 +000015**Source code:** :source:`Lib/tempfile.py`
16
17--------------
18
Robert Collins2ebdc132015-08-13 11:38:02 +120019This module creates temporary files and directories. It works on all
20supported platforms. :class:`TemporaryFile`, :class:`NamedTemporaryFile`,
21:class:`TemporaryDirectory`, and :class:`SpooledTemporaryFile` are high-level
22interfaces which provide automatic cleanup and can be used as
23context managers. :func:`mkstemp` and
24:func:`mkdtemp` are lower-level functions which require manual cleanup.
Georg Brandl116aa622007-08-15 14:28:22 +000025
Robert Collins2ebdc132015-08-13 11:38:02 +120026All the user-callable functions and constructors take additional arguments which
27allow direct control over the location and name of temporary files and
28directories. Files names used by this module include a string of
29random characters which allows those files to be securely created in
30shared temporary directories.
Christian Heimes81ee3ef2008-05-04 22:42:01 +000031To maintain backward compatibility, the argument order is somewhat odd; it
32is recommended to use keyword arguments for clarity.
Georg Brandl116aa622007-08-15 14:28:22 +000033
Nick Coghlan543af752010-10-24 11:23:25 +000034The module defines the following user-callable items:
Georg Brandl116aa622007-08-15 14:28:22 +000035
Martin Panter9b566c32015-11-07 00:32:50 +000036.. function:: TemporaryFile(mode='w+b', buffering=None, encoding=None, newline=None, suffix=None, prefix=None, dir=None)
Georg Brandl116aa622007-08-15 14:28:22 +000037
Antoine Pitrou11cb9612010-09-15 11:11:28 +000038 Return a :term:`file-like object` that can be used as a temporary storage area.
Robert Collins2ebdc132015-08-13 11:38:02 +120039 The file is created securely, using the same rules as :func:`mkstemp`. It will be destroyed as soon
Georg Brandl116aa622007-08-15 14:28:22 +000040 as it is closed (including an implicit close when the object is garbage
Robert Collins2ebdc132015-08-13 11:38:02 +120041 collected). Under Unix, the directory entry for the file is either not created at all or is removed
Christian Heimes81ee3ef2008-05-04 22:42:01 +000042 immediately after the file is created. Other platforms do not support
43 this; your code should not rely on a temporary file created using this
44 function having or not having a visible name in the file system.
Georg Brandl116aa622007-08-15 14:28:22 +000045
Robert Collins2ebdc132015-08-13 11:38:02 +120046 The resulting object can be used as a context manager (see
47 :ref:`tempfile-examples`). On completion of the context or
48 destruction of the file object the temporary file will be removed
49 from the filesystem.
50
Christian Heimes81ee3ef2008-05-04 22:42:01 +000051 The *mode* parameter defaults to ``'w+b'`` so that the file created can
52 be read and written without being closed. Binary mode is used so that it
53 behaves consistently on all platforms without regard for the data that is
Georg Brandl14dfede2010-05-21 21:12:07 +000054 stored. *buffering*, *encoding* and *newline* are interpreted as for
55 :func:`open`.
Georg Brandl116aa622007-08-15 14:28:22 +000056
Martin Panter9b566c32015-11-07 00:32:50 +000057 The *dir*, *prefix* and *suffix* parameters have the same meaning and
58 defaults as with :func:`mkstemp`.
Georg Brandl116aa622007-08-15 14:28:22 +000059
Christian Heimes7f044312008-01-06 17:05:40 +000060 The returned object is a true file object on POSIX platforms. On other
Georg Brandl502d9a52009-07-26 15:02:41 +000061 platforms, it is a file-like object whose :attr:`!file` attribute is the
Robert Collins2ebdc132015-08-13 11:38:02 +120062 underlying true file object.
Christian Heimes7f044312008-01-06 17:05:40 +000063
Victor Stinnerd967fc92014-06-05 14:27:45 +020064 The :py:data:`os.O_TMPFILE` flag is used if it is available and works
Robert Collins2ebdc132015-08-13 11:38:02 +120065 (Linux-specific, requires Linux kernel 3.11 or later).
Victor Stinnerd967fc92014-06-05 14:27:45 +020066
67 .. versionchanged:: 3.5
68
69 The :py:data:`os.O_TMPFILE` flag is now used if available.
70
Georg Brandl116aa622007-08-15 14:28:22 +000071
Martin Panter9b566c32015-11-07 00:32:50 +000072.. function:: NamedTemporaryFile(mode='w+b', buffering=None, encoding=None, newline=None, suffix=None, prefix=None, dir=None, delete=True)
Georg Brandl116aa622007-08-15 14:28:22 +000073
Christian Heimes81ee3ef2008-05-04 22:42:01 +000074 This function operates exactly as :func:`TemporaryFile` does, except that
75 the file is guaranteed to have a visible name in the file system (on
76 Unix, the directory entry is not unlinked). That name can be retrieved
Martin Panter1f0e1f32016-02-22 10:10:00 +000077 from the :attr:`name` attribute of the returned
78 file-like object. Whether the name can be
Christian Heimes81ee3ef2008-05-04 22:42:01 +000079 used to open the file a second time, while the named temporary file is
80 still open, varies across platforms (it can be so used on Unix; it cannot
81 on Windows NT or later). If *delete* is true (the default), the file is
82 deleted as soon as it is closed.
Georg Brandl502d9a52009-07-26 15:02:41 +000083 The returned object is always a file-like object whose :attr:`!file`
Christian Heimes81ee3ef2008-05-04 22:42:01 +000084 attribute is the underlying true file object. This file-like object can
85 be used in a :keyword:`with` statement, just like a normal file.
Georg Brandl116aa622007-08-15 14:28:22 +000086
Georg Brandl116aa622007-08-15 14:28:22 +000087
Martin Panter9b566c32015-11-07 00:32:50 +000088.. function:: SpooledTemporaryFile(max_size=0, mode='w+b', buffering=None, encoding=None, newline=None, suffix=None, prefix=None, dir=None)
Georg Brandl116aa622007-08-15 14:28:22 +000089
Christian Heimes81ee3ef2008-05-04 22:42:01 +000090 This function operates exactly as :func:`TemporaryFile` does, except that
91 data is spooled in memory until the file size exceeds *max_size*, or
92 until the file's :func:`fileno` method is called, at which point the
93 contents are written to disk and operation proceeds as with
94 :func:`TemporaryFile`.
Georg Brandl116aa622007-08-15 14:28:22 +000095
Christian Heimes81ee3ef2008-05-04 22:42:01 +000096 The resulting file has one additional method, :func:`rollover`, which
97 causes the file to roll over to an on-disk file regardless of its size.
Georg Brandl116aa622007-08-15 14:28:22 +000098
Christian Heimes81ee3ef2008-05-04 22:42:01 +000099 The returned object is a file-like object whose :attr:`_file` attribute
Martin Panter7462b6492015-11-02 03:37:02 +0000100 is either an :class:`io.BytesIO` or :class:`io.StringIO` object (depending on
Serhiy Storchaka4b109cb2013-02-09 11:51:21 +0200101 whether binary or text *mode* was specified) or a true file
Serhiy Storchaka4f169a72013-02-09 11:46:42 +0200102 object, depending on whether :func:`rollover` has been called. This
103 file-like object can be used in a :keyword:`with` statement, just like
104 a normal file.
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000105
R David Murrayca76ea12012-10-06 18:32:39 -0400106 .. versionchanged:: 3.3
107 the truncate method now accepts a ``size`` argument.
108
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000109
Martin Panter9b566c32015-11-07 00:32:50 +0000110.. function:: TemporaryDirectory(suffix=None, prefix=None, dir=None)
Nick Coghlan543af752010-10-24 11:23:25 +0000111
Robert Collins2ebdc132015-08-13 11:38:02 +1200112 This function securely creates a temporary directory using the same rules as :func:`mkdtemp`.
Nick Coghlan543af752010-10-24 11:23:25 +0000113 The resulting object can be used as a context manager (see
Robert Collins2ebdc132015-08-13 11:38:02 +1200114 :ref:`tempfile-examples`). On completion of the context or destruction
R David Murray23686072014-02-05 14:53:40 -0500115 of the temporary directory object the newly created temporary directory
Nick Coghlan543af752010-10-24 11:23:25 +0000116 and all its contents are removed from the filesystem.
117
R David Murray23686072014-02-05 14:53:40 -0500118 The directory name can be retrieved from the :attr:`name` attribute of the
119 returned object. When the returned object is used as a context manager, the
120 :attr:`name` will be assigned to the target of the :keyword:`as` clause in
121 the :keyword:`with` statement, if there is one.
Nick Coghlan543af752010-10-24 11:23:25 +0000122
123 The directory can be explicitly cleaned up by calling the
124 :func:`cleanup` method.
125
126 .. versionadded:: 3.2
127
128
Gregory P. Smithad577b92015-05-22 16:18:14 -0700129.. function:: mkstemp(suffix=None, prefix=None, dir=None, text=False)
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000130
131 Creates a temporary file in the most secure manner possible. There are
132 no race conditions in the file's creation, assuming that the platform
133 properly implements the :const:`os.O_EXCL` flag for :func:`os.open`. The
134 file is readable and writable only by the creating user ID. If the
135 platform uses permission bits to indicate whether a file is executable,
136 the file is executable by no one. The file descriptor is not inherited
137 by child processes.
138
139 Unlike :func:`TemporaryFile`, the user of :func:`mkstemp` is responsible
140 for deleting the temporary file when done with it.
141
Martin Panter9b566c32015-11-07 00:32:50 +0000142 If *suffix* is not ``None``, the file name will end with that suffix,
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000143 otherwise there will be no suffix. :func:`mkstemp` does not put a dot
144 between the file name and the suffix; if you need one, put it at the
145 beginning of *suffix*.
146
Martin Panter9b566c32015-11-07 00:32:50 +0000147 If *prefix* is not ``None``, the file name will begin with that prefix;
148 otherwise, a default prefix is used. The default is the return value of
149 :func:`gettempprefix` or :func:`gettempprefixb`, as appropriate.
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000150
Martin Panter9b566c32015-11-07 00:32:50 +0000151 If *dir* is not ``None``, the file will be created in that directory;
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000152 otherwise, a default directory is used. The default directory is chosen
153 from a platform-dependent list, but the user of the application can
154 control the directory location by setting the *TMPDIR*, *TEMP* or *TMP*
155 environment variables. There is thus no guarantee that the generated
156 filename will have any nice properties, such as not requiring quoting
157 when passed to external commands via ``os.popen()``.
158
Martin Panter9b566c32015-11-07 00:32:50 +0000159 If any of *suffix*, *prefix*, and *dir* are not
160 ``None``, they must be the same type.
Gregory P. Smithad577b92015-05-22 16:18:14 -0700161 If they are bytes, the returned name will be bytes instead of str.
162 If you want to force a bytes return value with otherwise default behavior,
163 pass ``suffix=b''``.
164
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000165 If *text* is specified, it indicates whether to open the file in binary
166 mode (the default) or text mode. On some platforms, this makes no
167 difference.
168
169 :func:`mkstemp` returns a tuple containing an OS-level handle to an open
170 file (as would be returned by :func:`os.open`) and the absolute pathname
171 of that file, in that order.
172
Gregory P. Smithad577b92015-05-22 16:18:14 -0700173 .. versionchanged:: 3.5
174 *suffix*, *prefix*, and *dir* may now be supplied in bytes in order to
175 obtain a bytes return value. Prior to this, only str was allowed.
176 *suffix* and *prefix* now accept and default to ``None`` to cause
177 an appropriate default value to be used.
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000178
Gregory P. Smithad577b92015-05-22 16:18:14 -0700179
180.. function:: mkdtemp(suffix=None, prefix=None, dir=None)
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000181
182 Creates a temporary directory in the most secure manner possible. There
183 are no race conditions in the directory's creation. The directory is
184 readable, writable, and searchable only by the creating user ID.
185
186 The user of :func:`mkdtemp` is responsible for deleting the temporary
187 directory and its contents when done with it.
188
189 The *prefix*, *suffix*, and *dir* arguments are the same as for
190 :func:`mkstemp`.
Georg Brandl116aa622007-08-15 14:28:22 +0000191
192 :func:`mkdtemp` returns the absolute pathname of the new directory.
193
Gregory P. Smithad577b92015-05-22 16:18:14 -0700194 .. versionchanged:: 3.5
195 *suffix*, *prefix*, and *dir* may now be supplied in bytes in order to
196 obtain a bytes return value. Prior to this, only str was allowed.
197 *suffix* and *prefix* now accept and default to ``None`` to cause
198 an appropriate default value to be used.
199
Georg Brandl116aa622007-08-15 14:28:22 +0000200
Robert Collins2ebdc132015-08-13 11:38:02 +1200201.. function:: gettempdir()
Georg Brandl116aa622007-08-15 14:28:22 +0000202
Robert Collins2ebdc132015-08-13 11:38:02 +1200203 Return the name of the directory used for temporary files. This
204 defines the default value for the *dir* argument to all functions
205 in this module.
Georg Brandl116aa622007-08-15 14:28:22 +0000206
Robert Collins2ebdc132015-08-13 11:38:02 +1200207 Python searches a standard list of directories to find one which
208 the calling user can create files in. The list is:
Georg Brandl116aa622007-08-15 14:28:22 +0000209
210 #. The directory named by the :envvar:`TMPDIR` environment variable.
211
212 #. The directory named by the :envvar:`TEMP` environment variable.
213
214 #. The directory named by the :envvar:`TMP` environment variable.
215
216 #. A platform-specific location:
217
Georg Brandl116aa622007-08-15 14:28:22 +0000218 * On Windows, the directories :file:`C:\\TEMP`, :file:`C:\\TMP`,
219 :file:`\\TEMP`, and :file:`\\TMP`, in that order.
220
221 * On all other platforms, the directories :file:`/tmp`, :file:`/var/tmp`, and
222 :file:`/usr/tmp`, in that order.
223
224 #. As a last resort, the current working directory.
225
Robert Collins2ebdc132015-08-13 11:38:02 +1200226 The result of this search is cached, see the description of
227 :data:`tempdir` below.
Georg Brandl116aa622007-08-15 14:28:22 +0000228
Gregory P. Smithad577b92015-05-22 16:18:14 -0700229.. function:: gettempdirb()
230
231 Same as :func:`gettempdir` but the return value is in bytes.
232
233 .. versionadded:: 3.5
Georg Brandl116aa622007-08-15 14:28:22 +0000234
Georg Brandl116aa622007-08-15 14:28:22 +0000235.. function:: gettempprefix()
236
237 Return the filename prefix used to create temporary files. This does not
Georg Brandl4b26ff82008-08-04 07:24:52 +0000238 contain the directory component.
Georg Brandl116aa622007-08-15 14:28:22 +0000239
Gregory P. Smithad577b92015-05-22 16:18:14 -0700240.. function:: gettempprefixb()
241
Martin Panter9b566c32015-11-07 00:32:50 +0000242 Same as :func:`gettempprefix` but the return value is in bytes.
Gregory P. Smithad577b92015-05-22 16:18:14 -0700243
244 .. versionadded:: 3.5
245
Robert Collins2ebdc132015-08-13 11:38:02 +1200246The module uses a global variable to store the name of the directory
247used for temporary files returned by :func:`gettempdir`. It can be
248set directly to override the selection process, but this is discouraged.
249All functions in this module take a *dir* argument which can be used
250to specify the directory and this is the recommend approach.
251
252.. data:: tempdir
253
254 When set to a value other than ``None``, this variable defines the
255 default value for the *dir* argument to all the functions defined in this
256 module.
257
258 If ``tempdir`` is unset or ``None`` at any call to any of the above
Martin Panter8f265652016-04-19 04:03:41 +0000259 functions except :func:`gettempprefix` it is initialized following the
Robert Collins2ebdc132015-08-13 11:38:02 +1200260 algorithm described in :func:`gettempdir`.
261
262.. _tempfile-examples:
Nick Coghlan543af752010-10-24 11:23:25 +0000263
264Examples
265--------
266
267Here are some examples of typical usage of the :mod:`tempfile` module::
268
269 >>> import tempfile
270
271 # create a temporary file and write some data to it
272 >>> fp = tempfile.TemporaryFile()
Ross Lagerwall810b94a2011-04-10 09:30:04 +0200273 >>> fp.write(b'Hello world!')
Nick Coghlan543af752010-10-24 11:23:25 +0000274 # read data from file
275 >>> fp.seek(0)
276 >>> fp.read()
Ross Lagerwall810b94a2011-04-10 09:30:04 +0200277 b'Hello world!'
Nick Coghlan543af752010-10-24 11:23:25 +0000278 # close the file, it will be removed
279 >>> fp.close()
280
281 # create a temporary file using a context manager
282 >>> with tempfile.TemporaryFile() as fp:
Ross Lagerwall810b94a2011-04-10 09:30:04 +0200283 ... fp.write(b'Hello world!')
Nick Coghlan543af752010-10-24 11:23:25 +0000284 ... fp.seek(0)
285 ... fp.read()
Ross Lagerwall810b94a2011-04-10 09:30:04 +0200286 b'Hello world!'
Nick Coghlan543af752010-10-24 11:23:25 +0000287 >>>
288 # file is now closed and removed
289
290 # create a temporary directory using the context manager
291 >>> with tempfile.TemporaryDirectory() as tmpdirname:
Ross Lagerwall810b94a2011-04-10 09:30:04 +0200292 ... print('created temporary directory', tmpdirname)
Nick Coghlan543af752010-10-24 11:23:25 +0000293 >>>
294 # directory and contents have been removed
295
Robert Collins2ebdc132015-08-13 11:38:02 +1200296
297Deprecated functions and variables
298----------------------------------
299
300A historical way to create temporary files was to first generate a
301file name with the :func:`mktemp` function and then create a file
302using this name. Unfortunately this is not secure, because a different
303process may create a file with this name in the time between the call
304to :func:`mktemp` and the subsequent attempt to create the file by the
305first process. The solution is to combine the two steps and create the
306file immediately. This approach is used by :func:`mkstemp` and the
307other functions described above.
308
309.. function:: mktemp(suffix='', prefix='tmp', dir=None)
310
311 .. deprecated:: 2.3
312 Use :func:`mkstemp` instead.
313
314 Return an absolute pathname of a file that did not exist at the time the
Martin Panter9b566c32015-11-07 00:32:50 +0000315 call is made. The *prefix*, *suffix*, and *dir* arguments are similar
316 to those of :func:`mkstemp`, except that bytes file names, ``suffix=None``
317 and ``prefix=None`` are not supported.
Robert Collins2ebdc132015-08-13 11:38:02 +1200318
319 .. warning::
320
321 Use of this function may introduce a security hole in your program. By
322 the time you get around to doing anything with the file name it returns,
323 someone else may have beaten you to the punch. :func:`mktemp` usage can
324 be replaced easily with :func:`NamedTemporaryFile`, passing it the
325 ``delete=False`` parameter::
326
327 >>> f = NamedTemporaryFile(delete=False)
328 >>> f.name
329 '/tmp/tmptjujjt'
330 >>> f.write(b"Hello World!\n")
331 13
332 >>> f.close()
333 >>> os.unlink(f.name)
334 >>> os.path.exists(f.name)
335 False