blob: 173dfb002bad94d1594dc3349cd413bff687408f [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001:mod:`zipfile` --- Work with ZIP archives
2=========================================
3
4.. module:: zipfile
5 :synopsis: Read and write ZIP-format archive files.
6.. moduleauthor:: James C. Ahlstrom <jim@interet.com>
7.. sectionauthor:: James C. Ahlstrom <jim@interet.com>
8
Georg Brandl8ec7f652007-08-15 14:28:01 +00009.. versionadded:: 1.6
10
Éric Araujo29a0b572011-08-19 02:14:03 +020011**Source code:** :source:`Lib/zipfile.py`
12
13--------------
14
Georg Brandl8ec7f652007-08-15 14:28:01 +000015The ZIP file format is a common archive and compression standard. This module
16provides tools to create, read, write, append, and list a ZIP file. Any
17advanced use of this module will require an understanding of the format, as
18defined in `PKZIP Application Note
Georg Brandl02677812008-03-15 00:20:19 +000019<http://www.pkware.com/documents/casestudies/APPNOTE.TXT>`_.
Georg Brandl8ec7f652007-08-15 14:28:01 +000020
Georg Brandl7d4bfb32010-08-02 21:44:25 +000021This module does not currently handle multi-disk ZIP files.
22It can handle ZIP files that use the ZIP64 extensions
Mark Summerfield91f94292007-11-05 14:38:50 +000023(that is ZIP files that are more than 4 GByte in size). It supports
24decryption of encrypted files in ZIP archives, but it currently cannot
Gregory P. Smithda407232008-01-20 01:32:00 +000025create an encrypted file. Decryption is extremely slow as it is
Georg Brandl8c18a472009-11-18 19:39:14 +000026implemented in native Python rather than C.
Georg Brandl8ec7f652007-08-15 14:28:01 +000027
Mark Summerfieldaea6e592007-11-05 09:22:48 +000028The module defines the following items:
Georg Brandl8ec7f652007-08-15 14:28:01 +000029
30.. exception:: BadZipfile
31
32 The error raised for bad ZIP files (old name: ``zipfile.error``).
33
34
35.. exception:: LargeZipFile
36
37 The error raised when a ZIP file would require ZIP64 functionality but that has
38 not been enabled.
39
40
41.. class:: ZipFile
Georg Brandl3b85b9b2010-11-26 08:20:18 +000042 :noindex:
Georg Brandl8ec7f652007-08-15 14:28:01 +000043
44 The class for reading and writing ZIP files. See section
45 :ref:`zipfile-objects` for constructor details.
46
47
48.. class:: PyZipFile
49
50 Class for creating ZIP archives containing Python libraries.
51
52
53.. class:: ZipInfo([filename[, date_time]])
54
55 Class used to represent information about a member of an archive. Instances
Andrew Svetlov8c441932012-10-06 18:01:05 +030056 of this class are returned by the :meth:`.getinfo` and :meth:`.infolist`
Georg Brandl8ec7f652007-08-15 14:28:01 +000057 methods of :class:`ZipFile` objects. Most users of the :mod:`zipfile` module
58 will not need to create these, but only use those created by this
59 module. *filename* should be the full name of the archive member, and
60 *date_time* should be a tuple containing six fields which describe the time
61 of the last modification to the file; the fields are described in section
62 :ref:`zipinfo-objects`.
63
64
65.. function:: is_zipfile(filename)
66
67 Returns ``True`` if *filename* is a valid ZIP file based on its magic number,
Antoine Pitrou6f193e02008-12-27 15:43:12 +000068 otherwise returns ``False``. *filename* may be a file or file-like object too.
Georg Brandl8ec7f652007-08-15 14:28:01 +000069
Antoine Pitrou6f193e02008-12-27 15:43:12 +000070 .. versionchanged:: 2.7
Benjamin Petersonfbaeca72008-12-27 22:18:58 +000071 Support for file and file-like objects.
Georg Brandl8ec7f652007-08-15 14:28:01 +000072
73.. data:: ZIP_STORED
74
75 The numeric constant for an uncompressed archive member.
76
77
78.. data:: ZIP_DEFLATED
79
80 The numeric constant for the usual ZIP compression method. This requires the
Andrew Svetlov8c441932012-10-06 18:01:05 +030081 :mod:`zlib` module. No other compression methods are currently supported.
Georg Brandl8ec7f652007-08-15 14:28:01 +000082
83
84.. seealso::
85
Georg Brandl02677812008-03-15 00:20:19 +000086 `PKZIP Application Note <http://www.pkware.com/documents/casestudies/APPNOTE.TXT>`_
Georg Brandl8ec7f652007-08-15 14:28:01 +000087 Documentation on the ZIP file format by Phil Katz, the creator of the format and
88 algorithms used.
89
90 `Info-ZIP Home Page <http://www.info-zip.org/>`_
91 Information about the Info-ZIP project's ZIP archive programs and development
92 libraries.
93
94
95.. _zipfile-objects:
96
97ZipFile Objects
98---------------
99
100
101.. class:: ZipFile(file[, mode[, compression[, allowZip64]]])
102
103 Open a ZIP file, where *file* can be either a path to a file (a string) or a
104 file-like object. The *mode* parameter should be ``'r'`` to read an existing
105 file, ``'w'`` to truncate and write a new file, or ``'a'`` to append to an
Ezio Melotti569e61f2009-12-30 06:14:51 +0000106 existing file. If *mode* is ``'a'`` and *file* refers to an existing ZIP
107 file, then additional files are added to it. If *file* does not refer to a
108 ZIP file, then a new ZIP archive is appended to the file. This is meant for
109 adding a ZIP archive to another file (such as :file:`python.exe`).
Georg Brandl8ec7f652007-08-15 14:28:01 +0000110
111 .. versionchanged:: 2.6
Ezio Melotti569e61f2009-12-30 06:14:51 +0000112 If *mode* is ``a`` and the file does not exist at all, it is created.
113
114 *compression* is the ZIP compression method to use when writing the archive,
115 and should be :const:`ZIP_STORED` or :const:`ZIP_DEFLATED`; unrecognized
116 values will cause :exc:`RuntimeError` to be raised. If :const:`ZIP_DEFLATED`
117 is specified but the :mod:`zlib` module is not available, :exc:`RuntimeError`
118 is also raised. The default is :const:`ZIP_STORED`. If *allowZip64* is
119 ``True`` zipfile will create ZIP files that use the ZIP64 extensions when
120 the zipfile is larger than 2 GB. If it is false (the default) :mod:`zipfile`
121 will raise an exception when the ZIP file would require ZIP64 extensions.
122 ZIP64 extensions are disabled by default because the default :program:`zip`
123 and :program:`unzip` commands on Unix (the InfoZIP utilities) don't support
124 these extensions.
125
Georg Brandlda29acd2010-12-21 17:58:06 +0000126 .. versionchanged:: 2.7.1
127 If the file is created with mode ``'a'`` or ``'w'`` and then
Andrew Svetlov8c441932012-10-06 18:01:05 +0300128 :meth:`closed <close>` without adding any files to the archive, the appropriate
Georg Brandlda29acd2010-12-21 17:58:06 +0000129 ZIP structures for an empty archive will be written to the file.
Georg Brandl86e0c892010-11-26 07:22:28 +0000130
Ezio Melotti569e61f2009-12-30 06:14:51 +0000131 ZipFile is also a context manager and therefore supports the
132 :keyword:`with` statement. In the example, *myzip* is closed after the
133 :keyword:`with` statement's suite is finished---even if an exception occurs::
134
135 with ZipFile('spam.zip', 'w') as myzip:
136 myzip.write('eggs.txt')
137
138 .. versionadded:: 2.7
139 Added the ability to use :class:`ZipFile` as a context manager.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000140
141
142.. method:: ZipFile.close()
143
144 Close the archive file. You must call :meth:`close` before exiting your program
145 or essential records will not be written.
146
147
148.. method:: ZipFile.getinfo(name)
149
150 Return a :class:`ZipInfo` object with information about the archive member
151 *name*. Calling :meth:`getinfo` for a name not currently contained in the
152 archive will raise a :exc:`KeyError`.
153
154
155.. method:: ZipFile.infolist()
156
157 Return a list containing a :class:`ZipInfo` object for each member of the
158 archive. The objects are in the same order as their entries in the actual ZIP
159 file on disk if an existing archive was opened.
160
161
162.. method:: ZipFile.namelist()
163
164 Return a list of archive members by name.
165
R David Murray5618aaa2012-08-15 11:15:39 -0400166 .. index::
167 single: universal newlines; zipfile.ZipFile.open method
168
Georg Brandl8ec7f652007-08-15 14:28:01 +0000169
170.. method:: ZipFile.open(name[, mode[, pwd]])
171
172 Extract a member from the archive as a file-like object (ZipExtFile). *name* is
Georg Brandl112aa502008-05-20 08:25:48 +0000173 the name of the file in the archive, or a :class:`ZipInfo` object. The *mode*
R David Murray5618aaa2012-08-15 11:15:39 -0400174 parameter, if included, must be one of the following: ``'r'`` (the default),
175 ``'U'``, or ``'rU'``. Choosing ``'U'`` or ``'rU'`` will enable
176 :term:`universal newline <universal newlines>`
Georg Brandl112aa502008-05-20 08:25:48 +0000177 support in the read-only object. *pwd* is the password used for encrypted files.
Andrew Svetlov8c441932012-10-06 18:01:05 +0300178 Calling :meth:`.open` on a closed ZipFile will raise a :exc:`RuntimeError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000179
180 .. note::
181
182 The file-like object is read-only and provides the following methods:
Serhiy Storchakab33336f2013-10-13 23:09:00 +0300183 :meth:`~file.read`, :meth:`~file.readline`,
184 :meth:`~file.readlines`, :meth:`__iter__`,
185 :meth:`~object.next`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000186
187 .. note::
188
Serhiy Storchakac328d112015-01-26 13:45:04 +0200189 If the ZipFile was created by passing in a file-like object as the first
190 argument to the constructor, then the object returned by :meth:`.open` shares the
191 ZipFile's file pointer. Under these circumstances, the object returned by
192 :meth:`.open` should not be used after any additional operations are performed
193 on the ZipFile object. If the ZipFile was created by passing in a string (the
194 filename) as the first argument to the constructor, then :meth:`.open` will
195 create a new file object that will be held by the ZipExtFile, allowing it to
196 operate independently of the ZipFile.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000197
Georg Brandl112aa502008-05-20 08:25:48 +0000198 .. note::
199
Andrew Svetlov8c441932012-10-06 18:01:05 +0300200 The :meth:`.open`, :meth:`read` and :meth:`extract` methods can take a filename
Georg Brandl112aa502008-05-20 08:25:48 +0000201 or a :class:`ZipInfo` object. You will appreciate this when trying to read a
202 ZIP file that contains members with duplicate names.
203
Georg Brandl8ec7f652007-08-15 14:28:01 +0000204 .. versionadded:: 2.6
205
206
Georg Brandl62416bc2008-01-07 18:47:44 +0000207.. method:: ZipFile.extract(member[, path[, pwd]])
208
Georg Brandl112aa502008-05-20 08:25:48 +0000209 Extract a member from the archive to the current working directory; *member*
210 must be its full name or a :class:`ZipInfo` object). Its file information is
211 extracted as accurately as possible. *path* specifies a different directory
212 to extract to. *member* can be a filename or a :class:`ZipInfo` object.
213 *pwd* is the password used for encrypted files.
Georg Brandl62416bc2008-01-07 18:47:44 +0000214
Zachary Waree093f112015-04-13 16:40:49 -0500215 Returns the normalized path created (a directory or new file).
216
Georg Brandl62416bc2008-01-07 18:47:44 +0000217 .. versionadded:: 2.6
218
Gregory P. Smitha26ec652013-02-07 22:11:03 -0800219 .. note::
220
221 If a member filename is an absolute path, a drive/UNC sharepoint and
222 leading (back)slashes will be stripped, e.g.: ``///foo/bar`` becomes
223 ``foo/bar`` on Unix, and ``C:\foo\bar`` becomes ``foo\bar`` on Windows.
224 And all ``".."`` components in a member filename will be removed, e.g.:
225 ``../../foo../../ba..r`` becomes ``foo../ba..r``. On Windows illegal
226 characters (``:``, ``<``, ``>``, ``|``, ``"``, ``?``, and ``*``)
227 replaced by underscore (``_``).
228
Georg Brandl62416bc2008-01-07 18:47:44 +0000229
230.. method:: ZipFile.extractall([path[, members[, pwd]]])
231
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000232 Extract all members from the archive to the current working directory. *path*
Georg Brandl62416bc2008-01-07 18:47:44 +0000233 specifies a different directory to extract to. *members* is optional and must
234 be a subset of the list returned by :meth:`namelist`. *pwd* is the password
235 used for encrypted files.
236
Gregory P. Smith657024c2009-09-29 21:56:31 +0000237 .. warning::
238
239 Never extract archives from untrusted sources without prior inspection.
240 It is possible that files are created outside of *path*, e.g. members
241 that have absolute filenames starting with ``"/"`` or filenames with two
242 dots ``".."``.
Gregory P. Smithec022172013-02-07 22:18:21 -0800243
Gregory P. Smitha26ec652013-02-07 22:11:03 -0800244 .. versionchanged:: 2.7.4
245 The zipfile module attempts to prevent that. See :meth:`extract` note.
Gregory P. Smith657024c2009-09-29 21:56:31 +0000246
Georg Brandl62416bc2008-01-07 18:47:44 +0000247 .. versionadded:: 2.6
248
249
Georg Brandl8ec7f652007-08-15 14:28:01 +0000250.. method:: ZipFile.printdir()
251
252 Print a table of contents for the archive to ``sys.stdout``.
253
254
255.. method:: ZipFile.setpassword(pwd)
256
257 Set *pwd* as default password to extract encrypted files.
258
259 .. versionadded:: 2.6
260
261
262.. method:: ZipFile.read(name[, pwd])
263
Georg Brandl112aa502008-05-20 08:25:48 +0000264 Return the bytes of the file *name* in the archive. *name* is the name of the
265 file in the archive, or a :class:`ZipInfo` object. The archive must be open for
266 read or append. *pwd* is the password used for encrypted files and, if specified,
267 it will override the default password set with :meth:`setpassword`. Calling
Georg Brandl8ec7f652007-08-15 14:28:01 +0000268 :meth:`read` on a closed ZipFile will raise a :exc:`RuntimeError`.
269
270 .. versionchanged:: 2.6
Georg Brandl112aa502008-05-20 08:25:48 +0000271 *pwd* was added, and *name* can now be a :class:`ZipInfo` object.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000272
273
274.. method:: ZipFile.testzip()
275
276 Read all the files in the archive and check their CRC's and file headers.
277 Return the name of the first bad file, or else return ``None``. Calling
278 :meth:`testzip` on a closed ZipFile will raise a :exc:`RuntimeError`.
279
280
281.. method:: ZipFile.write(filename[, arcname[, compress_type]])
282
283 Write the file named *filename* to the archive, giving it the archive name
284 *arcname* (by default, this will be the same as *filename*, but without a drive
285 letter and with leading path separators removed). If given, *compress_type*
286 overrides the value given for the *compression* parameter to the constructor for
287 the new entry. The archive must be open with mode ``'w'`` or ``'a'`` -- calling
288 :meth:`write` on a ZipFile created with mode ``'r'`` will raise a
289 :exc:`RuntimeError`. Calling :meth:`write` on a closed ZipFile will raise a
290 :exc:`RuntimeError`.
291
292 .. note::
293
294 There is no official file name encoding for ZIP files. If you have unicode file
Georg Brandlf11ed152007-08-30 10:09:42 +0000295 names, you must convert them to byte strings in your desired encoding before
Georg Brandl8ec7f652007-08-15 14:28:01 +0000296 passing them to :meth:`write`. WinZip interprets all file names as encoded in
297 CP437, also known as DOS Latin.
298
299 .. note::
300
301 Archive names should be relative to the archive root, that is, they should not
302 start with a path separator.
303
304 .. note::
305
306 If ``arcname`` (or ``filename``, if ``arcname`` is not given) contains a null
307 byte, the name of the file in the archive will be truncated at the null byte.
308
309
Ronald Oussorendd25e862010-02-07 20:18:02 +0000310.. method:: ZipFile.writestr(zinfo_or_arcname, bytes[, compress_type])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000311
312 Write the string *bytes* to the archive; *zinfo_or_arcname* is either the file
313 name it will be given in the archive, or a :class:`ZipInfo` instance. If it's
314 an instance, at least the filename, date, and time must be given. If it's a
315 name, the date and time is set to the current date and time. The archive must be
316 opened with mode ``'w'`` or ``'a'`` -- calling :meth:`writestr` on a ZipFile
317 created with mode ``'r'`` will raise a :exc:`RuntimeError`. Calling
318 :meth:`writestr` on a closed ZipFile will raise a :exc:`RuntimeError`.
319
Ronald Oussorendd25e862010-02-07 20:18:02 +0000320 If given, *compress_type* overrides the value given for the *compression*
321 parameter to the constructor for the new entry, or in the *zinfo_or_arcname*
322 (if that is a :class:`ZipInfo` instance).
323
Georg Brandl62416bc2008-01-07 18:47:44 +0000324 .. note::
325
Éric Araujo8e726b42010-12-26 17:55:02 +0000326 When passing a :class:`ZipInfo` instance as the *zinfo_or_arcname* parameter,
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000327 the compression method used will be that specified in the *compress_type*
328 member of the given :class:`ZipInfo` instance. By default, the
Georg Brandl62416bc2008-01-07 18:47:44 +0000329 :class:`ZipInfo` constructor sets this member to :const:`ZIP_STORED`.
330
Ronald Oussorendd25e862010-02-07 20:18:02 +0000331 .. versionchanged:: 2.7
Andrew Svetlov8c441932012-10-06 18:01:05 +0300332 The *compress_type* argument.
Ronald Oussorendd25e862010-02-07 20:18:02 +0000333
Martin v. Löwis8c436412008-07-03 12:51:14 +0000334The following data attributes are also available:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000335
336
337.. attribute:: ZipFile.debug
338
339 The level of debug output to use. This may be set from ``0`` (the default, no
340 output) to ``3`` (the most output). Debugging information is written to
341 ``sys.stdout``.
342
Martin v. Löwis8c436412008-07-03 12:51:14 +0000343.. attribute:: ZipFile.comment
344
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000345 The comment text associated with the ZIP file. If assigning a comment to a
346 :class:`ZipFile` instance created with mode 'a' or 'w', this should be a
347 string no longer than 65535 bytes. Comments longer than this will be
Andrew Svetlov8c441932012-10-06 18:01:05 +0300348 truncated in the written archive when :meth:`.close` is called.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000349
350.. _pyzipfile-objects:
351
352PyZipFile Objects
353-----------------
354
355The :class:`PyZipFile` constructor takes the same parameters as the
356:class:`ZipFile` constructor. Instances have one method in addition to those of
357:class:`ZipFile` objects.
358
359
360.. method:: PyZipFile.writepy(pathname[, basename])
361
362 Search for files :file:`\*.py` and add the corresponding file to the archive.
363 The corresponding file is a :file:`\*.pyo` file if available, else a
364 :file:`\*.pyc` file, compiling if necessary. If the pathname is a file, the
365 filename must end with :file:`.py`, and just the (corresponding
366 :file:`\*.py[co]`) file is added at the top level (no path information). If the
367 pathname is a file that does not end with :file:`.py`, a :exc:`RuntimeError`
368 will be raised. If it is a directory, and the directory is not a package
369 directory, then all the files :file:`\*.py[co]` are added at the top level. If
370 the directory is a package directory, then all :file:`\*.py[co]` are added under
371 the package name as a file path, and if any subdirectories are package
372 directories, all of these are added recursively. *basename* is intended for
373 internal use only. The :meth:`writepy` method makes archives with file names
374 like this::
375
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000376 string.pyc # Top level name
377 test/__init__.pyc # Package directory
Brett Cannon3c759142008-05-09 05:25:37 +0000378 test/test_support.pyc # Module test.test_support
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000379 test/bogus/__init__.pyc # Subpackage directory
Georg Brandl8ec7f652007-08-15 14:28:01 +0000380 test/bogus/myfile.pyc # Submodule test.bogus.myfile
381
382
383.. _zipinfo-objects:
384
385ZipInfo Objects
386---------------
387
Andrew Svetlov8c441932012-10-06 18:01:05 +0300388Instances of the :class:`ZipInfo` class are returned by the :meth:`.getinfo` and
389:meth:`.infolist` methods of :class:`ZipFile` objects. Each object stores
Georg Brandl8ec7f652007-08-15 14:28:01 +0000390information about a single member of the ZIP archive.
391
392Instances have the following attributes:
393
394
395.. attribute:: ZipInfo.filename
396
397 Name of the file in the archive.
398
399
400.. attribute:: ZipInfo.date_time
401
402 The time and date of the last modification to the archive member. This is a
403 tuple of six values:
404
405 +-------+--------------------------+
406 | Index | Value |
407 +=======+==========================+
Senthil Kumaranddd40312011-10-20 01:38:35 +0800408 | ``0`` | Year (>= 1980) |
Georg Brandl8ec7f652007-08-15 14:28:01 +0000409 +-------+--------------------------+
410 | ``1`` | Month (one-based) |
411 +-------+--------------------------+
412 | ``2`` | Day of month (one-based) |
413 +-------+--------------------------+
414 | ``3`` | Hours (zero-based) |
415 +-------+--------------------------+
416 | ``4`` | Minutes (zero-based) |
417 +-------+--------------------------+
418 | ``5`` | Seconds (zero-based) |
419 +-------+--------------------------+
420
Senthil Kumaranddd40312011-10-20 01:38:35 +0800421 .. note::
422
423 The ZIP file format does not support timestamps before 1980.
424
Georg Brandl8ec7f652007-08-15 14:28:01 +0000425
426.. attribute:: ZipInfo.compress_type
427
428 Type of compression for the archive member.
429
430
431.. attribute:: ZipInfo.comment
432
433 Comment for the individual archive member.
434
435
436.. attribute:: ZipInfo.extra
437
438 Expansion field data. The `PKZIP Application Note
Georg Brandl02677812008-03-15 00:20:19 +0000439 <http://www.pkware.com/documents/casestudies/APPNOTE.TXT>`_ contains
Georg Brandl8ec7f652007-08-15 14:28:01 +0000440 some comments on the internal structure of the data contained in this string.
441
442
443.. attribute:: ZipInfo.create_system
444
445 System which created ZIP archive.
446
447
448.. attribute:: ZipInfo.create_version
449
450 PKZIP version which created ZIP archive.
451
452
453.. attribute:: ZipInfo.extract_version
454
455 PKZIP version needed to extract archive.
456
457
458.. attribute:: ZipInfo.reserved
459
460 Must be zero.
461
462
463.. attribute:: ZipInfo.flag_bits
464
465 ZIP flag bits.
466
467
468.. attribute:: ZipInfo.volume
469
470 Volume number of file header.
471
472
473.. attribute:: ZipInfo.internal_attr
474
475 Internal attributes.
476
477
478.. attribute:: ZipInfo.external_attr
479
480 External file attributes.
481
482
483.. attribute:: ZipInfo.header_offset
484
485 Byte offset to the file header.
486
487
488.. attribute:: ZipInfo.CRC
489
490 CRC-32 of the uncompressed file.
491
492
493.. attribute:: ZipInfo.compress_size
494
495 Size of the compressed data.
496
497
498.. attribute:: ZipInfo.file_size
499
500 Size of the uncompressed file.
501