blob: f4148530d8534db13f975b4e15b050e9de393a75 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`zipfile` --- Work with ZIP archives
2=========================================
3
4.. module:: zipfile
5 :synopsis: Read and write ZIP-format archive files.
6.. moduleauthor:: James C. Ahlstrom <jim@interet.com>
7.. sectionauthor:: James C. Ahlstrom <jim@interet.com>
8
Georg Brandl116aa622007-08-15 14:28:22 +00009The ZIP file format is a common archive and compression standard. This module
10provides tools to create, read, write, append, and list a ZIP file. Any
11advanced use of this module will require an understanding of the format, as
12defined in `PKZIP Application Note
Christian Heimesdd15f6c2008-03-16 00:07:10 +000013<http://www.pkware.com/documents/casestudies/APPNOTE.TXT>`_.
Georg Brandl116aa622007-08-15 14:28:22 +000014
Guido van Rossum77677112007-11-05 19:43:04 +000015This module does not currently handle multi-disk ZIP files, or ZIP files
16which have appended comments (although it correctly handles comments
17added to individual archive members---for which see the :ref:`zipinfo-objects`
18documentation). It can handle ZIP files that use the ZIP64 extensions
19(that is ZIP files that are more than 4 GByte in size). It supports
20decryption of encrypted files in ZIP archives, but it currently cannot
Christian Heimesfdab48e2008-01-20 09:06:41 +000021create an encrypted file. Decryption is extremely slow as it is
Benjamin Peterson39778f62009-11-25 18:37:12 +000022implemented in native Python rather than C.
Georg Brandl116aa622007-08-15 14:28:22 +000023
Guido van Rossum77677112007-11-05 19:43:04 +000024For other archive formats, see the :mod:`bz2`, :mod:`gzip`, and
25:mod:`tarfile` modules.
Georg Brandl116aa622007-08-15 14:28:22 +000026
Guido van Rossum77677112007-11-05 19:43:04 +000027The module defines the following items:
Georg Brandl116aa622007-08-15 14:28:22 +000028
29.. exception:: BadZipfile
30
31 The error raised for bad ZIP files (old name: ``zipfile.error``).
32
33
34.. exception:: LargeZipFile
35
36 The error raised when a ZIP file would require ZIP64 functionality but that has
37 not been enabled.
38
39
40.. class:: ZipFile
41
42 The class for reading and writing ZIP files. See section
43 :ref:`zipfile-objects` for constructor details.
44
45
46.. class:: PyZipFile
47
48 Class for creating ZIP archives containing Python libraries.
49
50
Georg Brandlb044b2a2009-09-16 16:05:59 +000051.. class:: ZipInfo(filename='NoName', date_time=(1980,1,1,0,0,0))
Georg Brandl116aa622007-08-15 14:28:22 +000052
53 Class used to represent information about a member of an archive. Instances
54 of this class are returned by the :meth:`getinfo` and :meth:`infolist`
55 methods of :class:`ZipFile` objects. Most users of the :mod:`zipfile` module
56 will not need to create these, but only use those created by this
57 module. *filename* should be the full name of the archive member, and
58 *date_time* should be a tuple containing six fields which describe the time
59 of the last modification to the file; the fields are described in section
60 :ref:`zipinfo-objects`.
61
62
63.. function:: is_zipfile(filename)
64
65 Returns ``True`` if *filename* is a valid ZIP file based on its magic number,
Antoine Pitroudb5fe662008-12-27 15:50:40 +000066 otherwise returns ``False``. *filename* may be a file or file-like object too.
67 This module does not currently handle ZIP files which have appended comments.
Georg Brandl116aa622007-08-15 14:28:22 +000068
Georg Brandl277a1502009-01-04 00:28:14 +000069 .. versionchanged:: 3.1
70 Support for file and file-like objects.
Georg Brandl116aa622007-08-15 14:28:22 +000071
72.. data:: ZIP_STORED
73
74 The numeric constant for an uncompressed archive member.
75
76
77.. data:: ZIP_DEFLATED
78
79 The numeric constant for the usual ZIP compression method. This requires the
80 zlib module. No other compression methods are currently supported.
81
82
83.. seealso::
84
Christian Heimesdd15f6c2008-03-16 00:07:10 +000085 `PKZIP Application Note <http://www.pkware.com/documents/casestudies/APPNOTE.TXT>`_
Georg Brandl116aa622007-08-15 14:28:22 +000086 Documentation on the ZIP file format by Phil Katz, the creator of the format and
87 algorithms used.
88
89 `Info-ZIP Home Page <http://www.info-zip.org/>`_
90 Information about the Info-ZIP project's ZIP archive programs and development
91 libraries.
92
93
94.. _zipfile-objects:
95
96ZipFile Objects
97---------------
98
99
Georg Brandlb044b2a2009-09-16 16:05:59 +0000100.. class:: ZipFile(file, mode='r', compression=ZIP_STORED, allowZip64=False)
Georg Brandl116aa622007-08-15 14:28:22 +0000101
102 Open a ZIP file, where *file* can be either a path to a file (a string) or a
103 file-like object. The *mode* parameter should be ``'r'`` to read an existing
104 file, ``'w'`` to truncate and write a new file, or ``'a'`` to append to an
105 existing file. If *mode* is ``'a'`` and *file* refers to an existing ZIP file,
106 then additional files are added to it. If *file* does not refer to a ZIP file,
107 then a new ZIP archive is appended to the file. This is meant for adding a ZIP
108 archive to another file, such as :file:`python.exe`. Using ::
109
110 cat myzip.zip >> python.exe
111
112 also works, and at least :program:`WinZip` can read such files. If *mode* is
113 ``a`` and the file does not exist at all, it is created. *compression* is the
114 ZIP compression method to use when writing the archive, and should be
115 :const:`ZIP_STORED` or :const:`ZIP_DEFLATED`; unrecognized values will cause
116 :exc:`RuntimeError` to be raised. If :const:`ZIP_DEFLATED` is specified but the
117 :mod:`zlib` module is not available, :exc:`RuntimeError` is also raised. The
118 default is :const:`ZIP_STORED`. If *allowZip64* is ``True`` zipfile will create
119 ZIP files that use the ZIP64 extensions when the zipfile is larger than 2 GB. If
120 it is false (the default) :mod:`zipfile` will raise an exception when the ZIP
121 file would require ZIP64 extensions. ZIP64 extensions are disabled by default
122 because the default :program:`zip` and :program:`unzip` commands on Unix (the
123 InfoZIP utilities) don't support these extensions.
124
Georg Brandl116aa622007-08-15 14:28:22 +0000125
126.. method:: ZipFile.close()
127
128 Close the archive file. You must call :meth:`close` before exiting your program
129 or essential records will not be written.
130
131
132.. method:: ZipFile.getinfo(name)
133
134 Return a :class:`ZipInfo` object with information about the archive member
135 *name*. Calling :meth:`getinfo` for a name not currently contained in the
136 archive will raise a :exc:`KeyError`.
137
138
139.. method:: ZipFile.infolist()
140
141 Return a list containing a :class:`ZipInfo` object for each member of the
142 archive. The objects are in the same order as their entries in the actual ZIP
143 file on disk if an existing archive was opened.
144
145
146.. method:: ZipFile.namelist()
147
148 Return a list of archive members by name.
149
150
Georg Brandlb044b2a2009-09-16 16:05:59 +0000151.. method:: ZipFile.open(name, mode='r', pwd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000152
153 Extract a member from the archive as a file-like object (ZipExtFile). *name* is
Georg Brandlb533e262008-05-25 18:19:30 +0000154 the name of the file in the archive, or a :class:`ZipInfo` object. The *mode*
155 parameter, if included, must be one of the following: ``'r'`` (the default),
156 ``'U'``, or ``'rU'``. Choosing ``'U'`` or ``'rU'`` will enable universal newline
157 support in the read-only object. *pwd* is the password used for encrypted files.
158 Calling :meth:`open` on a closed ZipFile will raise a :exc:`RuntimeError`.
Georg Brandl116aa622007-08-15 14:28:22 +0000159
160 .. note::
161
162 The file-like object is read-only and provides the following methods:
163 :meth:`read`, :meth:`readline`, :meth:`readlines`, :meth:`__iter__`,
Ezio Melotti6bccd292010-04-05 07:58:21 +0000164 :meth:`__next__`.
Georg Brandl116aa622007-08-15 14:28:22 +0000165
166 .. note::
167
168 If the ZipFile was created by passing in a file-like object as the first
Guido van Rossumda27fd22007-08-17 00:24:54 +0000169 argument to the constructor, then the object returned by :meth:`.open` shares the
Georg Brandl116aa622007-08-15 14:28:22 +0000170 ZipFile's file pointer. Under these circumstances, the object returned by
Guido van Rossumda27fd22007-08-17 00:24:54 +0000171 :meth:`.open` should not be used after any additional operations are performed
Georg Brandl116aa622007-08-15 14:28:22 +0000172 on the ZipFile object. If the ZipFile was created by passing in a string (the
Guido van Rossumda27fd22007-08-17 00:24:54 +0000173 filename) as the first argument to the constructor, then :meth:`.open` will
Georg Brandl116aa622007-08-15 14:28:22 +0000174 create a new file object that will be held by the ZipExtFile, allowing it to
175 operate independently of the ZipFile.
176
Georg Brandlb533e262008-05-25 18:19:30 +0000177 .. note::
178
179 The :meth:`open`, :meth:`read` and :meth:`extract` methods can take a filename
180 or a :class:`ZipInfo` object. You will appreciate this when trying to read a
181 ZIP file that contains members with duplicate names.
182
Georg Brandl116aa622007-08-15 14:28:22 +0000183
Georg Brandlb044b2a2009-09-16 16:05:59 +0000184.. method:: ZipFile.extract(member, path=None, pwd=None)
Christian Heimes790c8232008-01-07 21:14:23 +0000185
Georg Brandlb533e262008-05-25 18:19:30 +0000186 Extract a member from the archive to the current working directory; *member*
187 must be its full name or a :class:`ZipInfo` object). Its file information is
188 extracted as accurately as possible. *path* specifies a different directory
189 to extract to. *member* can be a filename or a :class:`ZipInfo` object.
190 *pwd* is the password used for encrypted files.
Christian Heimes790c8232008-01-07 21:14:23 +0000191
Christian Heimes790c8232008-01-07 21:14:23 +0000192
Georg Brandlb044b2a2009-09-16 16:05:59 +0000193.. method:: ZipFile.extractall(path=None, members=None, pwd=None)
Christian Heimes790c8232008-01-07 21:14:23 +0000194
Georg Brandl48310cd2009-01-03 21:18:54 +0000195 Extract all members from the archive to the current working directory. *path*
Christian Heimes790c8232008-01-07 21:14:23 +0000196 specifies a different directory to extract to. *members* is optional and must
197 be a subset of the list returned by :meth:`namelist`. *pwd* is the password
198 used for encrypted files.
199
Benjamin Peterson8f6713f2009-11-13 02:29:35 +0000200 .. warning::
201
202 Never extract archives from untrusted sources without prior inspection.
203 It is possible that files are created outside of *path*, e.g. members
204 that have absolute filenames starting with ``"/"`` or filenames with two
205 dots ``".."``.
206
Christian Heimes790c8232008-01-07 21:14:23 +0000207
Georg Brandl116aa622007-08-15 14:28:22 +0000208.. method:: ZipFile.printdir()
209
210 Print a table of contents for the archive to ``sys.stdout``.
211
212
213.. method:: ZipFile.setpassword(pwd)
214
215 Set *pwd* as default password to extract encrypted files.
216
Georg Brandl116aa622007-08-15 14:28:22 +0000217
Georg Brandlb044b2a2009-09-16 16:05:59 +0000218.. method:: ZipFile.read(name, pwd=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000219
Georg Brandlb533e262008-05-25 18:19:30 +0000220 Return the bytes of the file *name* in the archive. *name* is the name of the
221 file in the archive, or a :class:`ZipInfo` object. The archive must be open for
222 read or append. *pwd* is the password used for encrypted files and, if specified,
223 it will override the default password set with :meth:`setpassword`. Calling
Georg Brandl116aa622007-08-15 14:28:22 +0000224 :meth:`read` on a closed ZipFile will raise a :exc:`RuntimeError`.
225
Georg Brandl116aa622007-08-15 14:28:22 +0000226
227.. method:: ZipFile.testzip()
228
229 Read all the files in the archive and check their CRC's and file headers.
230 Return the name of the first bad file, or else return ``None``. Calling
231 :meth:`testzip` on a closed ZipFile will raise a :exc:`RuntimeError`.
232
233
Georg Brandlb044b2a2009-09-16 16:05:59 +0000234.. method:: ZipFile.write(filename, arcname=None, compress_type=None)
Georg Brandl116aa622007-08-15 14:28:22 +0000235
236 Write the file named *filename* to the archive, giving it the archive name
237 *arcname* (by default, this will be the same as *filename*, but without a drive
238 letter and with leading path separators removed). If given, *compress_type*
239 overrides the value given for the *compression* parameter to the constructor for
240 the new entry. The archive must be open with mode ``'w'`` or ``'a'`` -- calling
241 :meth:`write` on a ZipFile created with mode ``'r'`` will raise a
242 :exc:`RuntimeError`. Calling :meth:`write` on a closed ZipFile will raise a
243 :exc:`RuntimeError`.
244
245 .. note::
246
247 There is no official file name encoding for ZIP files. If you have unicode file
Thomas Wouters47b49bf2007-08-30 22:15:33 +0000248 names, you must convert them to byte strings in your desired encoding before
Georg Brandl116aa622007-08-15 14:28:22 +0000249 passing them to :meth:`write`. WinZip interprets all file names as encoded in
250 CP437, also known as DOS Latin.
251
252 .. note::
253
254 Archive names should be relative to the archive root, that is, they should not
255 start with a path separator.
256
257 .. note::
258
259 If ``arcname`` (or ``filename``, if ``arcname`` is not given) contains a null
260 byte, the name of the file in the archive will be truncated at the null byte.
261
262
263.. method:: ZipFile.writestr(zinfo_or_arcname, bytes)
264
265 Write the string *bytes* to the archive; *zinfo_or_arcname* is either the file
266 name it will be given in the archive, or a :class:`ZipInfo` instance. If it's
267 an instance, at least the filename, date, and time must be given. If it's a
268 name, the date and time is set to the current date and time. The archive must be
269 opened with mode ``'w'`` or ``'a'`` -- calling :meth:`writestr` on a ZipFile
270 created with mode ``'r'`` will raise a :exc:`RuntimeError`. Calling
271 :meth:`writestr` on a closed ZipFile will raise a :exc:`RuntimeError`.
272
Christian Heimes790c8232008-01-07 21:14:23 +0000273 .. note::
274
Georg Brandl48310cd2009-01-03 21:18:54 +0000275 When passing a :class:`ZipInfo` instance as the *zinfo_or_acrname* parameter,
276 the compression method used will be that specified in the *compress_type*
277 member of the given :class:`ZipInfo` instance. By default, the
Christian Heimes790c8232008-01-07 21:14:23 +0000278 :class:`ZipInfo` constructor sets this member to :const:`ZIP_STORED`.
279
Martin v. Löwisb09b8442008-07-03 14:13:42 +0000280The following data attributes are also available:
Georg Brandl116aa622007-08-15 14:28:22 +0000281
282
283.. attribute:: ZipFile.debug
284
285 The level of debug output to use. This may be set from ``0`` (the default, no
286 output) to ``3`` (the most output). Debugging information is written to
287 ``sys.stdout``.
288
Martin v. Löwisb09b8442008-07-03 14:13:42 +0000289.. attribute:: ZipFile.comment
290
Georg Brandl48310cd2009-01-03 21:18:54 +0000291 The comment text associated with the ZIP file. If assigning a comment to a
292 :class:`ZipFile` instance created with mode 'a' or 'w', this should be a
293 string no longer than 65535 bytes. Comments longer than this will be
Martin v. Löwisb09b8442008-07-03 14:13:42 +0000294 truncated in the written archive when :meth:`ZipFile.close` is called.
Georg Brandl116aa622007-08-15 14:28:22 +0000295
296.. _pyzipfile-objects:
297
298PyZipFile Objects
299-----------------
300
301The :class:`PyZipFile` constructor takes the same parameters as the
302:class:`ZipFile` constructor. Instances have one method in addition to those of
303:class:`ZipFile` objects.
304
305
Georg Brandlb044b2a2009-09-16 16:05:59 +0000306.. method:: PyZipFile.writepy(pathname, basename='')
Georg Brandl116aa622007-08-15 14:28:22 +0000307
308 Search for files :file:`\*.py` and add the corresponding file to the archive.
309 The corresponding file is a :file:`\*.pyo` file if available, else a
310 :file:`\*.pyc` file, compiling if necessary. If the pathname is a file, the
311 filename must end with :file:`.py`, and just the (corresponding
312 :file:`\*.py[co]`) file is added at the top level (no path information). If the
313 pathname is a file that does not end with :file:`.py`, a :exc:`RuntimeError`
314 will be raised. If it is a directory, and the directory is not a package
315 directory, then all the files :file:`\*.py[co]` are added at the top level. If
316 the directory is a package directory, then all :file:`\*.py[co]` are added under
317 the package name as a file path, and if any subdirectories are package
318 directories, all of these are added recursively. *basename* is intended for
319 internal use only. The :meth:`writepy` method makes archives with file names
320 like this::
321
Georg Brandl48310cd2009-01-03 21:18:54 +0000322 string.pyc # Top level name
323 test/__init__.pyc # Package directory
Georg Brandl116aa622007-08-15 14:28:22 +0000324 test/testall.pyc # Module test.testall
Georg Brandl48310cd2009-01-03 21:18:54 +0000325 test/bogus/__init__.pyc # Subpackage directory
Georg Brandl116aa622007-08-15 14:28:22 +0000326 test/bogus/myfile.pyc # Submodule test.bogus.myfile
327
328
329.. _zipinfo-objects:
330
331ZipInfo Objects
332---------------
333
334Instances of the :class:`ZipInfo` class are returned by the :meth:`getinfo` and
335:meth:`infolist` methods of :class:`ZipFile` objects. Each object stores
336information about a single member of the ZIP archive.
337
338Instances have the following attributes:
339
340
341.. attribute:: ZipInfo.filename
342
343 Name of the file in the archive.
344
345
346.. attribute:: ZipInfo.date_time
347
348 The time and date of the last modification to the archive member. This is a
349 tuple of six values:
350
351 +-------+--------------------------+
352 | Index | Value |
353 +=======+==========================+
354 | ``0`` | Year |
355 +-------+--------------------------+
356 | ``1`` | Month (one-based) |
357 +-------+--------------------------+
358 | ``2`` | Day of month (one-based) |
359 +-------+--------------------------+
360 | ``3`` | Hours (zero-based) |
361 +-------+--------------------------+
362 | ``4`` | Minutes (zero-based) |
363 +-------+--------------------------+
364 | ``5`` | Seconds (zero-based) |
365 +-------+--------------------------+
366
367
368.. attribute:: ZipInfo.compress_type
369
370 Type of compression for the archive member.
371
372
373.. attribute:: ZipInfo.comment
374
375 Comment for the individual archive member.
376
377
378.. attribute:: ZipInfo.extra
379
380 Expansion field data. The `PKZIP Application Note
Christian Heimesdd15f6c2008-03-16 00:07:10 +0000381 <http://www.pkware.com/documents/casestudies/APPNOTE.TXT>`_ contains
Georg Brandl116aa622007-08-15 14:28:22 +0000382 some comments on the internal structure of the data contained in this string.
383
384
385.. attribute:: ZipInfo.create_system
386
387 System which created ZIP archive.
388
389
390.. attribute:: ZipInfo.create_version
391
392 PKZIP version which created ZIP archive.
393
394
395.. attribute:: ZipInfo.extract_version
396
397 PKZIP version needed to extract archive.
398
399
400.. attribute:: ZipInfo.reserved
401
402 Must be zero.
403
404
405.. attribute:: ZipInfo.flag_bits
406
407 ZIP flag bits.
408
409
410.. attribute:: ZipInfo.volume
411
412 Volume number of file header.
413
414
415.. attribute:: ZipInfo.internal_attr
416
417 Internal attributes.
418
419
420.. attribute:: ZipInfo.external_attr
421
422 External file attributes.
423
424
425.. attribute:: ZipInfo.header_offset
426
427 Byte offset to the file header.
428
429
430.. attribute:: ZipInfo.CRC
431
432 CRC-32 of the uncompressed file.
433
434
435.. attribute:: ZipInfo.compress_size
436
437 Size of the compressed data.
438
439
440.. attribute:: ZipInfo.file_size
441
442 Size of the uncompressed file.
443