Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 1 | :mod:`gzip` --- Support for :program:`gzip` files |
| 2 | ================================================= |
| 3 | |
| 4 | .. module:: gzip |
| 5 | :synopsis: Interfaces for gzip compression and decompression using file objects. |
| 6 | |
Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 7 | This module provides a simple interface to compress and decompress files just |
| 8 | like the GNU programs :program:`gzip` and :program:`gunzip` would. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 9 | |
Georg Brandl | 1f01deb | 2009-01-03 22:47:39 +0000 | [diff] [blame] | 10 | The data compression is provided by the :mod:`zlib` module. |
Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 11 | |
| 12 | The :mod:`gzip` module provides the :class:`GzipFile` class which is modeled |
| 13 | after Python's File Object. The :class:`GzipFile` class reads and writes |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 14 | :program:`gzip`\ -format files, automatically compressing or decompressing the |
Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 15 | data so that it looks like an ordinary file object. |
| 16 | |
| 17 | Note that additional file formats which can be decompressed by the |
| 18 | :program:`gzip` and :program:`gunzip` programs, such as those produced by |
| 19 | :program:`compress` and :program:`pack`, are not supported by this module. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 20 | |
Guido van Rossum | 7767711 | 2007-11-05 19:43:04 +0000 | [diff] [blame] | 21 | For other archive formats, see the :mod:`bz2`, :mod:`zipfile`, and |
| 22 | :mod:`tarfile` modules. |
| 23 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 24 | The module defines the following items: |
| 25 | |
| 26 | |
Georg Brandl | 036490d | 2009-05-17 13:00:36 +0000 | [diff] [blame] | 27 | .. class:: GzipFile(filename=None, mode=None, compresslevel=9, fileobj=None, mtime=None) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 28 | |
| 29 | Constructor for the :class:`GzipFile` class, which simulates most of the methods |
| 30 | of a file object, with the exception of the :meth:`readinto` and |
| 31 | :meth:`truncate` methods. At least one of *fileobj* and *filename* must be |
| 32 | given a non-trivial value. |
| 33 | |
| 34 | The new class instance is based on *fileobj*, which can be a regular file, a |
| 35 | :class:`StringIO` object, or any other object which simulates a file. It |
| 36 | defaults to ``None``, in which case *filename* is opened to provide a file |
| 37 | object. |
| 38 | |
| 39 | When *fileobj* is not ``None``, the *filename* argument is only used to be |
| 40 | included in the :program:`gzip` file header, which may includes the original |
| 41 | filename of the uncompressed file. It defaults to the filename of *fileobj*, if |
| 42 | discernible; otherwise, it defaults to the empty string, and in this case the |
| 43 | original filename is not included in the header. |
| 44 | |
| 45 | The *mode* argument can be any of ``'r'``, ``'rb'``, ``'a'``, ``'ab'``, ``'w'``, |
| 46 | or ``'wb'``, depending on whether the file will be read or written. The default |
| 47 | is the mode of *fileobj* if discernible; otherwise, the default is ``'rb'``. If |
| 48 | not given, the 'b' flag will be added to the mode to ensure the file is opened |
| 49 | in binary mode for cross-platform portability. |
| 50 | |
| 51 | The *compresslevel* argument is an integer from ``1`` to ``9`` controlling the |
| 52 | level of compression; ``1`` is fastest and produces the least compression, and |
| 53 | ``9`` is slowest and produces the most compression. The default is ``9``. |
| 54 | |
Antoine Pitrou | 42db3ef | 2009-01-04 21:37:59 +0000 | [diff] [blame] | 55 | The *mtime* argument is an optional numeric timestamp to be written to |
Benjamin Peterson | e0124bd | 2009-03-09 21:04:33 +0000 | [diff] [blame] | 56 | the stream when compressing. All :program:`gzip` compressed streams are |
Antoine Pitrou | 42db3ef | 2009-01-04 21:37:59 +0000 | [diff] [blame] | 57 | required to contain a timestamp. If omitted or ``None``, the current |
| 58 | time is used. This module ignores the timestamp when decompressing; |
| 59 | however, some programs, such as :program:`gunzip`\ , make use of it. |
| 60 | The format of the timestamp is the same as that of the return value of |
| 61 | ``time.time()`` and of the ``st_mtime`` member of the object returned |
| 62 | by ``os.stat()``. |
| 63 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 64 | Calling a :class:`GzipFile` object's :meth:`close` method does not close |
| 65 | *fileobj*, since you might wish to append more material after the compressed |
| 66 | data. This also allows you to pass a :class:`StringIO` object opened for |
| 67 | writing as *fileobj*, and retrieve the resulting memory buffer using the |
| 68 | :class:`StringIO` object's :meth:`getvalue` method. |
| 69 | |
Benjamin Peterson | 886af96 | 2010-03-21 23:13:07 +0000 | [diff] [blame] | 70 | :class:`GzipFile` supports iteration and the :keyword:`with` statement. |
Benjamin Peterson | e0124bd | 2009-03-09 21:04:33 +0000 | [diff] [blame] | 71 | |
Benjamin Peterson | 10745a9 | 2009-03-09 21:08:47 +0000 | [diff] [blame] | 72 | .. versionchanged:: 3.1 |
Benjamin Peterson | e0124bd | 2009-03-09 21:04:33 +0000 | [diff] [blame] | 73 | Support for the :keyword:`with` statement was added. |
| 74 | |
Antoine Pitrou | 8e33fd7 | 2010-01-13 14:37:26 +0000 | [diff] [blame] | 75 | .. versionchanged:: 3.2 |
| 76 | Support for zero-padded files was added. |
| 77 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 78 | |
Georg Brandl | 036490d | 2009-05-17 13:00:36 +0000 | [diff] [blame] | 79 | .. function:: open(filename, mode='rb', compresslevel=9) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 80 | |
| 81 | This is a shorthand for ``GzipFile(filename,`` ``mode,`` ``compresslevel)``. |
| 82 | The *filename* argument is required; *mode* defaults to ``'rb'`` and |
| 83 | *compresslevel* defaults to ``9``. |
| 84 | |
Antoine Pitrou | 79c5ef1 | 2010-08-17 21:10:05 +0000 | [diff] [blame] | 85 | .. function:: compress(data, compresslevel=9) |
| 86 | |
| 87 | Compress the *data*, returning a :class:`bytes` object containing |
| 88 | the compressed data. *compresslevel* has the same meaning as in |
| 89 | the :class:`GzipFile` constructor above. |
| 90 | |
Antoine Pitrou | cdfe1c5 | 2010-08-17 21:15:00 +0000 | [diff] [blame^] | 91 | .. versionadded:: 3.2 |
| 92 | |
Antoine Pitrou | 79c5ef1 | 2010-08-17 21:10:05 +0000 | [diff] [blame] | 93 | .. function:: decompress(data) |
| 94 | |
| 95 | Decompress the *data*, returning a :class:`bytes` object containing the |
| 96 | uncompressed data. |
| 97 | |
Antoine Pitrou | cdfe1c5 | 2010-08-17 21:15:00 +0000 | [diff] [blame^] | 98 | .. versionadded:: 3.2 |
| 99 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 100 | |
Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 101 | .. _gzip-usage-examples: |
| 102 | |
| 103 | Examples of usage |
| 104 | ----------------- |
| 105 | |
| 106 | Example of how to read a compressed file:: |
| 107 | |
| 108 | import gzip |
Antoine Pitrou | bf1a018 | 2010-08-17 21:11:49 +0000 | [diff] [blame] | 109 | with gzip.open('/home/joe/file.txt.gz', 'rb') as f: |
| 110 | file_content = f.read() |
Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 111 | |
| 112 | Example of how to create a compressed GZIP file:: |
| 113 | |
| 114 | import gzip |
Antoine Pitrou | bf1a018 | 2010-08-17 21:11:49 +0000 | [diff] [blame] | 115 | content = b"Lots of content here" |
| 116 | with gzip.open('/home/joe/file.txt.gz', 'wb') as f: |
| 117 | f.write(content) |
Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 118 | |
| 119 | Example of how to GZIP compress an existing file:: |
| 120 | |
| 121 | import gzip |
Antoine Pitrou | bf1a018 | 2010-08-17 21:11:49 +0000 | [diff] [blame] | 122 | with open('/home/joe/file.txt', 'rb') as f_in: |
| 123 | with f_out = gzip.open('/home/joe/file.txt.gz', 'wb') as f_out: |
| 124 | f_out.writelines(f_in) |
Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 125 | |
Antoine Pitrou | 79c5ef1 | 2010-08-17 21:10:05 +0000 | [diff] [blame] | 126 | Example of how to GZIP compress a binary string:: |
| 127 | |
| 128 | import gzip |
| 129 | s_in = b"Lots of content here" |
| 130 | s_out = gzip.compress(s_in) |
Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 131 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 132 | .. seealso:: |
| 133 | |
| 134 | Module :mod:`zlib` |
| 135 | The basic data compression module needed to support the :program:`gzip` file |
| 136 | format. |
| 137 | |