blob: 44e133100bae860c0a08ea25af5390760358217c [file] [log] [blame]
Antoine Pitrou37dc5f82011-04-03 17:05:46 +02001:mod:`bz2` --- Support for :program:`bzip2` compression
2=======================================================
Georg Brandl116aa622007-08-15 14:28:22 +00003
4.. module:: bz2
Antoine Pitrou37dc5f82011-04-03 17:05:46 +02005 :synopsis: Interfaces for bzip2 compression and decompression.
Georg Brandl116aa622007-08-15 14:28:22 +00006.. moduleauthor:: Gustavo Niemeyer <niemeyer@conectiva.com>
Antoine Pitrou37dc5f82011-04-03 17:05:46 +02007.. moduleauthor:: Nadeem Vawda <nadeem.vawda@gmail.com>
Georg Brandl116aa622007-08-15 14:28:22 +00008.. sectionauthor:: Gustavo Niemeyer <niemeyer@conectiva.com>
Antoine Pitrou37dc5f82011-04-03 17:05:46 +02009.. sectionauthor:: Nadeem Vawda <nadeem.vawda@gmail.com>
Georg Brandl116aa622007-08-15 14:28:22 +000010
11
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020012This module provides a comprehensive interface for compressing and
13decompressing data using the bzip2 compression algorithm.
Georg Brandl116aa622007-08-15 14:28:22 +000014
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020015The :mod:`bz2` module contains:
Georg Brandl116aa622007-08-15 14:28:22 +000016
Nadeem Vawdaaf518c12012-06-04 23:32:38 +020017* The :func:`.open` function and :class:`BZ2File` class for reading and
18 writing compressed files.
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020019* The :class:`BZ2Compressor` and :class:`BZ2Decompressor` classes for
20 incremental (de)compression.
21* The :func:`compress` and :func:`decompress` functions for one-shot
22 (de)compression.
Georg Brandl116aa622007-08-15 14:28:22 +000023
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020024All of the classes in this module may safely be accessed from multiple threads.
Georg Brandl116aa622007-08-15 14:28:22 +000025
26
27(De)compression of files
28------------------------
29
Nadeem Vawdaaf518c12012-06-04 23:32:38 +020030.. function:: open(filename, mode='r', compresslevel=9, encoding=None, errors=None, newline=None)
31
32 Open a bzip2-compressed file in binary or text mode, returning a :term:`file
33 object`.
34
35 As with the constructor for :class:`BZ2File`, the *filename* argument can be
36 an actual filename (a :class:`str` or :class:`bytes` object), or an existing
37 file object to read from or write to.
38
39 The *mode* argument can be any of ``'r'``, ``'rb'``, ``'w'``, ``'wb'``,
Nadeem Vawda8a9e99c2013-10-19 00:11:06 +020040 ``'x'``, ``'xb'``, ``'a'`` or ``'ab'`` for binary mode, or ``'rt'``,
41 ``'wt'``, ``'xt'``, or ``'at'`` for text mode. The default is ``'rb'``.
Nadeem Vawdaaf518c12012-06-04 23:32:38 +020042
43 The *compresslevel* argument is an integer from 1 to 9, as for the
44 :class:`BZ2File` constructor.
45
46 For binary mode, this function is equivalent to the :class:`BZ2File`
47 constructor: ``BZ2File(filename, mode, compresslevel=compresslevel)``. In
48 this case, the *encoding*, *errors* and *newline* arguments must not be
49 provided.
50
51 For text mode, a :class:`BZ2File` object is created, and wrapped in an
52 :class:`io.TextIOWrapper` instance with the specified encoding, error
53 handling behavior, and line ending(s).
54
55 .. versionadded:: 3.3
56
Nadeem Vawda8a9e99c2013-10-19 00:11:06 +020057 .. versionchanged:: 3.4
58 The ``'x'`` (exclusive creation) mode was added.
59
Nadeem Vawdaaf518c12012-06-04 23:32:38 +020060
Nadeem Vawdaaebcdba2012-06-04 23:31:20 +020061.. class:: BZ2File(filename, mode='r', buffering=None, compresslevel=9)
Georg Brandl116aa622007-08-15 14:28:22 +000062
Nadeem Vawdaaf518c12012-06-04 23:32:38 +020063 Open a bzip2-compressed file in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +000064
Nadeem Vawdaaebcdba2012-06-04 23:31:20 +020065 If *filename* is a :class:`str` or :class:`bytes` object, open the named file
66 directly. Otherwise, *filename* should be a :term:`file object`, which will
67 be used to read or write the compressed data.
Georg Brandl116aa622007-08-15 14:28:22 +000068
Nadeem Vawda200e00a2011-05-27 01:52:16 +020069 The *mode* argument can be either ``'r'`` for reading (default), ``'w'`` for
Nadeem Vawda8a9e99c2013-10-19 00:11:06 +020070 overwriting, ``'x'`` for exclusive creation, or ``'a'`` for appending. These
71 can equivalently be given as ``'rb'``, ``'wb'``, ``'xb'`` and ``'ab'``
72 respectively.
Nadeem Vawda50cb9362012-06-04 23:31:22 +020073
74 If *filename* is a file object (rather than an actual file name), a mode of
75 ``'w'`` does not truncate the file, and is instead equivalent to ``'a'``.
Georg Brandl116aa622007-08-15 14:28:22 +000076
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020077 The *buffering* argument is ignored. Its use is deprecated.
78
Nadeem Vawda200e00a2011-05-27 01:52:16 +020079 If *mode* is ``'w'`` or ``'a'``, *compresslevel* can be a number between
80 ``1`` and ``9`` specifying the level of compression: ``1`` produces the
81 least compression, and ``9`` (default) produces the most compression.
82
83 If *mode* is ``'r'``, the input file may be the concatenation of multiple
84 compressed streams.
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020085
86 :class:`BZ2File` provides all of the members specified by the
87 :class:`io.BufferedIOBase`, except for :meth:`detach` and :meth:`truncate`.
88 Iteration and the :keyword:`with` statement are supported.
89
90 :class:`BZ2File` also provides the following method:
91
92 .. method:: peek([n])
93
94 Return buffered data without advancing the file position. At least one
95 byte of data will be returned (unless at EOF). The exact number of bytes
96 returned is unspecified.
97
98 .. versionadded:: 3.3
Benjamin Petersone0124bd2009-03-09 21:04:33 +000099
Benjamin Peterson10745a92009-03-09 21:08:47 +0000100 .. versionchanged:: 3.1
Benjamin Petersone0124bd2009-03-09 21:04:33 +0000101 Support for the :keyword:`with` statement was added.
102
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200103 .. versionchanged:: 3.3
104 The :meth:`fileno`, :meth:`readable`, :meth:`seekable`, :meth:`writable`,
105 :meth:`read1` and :meth:`readinto` methods were added.
Georg Brandl116aa622007-08-15 14:28:22 +0000106
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200107 .. versionchanged:: 3.3
Nadeem Vawdaaebcdba2012-06-04 23:31:20 +0200108 Support was added for *filename* being a :term:`file object` instead of an
109 actual filename.
Georg Brandl116aa622007-08-15 14:28:22 +0000110
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200111 .. versionchanged:: 3.3
112 The ``'a'`` (append) mode was added, along with support for reading
113 multi-stream files.
114
Nadeem Vawda8a9e99c2013-10-19 00:11:06 +0200115 .. versionchanged:: 3.4
116 The ``'x'`` (exclusive creation) mode was added.
117
Georg Brandl116aa622007-08-15 14:28:22 +0000118
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200119Incremental (de)compression
120---------------------------
Georg Brandl116aa622007-08-15 14:28:22 +0000121
Georg Brandl0d8f0732009-04-05 22:20:44 +0000122.. class:: BZ2Compressor(compresslevel=9)
Georg Brandl116aa622007-08-15 14:28:22 +0000123
124 Create a new compressor object. This object may be used to compress data
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200125 incrementally. For one-shot compression, use the :func:`compress` function
126 instead.
127
128 *compresslevel*, if given, must be a number between ``1`` and ``9``. The
129 default is ``9``.
Georg Brandl116aa622007-08-15 14:28:22 +0000130
Benjamin Petersone41251e2008-04-25 01:59:09 +0000131 .. method:: compress(data)
Georg Brandl116aa622007-08-15 14:28:22 +0000132
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200133 Provide data to the compressor object. Returns a chunk of compressed data
134 if possible, or an empty byte string otherwise.
135
136 When you have finished providing data to the compressor, call the
137 :meth:`flush` method to finish the compression process.
Georg Brandl116aa622007-08-15 14:28:22 +0000138
139
Benjamin Petersone41251e2008-04-25 01:59:09 +0000140 .. method:: flush()
Georg Brandl116aa622007-08-15 14:28:22 +0000141
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200142 Finish the compression process. Returns the compressed data left in
143 internal buffers.
144
145 The compressor object may not be used after this method has been called.
Georg Brandl116aa622007-08-15 14:28:22 +0000146
147
148.. class:: BZ2Decompressor()
149
150 Create a new decompressor object. This object may be used to decompress data
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200151 incrementally. For one-shot compression, use the :func:`decompress` function
152 instead.
Georg Brandl116aa622007-08-15 14:28:22 +0000153
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200154 .. note::
155 This class does not transparently handle inputs containing multiple
156 compressed streams, unlike :func:`decompress` and :class:`BZ2File`. If
157 you need to decompress a multi-stream input with :class:`BZ2Decompressor`,
158 you must use a new decompressor for each stream.
159
Benjamin Petersone41251e2008-04-25 01:59:09 +0000160 .. method:: decompress(data)
Georg Brandl116aa622007-08-15 14:28:22 +0000161
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200162 Provide data to the decompressor object. Returns a chunk of decompressed
163 data if possible, or an empty byte string otherwise.
164
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200165 Attempting to decompress data after the end of the current stream is
166 reached raises an :exc:`EOFError`. If any data is found after the end of
167 the stream, it is ignored and saved in the :attr:`unused_data` attribute.
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200168
169
170 .. attribute:: eof
171
172 True if the end-of-stream marker has been reached.
173
174 .. versionadded:: 3.3
175
176
177 .. attribute:: unused_data
178
179 Data found after the end of the compressed stream.
Georg Brandl116aa622007-08-15 14:28:22 +0000180
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200181 If this attribute is accessed before the end of the stream has been
182 reached, its value will be ``b''``.
183
Georg Brandl116aa622007-08-15 14:28:22 +0000184
185One-shot (de)compression
186------------------------
187
Georg Brandl0d8f0732009-04-05 22:20:44 +0000188.. function:: compress(data, compresslevel=9)
Georg Brandl116aa622007-08-15 14:28:22 +0000189
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200190 Compress *data*.
191
192 *compresslevel*, if given, must be a number between ``1`` and ``9``. The
193 default is ``9``.
194
195 For incremental compression, use a :class:`BZ2Compressor` instead.
Georg Brandl116aa622007-08-15 14:28:22 +0000196
197
198.. function:: decompress(data)
199
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200200 Decompress *data*.
201
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200202 If *data* is the concatenation of multiple compressed streams, decompress
203 all of the streams.
204
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200205 For incremental decompression, use a :class:`BZ2Decompressor` instead.
Georg Brandl116aa622007-08-15 14:28:22 +0000206
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200207 .. versionchanged:: 3.3
208 Support for multi-stream inputs was added.
209