blob: b79bccdb31e862c09af7decc31c07dfe9b635cef [file] [log] [blame]
Antoine Pitrou37dc5f82011-04-03 17:05:46 +02001:mod:`bz2` --- Support for :program:`bzip2` compression
2=======================================================
Georg Brandl116aa622007-08-15 14:28:22 +00003
4.. module:: bz2
Antoine Pitrou37dc5f82011-04-03 17:05:46 +02005 :synopsis: Interfaces for bzip2 compression and decompression.
Georg Brandl116aa622007-08-15 14:28:22 +00006.. moduleauthor:: Gustavo Niemeyer <niemeyer@conectiva.com>
Antoine Pitrou37dc5f82011-04-03 17:05:46 +02007.. moduleauthor:: Nadeem Vawda <nadeem.vawda@gmail.com>
Georg Brandl116aa622007-08-15 14:28:22 +00008.. sectionauthor:: Gustavo Niemeyer <niemeyer@conectiva.com>
Antoine Pitrou37dc5f82011-04-03 17:05:46 +02009.. sectionauthor:: Nadeem Vawda <nadeem.vawda@gmail.com>
Georg Brandl116aa622007-08-15 14:28:22 +000010
11
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020012This module provides a comprehensive interface for compressing and
13decompressing data using the bzip2 compression algorithm.
Georg Brandl116aa622007-08-15 14:28:22 +000014
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020015The :mod:`bz2` module contains:
Georg Brandl116aa622007-08-15 14:28:22 +000016
Nadeem Vawdaaf518c12012-06-04 23:32:38 +020017* The :func:`.open` function and :class:`BZ2File` class for reading and
18 writing compressed files.
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020019* The :class:`BZ2Compressor` and :class:`BZ2Decompressor` classes for
20 incremental (de)compression.
21* The :func:`compress` and :func:`decompress` functions for one-shot
22 (de)compression.
Georg Brandl116aa622007-08-15 14:28:22 +000023
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020024All of the classes in this module may safely be accessed from multiple threads.
Georg Brandl116aa622007-08-15 14:28:22 +000025
26
27(De)compression of files
28------------------------
29
Nadeem Vawdaaf518c12012-06-04 23:32:38 +020030.. function:: open(filename, mode='r', compresslevel=9, encoding=None, errors=None, newline=None)
31
32 Open a bzip2-compressed file in binary or text mode, returning a :term:`file
33 object`.
34
35 As with the constructor for :class:`BZ2File`, the *filename* argument can be
36 an actual filename (a :class:`str` or :class:`bytes` object), or an existing
37 file object to read from or write to.
38
39 The *mode* argument can be any of ``'r'``, ``'rb'``, ``'w'``, ``'wb'``,
40 ``'a'``, or ``'ab'`` for binary mode, or ``'rt'``, ``'wt'``, or ``'at'`` for
41 text mode. The default is ``'rb'``.
42
43 The *compresslevel* argument is an integer from 1 to 9, as for the
44 :class:`BZ2File` constructor.
45
46 For binary mode, this function is equivalent to the :class:`BZ2File`
47 constructor: ``BZ2File(filename, mode, compresslevel=compresslevel)``. In
48 this case, the *encoding*, *errors* and *newline* arguments must not be
49 provided.
50
51 For text mode, a :class:`BZ2File` object is created, and wrapped in an
52 :class:`io.TextIOWrapper` instance with the specified encoding, error
53 handling behavior, and line ending(s).
54
55 .. versionadded:: 3.3
56
57
Nadeem Vawdaaebcdba2012-06-04 23:31:20 +020058.. class:: BZ2File(filename, mode='r', buffering=None, compresslevel=9)
Georg Brandl116aa622007-08-15 14:28:22 +000059
Nadeem Vawdaaf518c12012-06-04 23:32:38 +020060 Open a bzip2-compressed file in binary mode.
Georg Brandl116aa622007-08-15 14:28:22 +000061
Nadeem Vawdaaebcdba2012-06-04 23:31:20 +020062 If *filename* is a :class:`str` or :class:`bytes` object, open the named file
63 directly. Otherwise, *filename* should be a :term:`file object`, which will
64 be used to read or write the compressed data.
Georg Brandl116aa622007-08-15 14:28:22 +000065
Nadeem Vawda200e00a2011-05-27 01:52:16 +020066 The *mode* argument can be either ``'r'`` for reading (default), ``'w'`` for
Nadeem Vawda50cb9362012-06-04 23:31:22 +020067 overwriting, or ``'a'`` for appending. These can equivalently be given as
68 ``'rb'``, ``'wb'``, and ``'ab'`` respectively.
69
70 If *filename* is a file object (rather than an actual file name), a mode of
71 ``'w'`` does not truncate the file, and is instead equivalent to ``'a'``.
Georg Brandl116aa622007-08-15 14:28:22 +000072
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020073 The *buffering* argument is ignored. Its use is deprecated.
74
Nadeem Vawda200e00a2011-05-27 01:52:16 +020075 If *mode* is ``'w'`` or ``'a'``, *compresslevel* can be a number between
76 ``1`` and ``9`` specifying the level of compression: ``1`` produces the
77 least compression, and ``9`` (default) produces the most compression.
78
79 If *mode* is ``'r'``, the input file may be the concatenation of multiple
80 compressed streams.
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020081
82 :class:`BZ2File` provides all of the members specified by the
83 :class:`io.BufferedIOBase`, except for :meth:`detach` and :meth:`truncate`.
84 Iteration and the :keyword:`with` statement are supported.
85
86 :class:`BZ2File` also provides the following method:
87
88 .. method:: peek([n])
89
90 Return buffered data without advancing the file position. At least one
91 byte of data will be returned (unless at EOF). The exact number of bytes
92 returned is unspecified.
93
Nadeem Vawda69761042013-12-08 19:47:22 +010094 .. note:: While calling :meth:`peek` does not change the file position of
95 the :class:`BZ2File`, it may change the position of the underlying file
96 object (e.g. if the :class:`BZ2File` was constructed by passing a file
97 object for *filename*).
98
Antoine Pitrou37dc5f82011-04-03 17:05:46 +020099 .. versionadded:: 3.3
Benjamin Petersone0124bd2009-03-09 21:04:33 +0000100
Benjamin Peterson10745a92009-03-09 21:08:47 +0000101 .. versionchanged:: 3.1
Benjamin Petersone0124bd2009-03-09 21:04:33 +0000102 Support for the :keyword:`with` statement was added.
103
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200104 .. versionchanged:: 3.3
105 The :meth:`fileno`, :meth:`readable`, :meth:`seekable`, :meth:`writable`,
106 :meth:`read1` and :meth:`readinto` methods were added.
Georg Brandl116aa622007-08-15 14:28:22 +0000107
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200108 .. versionchanged:: 3.3
Nadeem Vawdaaebcdba2012-06-04 23:31:20 +0200109 Support was added for *filename* being a :term:`file object` instead of an
110 actual filename.
Georg Brandl116aa622007-08-15 14:28:22 +0000111
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200112 .. versionchanged:: 3.3
113 The ``'a'`` (append) mode was added, along with support for reading
114 multi-stream files.
115
Georg Brandl116aa622007-08-15 14:28:22 +0000116
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200117Incremental (de)compression
118---------------------------
Georg Brandl116aa622007-08-15 14:28:22 +0000119
Georg Brandl0d8f0732009-04-05 22:20:44 +0000120.. class:: BZ2Compressor(compresslevel=9)
Georg Brandl116aa622007-08-15 14:28:22 +0000121
122 Create a new compressor object. This object may be used to compress data
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200123 incrementally. For one-shot compression, use the :func:`compress` function
124 instead.
125
126 *compresslevel*, if given, must be a number between ``1`` and ``9``. The
127 default is ``9``.
Georg Brandl116aa622007-08-15 14:28:22 +0000128
Benjamin Petersone41251e2008-04-25 01:59:09 +0000129 .. method:: compress(data)
Georg Brandl116aa622007-08-15 14:28:22 +0000130
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200131 Provide data to the compressor object. Returns a chunk of compressed data
132 if possible, or an empty byte string otherwise.
133
134 When you have finished providing data to the compressor, call the
135 :meth:`flush` method to finish the compression process.
Georg Brandl116aa622007-08-15 14:28:22 +0000136
137
Benjamin Petersone41251e2008-04-25 01:59:09 +0000138 .. method:: flush()
Georg Brandl116aa622007-08-15 14:28:22 +0000139
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200140 Finish the compression process. Returns the compressed data left in
141 internal buffers.
142
143 The compressor object may not be used after this method has been called.
Georg Brandl116aa622007-08-15 14:28:22 +0000144
145
146.. class:: BZ2Decompressor()
147
148 Create a new decompressor object. This object may be used to decompress data
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200149 incrementally. For one-shot compression, use the :func:`decompress` function
150 instead.
Georg Brandl116aa622007-08-15 14:28:22 +0000151
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200152 .. note::
153 This class does not transparently handle inputs containing multiple
154 compressed streams, unlike :func:`decompress` and :class:`BZ2File`. If
155 you need to decompress a multi-stream input with :class:`BZ2Decompressor`,
156 you must use a new decompressor for each stream.
157
Benjamin Petersone41251e2008-04-25 01:59:09 +0000158 .. method:: decompress(data)
Georg Brandl116aa622007-08-15 14:28:22 +0000159
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200160 Provide data to the decompressor object. Returns a chunk of decompressed
161 data if possible, or an empty byte string otherwise.
162
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200163 Attempting to decompress data after the end of the current stream is
164 reached raises an :exc:`EOFError`. If any data is found after the end of
165 the stream, it is ignored and saved in the :attr:`unused_data` attribute.
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200166
167
168 .. attribute:: eof
169
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200170 ``True`` if the end-of-stream marker has been reached.
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200171
172 .. versionadded:: 3.3
173
174
175 .. attribute:: unused_data
176
177 Data found after the end of the compressed stream.
Georg Brandl116aa622007-08-15 14:28:22 +0000178
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200179 If this attribute is accessed before the end of the stream has been
180 reached, its value will be ``b''``.
181
Georg Brandl116aa622007-08-15 14:28:22 +0000182
183One-shot (de)compression
184------------------------
185
Georg Brandl0d8f0732009-04-05 22:20:44 +0000186.. function:: compress(data, compresslevel=9)
Georg Brandl116aa622007-08-15 14:28:22 +0000187
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200188 Compress *data*.
189
190 *compresslevel*, if given, must be a number between ``1`` and ``9``. The
191 default is ``9``.
192
193 For incremental compression, use a :class:`BZ2Compressor` instead.
Georg Brandl116aa622007-08-15 14:28:22 +0000194
195
196.. function:: decompress(data)
197
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200198 Decompress *data*.
199
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200200 If *data* is the concatenation of multiple compressed streams, decompress
201 all of the streams.
202
Antoine Pitrou37dc5f82011-04-03 17:05:46 +0200203 For incremental decompression, use a :class:`BZ2Decompressor` instead.
Georg Brandl116aa622007-08-15 14:28:22 +0000204
Nadeem Vawda200e00a2011-05-27 01:52:16 +0200205 .. versionchanged:: 3.3
206 Support for multi-stream inputs was added.
207