blob: ed281bd72cea396c4ee6bef931eb4e84020cd153 [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001
2:mod:`bz2` --- Compression compatible with :program:`bzip2`
3===========================================================
4
5.. module:: bz2
6 :synopsis: Interface to compression and decompression routines compatible with bzip2.
7.. moduleauthor:: Gustavo Niemeyer <niemeyer@conectiva.com>
8.. sectionauthor:: Gustavo Niemeyer <niemeyer@conectiva.com>
9
10
11.. versionadded:: 2.3
12
13This module provides a comprehensive interface for the bz2 compression library.
14It implements a complete file interface, one-shot (de)compression functions, and
15types for sequential (de)compression.
16
Mark Summerfieldaea6e592007-11-05 09:22:48 +000017For other archive formats, see the :mod:`gzip`, :mod:`zipfile`, and
18:mod:`tarfile` modules.
19
20Here is a summary of the features offered by the bz2 module:
Georg Brandl8ec7f652007-08-15 14:28:01 +000021
22* :class:`BZ2File` class implements a complete file interface, including
Ezio Melottic4785a72010-03-13 00:15:36 +000023 :meth:`~BZ2File.readline`, :meth:`~BZ2File.readlines`,
24 :meth:`~BZ2File.writelines`, :meth:`~BZ2File.seek`, etc;
Georg Brandl8ec7f652007-08-15 14:28:01 +000025
Ezio Melottic4785a72010-03-13 00:15:36 +000026* :class:`BZ2File` class implements emulated :meth:`~BZ2File.seek` support;
Georg Brandl8ec7f652007-08-15 14:28:01 +000027
28* :class:`BZ2File` class implements universal newline support;
29
30* :class:`BZ2File` class offers an optimized line iteration using the readahead
31 algorithm borrowed from file objects;
32
33* Sequential (de)compression supported by :class:`BZ2Compressor` and
34 :class:`BZ2Decompressor` classes;
35
36* One-shot (de)compression supported by :func:`compress` and :func:`decompress`
37 functions;
38
Mark Summerfieldaea6e592007-11-05 09:22:48 +000039* Thread safety uses individual locking mechanism.
Georg Brandl8ec7f652007-08-15 14:28:01 +000040
41
42(De)compression of files
43------------------------
44
45Handling of compressed files is offered by the :class:`BZ2File` class.
46
47
48.. class:: BZ2File(filename[, mode[, buffering[, compresslevel]]])
49
Benjamin Petersonc7b05922008-04-25 01:29:10 +000050 Open a bz2 file. Mode can be either ``'r'`` or ``'w'``, for reading (default)
Georg Brandl8ec7f652007-08-15 14:28:01 +000051 or writing. When opened for writing, the file will be created if it doesn't
Benjamin Petersonc7b05922008-04-25 01:29:10 +000052 exist, and truncated otherwise. If *buffering* is given, ``0`` means
53 unbuffered, and larger numbers specify the buffer size; the default is
54 ``0``. If *compresslevel* is given, it must be a number between ``1`` and
55 ``9``; the default is ``9``. Add a ``'U'`` to mode to open the file for input
56 with universal newline support. Any line ending in the input file will be
57 seen as a ``'\n'`` in Python. Also, a file so opened gains the attribute
Georg Brandl8ec7f652007-08-15 14:28:01 +000058 :attr:`newlines`; the value for this attribute is one of ``None`` (no newline
Benjamin Petersonc7b05922008-04-25 01:29:10 +000059 read yet), ``'\r'``, ``'\n'``, ``'\r\n'`` or a tuple containing all the
60 newline types seen. Universal newlines are available only when
61 reading. Instances support iteration in the same way as normal :class:`file`
62 instances.
Georg Brandl8ec7f652007-08-15 14:28:01 +000063
Benjamin Peterson6d834292009-03-09 20:38:56 +000064 :class:`BZ2File` supports the :keyword:`with` statement.
65
66 .. versionchanged:: 2.7
67 Support for the :keyword:`with` statement was added.
68
Georg Brandl8ec7f652007-08-15 14:28:01 +000069
Benjamin Petersonc7b05922008-04-25 01:29:10 +000070 .. method:: close()
Georg Brandl8ec7f652007-08-15 14:28:01 +000071
Benjamin Petersonc7b05922008-04-25 01:29:10 +000072 Close the file. Sets data attribute :attr:`closed` to true. A closed file
73 cannot be used for further I/O operations. :meth:`close` may be called
74 more than once without error.
Georg Brandl8ec7f652007-08-15 14:28:01 +000075
76
Benjamin Petersonc7b05922008-04-25 01:29:10 +000077 .. method:: read([size])
Georg Brandl8ec7f652007-08-15 14:28:01 +000078
Benjamin Petersonc7b05922008-04-25 01:29:10 +000079 Read at most *size* uncompressed bytes, returned as a string. If the
80 *size* argument is negative or omitted, read until EOF is reached.
Georg Brandl8ec7f652007-08-15 14:28:01 +000081
82
Benjamin Petersonc7b05922008-04-25 01:29:10 +000083 .. method:: readline([size])
Georg Brandl8ec7f652007-08-15 14:28:01 +000084
Benjamin Petersonc7b05922008-04-25 01:29:10 +000085 Return the next line from the file, as a string, retaining newline. A
86 non-negative *size* argument limits the maximum number of bytes to return
87 (an incomplete line may be returned then). Return an empty string at EOF.
Georg Brandl8ec7f652007-08-15 14:28:01 +000088
89
Benjamin Petersonc7b05922008-04-25 01:29:10 +000090 .. method:: readlines([size])
Georg Brandl8ec7f652007-08-15 14:28:01 +000091
Benjamin Petersonc7b05922008-04-25 01:29:10 +000092 Return a list of lines read. The optional *size* argument, if given, is an
93 approximate bound on the total number of bytes in the lines returned.
Georg Brandl8ec7f652007-08-15 14:28:01 +000094
95
Benjamin Petersonc7b05922008-04-25 01:29:10 +000096 .. method:: xreadlines()
Georg Brandl8ec7f652007-08-15 14:28:01 +000097
Benjamin Petersonc7b05922008-04-25 01:29:10 +000098 For backward compatibility. :class:`BZ2File` objects now include the
99 performance optimizations previously implemented in the :mod:`xreadlines`
100 module.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000101
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000102 .. deprecated:: 2.3
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000103 This exists only for compatibility with the method by this name on
104 :class:`file` objects, which is deprecated. Use ``for line in file``
105 instead.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000106
107
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000108 .. method:: seek(offset[, whence])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000109
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000110 Move to new file position. Argument *offset* is a byte count. Optional
111 argument *whence* defaults to ``os.SEEK_SET`` or ``0`` (offset from start
112 of file; offset should be ``>= 0``); other values are ``os.SEEK_CUR`` or
113 ``1`` (move relative to current position; offset can be positive or
114 negative), and ``os.SEEK_END`` or ``2`` (move relative to end of file;
115 offset is usually negative, although many platforms allow seeking beyond
116 the end of a file).
Georg Brandl8ec7f652007-08-15 14:28:01 +0000117
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000118 Note that seeking of bz2 files is emulated, and depending on the
119 parameters the operation may be extremely slow.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000120
121
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000122 .. method:: tell()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000123
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000124 Return the current file position, an integer (may be a long integer).
Georg Brandl8ec7f652007-08-15 14:28:01 +0000125
126
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000127 .. method:: write(data)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000128
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000129 Write string *data* to file. Note that due to buffering, :meth:`close` may
130 be needed before the file on disk reflects the data written.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000131
132
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000133 .. method:: writelines(sequence_of_strings)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000134
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000135 Write the sequence of strings to the file. Note that newlines are not
136 added. The sequence can be any iterable object producing strings. This is
137 equivalent to calling write() for each string.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000138
139
140Sequential (de)compression
141--------------------------
142
143Sequential compression and decompression is done using the classes
144:class:`BZ2Compressor` and :class:`BZ2Decompressor`.
145
146
147.. class:: BZ2Compressor([compresslevel])
148
149 Create a new compressor object. This object may be used to compress data
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000150 sequentially. If you want to compress data in one shot, use the
151 :func:`compress` function instead. The *compresslevel* parameter, if given,
152 must be a number between ``1`` and ``9``; the default is ``9``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000153
154
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000155 .. method:: compress(data)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000156
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000157 Provide more data to the compressor object. It will return chunks of
158 compressed data whenever possible. When you've finished providing data to
159 compress, call the :meth:`flush` method to finish the compression process,
160 and return what is left in internal buffers.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000161
162
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000163 .. method:: flush()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000164
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000165 Finish the compression process and return what is left in internal
166 buffers. You must not use the compressor object after calling this method.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000167
168
169.. class:: BZ2Decompressor()
170
171 Create a new decompressor object. This object may be used to decompress data
172 sequentially. If you want to decompress data in one shot, use the
173 :func:`decompress` function instead.
174
175
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000176 .. method:: decompress(data)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000177
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000178 Provide more data to the decompressor object. It will return chunks of
179 decompressed data whenever possible. If you try to decompress data after
180 the end of stream is found, :exc:`EOFError` will be raised. If any data
181 was found after the end of stream, it'll be ignored and saved in
182 :attr:`unused_data` attribute.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000183
184
185One-shot (de)compression
186------------------------
187
188One-shot compression and decompression is provided through the :func:`compress`
189and :func:`decompress` functions.
190
191
192.. function:: compress(data[, compresslevel])
193
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000194 Compress *data* in one shot. If you want to compress data sequentially, use
195 an instance of :class:`BZ2Compressor` instead. The *compresslevel* parameter,
196 if given, must be a number between ``1`` and ``9``; the default is ``9``.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000197
198
199.. function:: decompress(data)
200
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000201 Decompress *data* in one shot. If you want to decompress data sequentially,
202 use an instance of :class:`BZ2Decompressor` instead.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000203