blob: b3a3215963d14a784b91e35c6baad123342534ff [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`bz2` --- Compression compatible with :program:`bzip2`
2===========================================================
3
4.. module:: bz2
Georg Brandl0d8f0732009-04-05 22:20:44 +00005 :synopsis: Interface to compression and decompression routines
6 compatible with bzip2.
Georg Brandl116aa622007-08-15 14:28:22 +00007.. moduleauthor:: Gustavo Niemeyer <niemeyer@conectiva.com>
8.. sectionauthor:: Gustavo Niemeyer <niemeyer@conectiva.com>
9
10
Georg Brandl116aa622007-08-15 14:28:22 +000011This module provides a comprehensive interface for the bz2 compression library.
12It implements a complete file interface, one-shot (de)compression functions, and
13types for sequential (de)compression.
14
Guido van Rossum77677112007-11-05 19:43:04 +000015For other archive formats, see the :mod:`gzip`, :mod:`zipfile`, and
16:mod:`tarfile` modules.
17
18Here is a summary of the features offered by the bz2 module:
Georg Brandl116aa622007-08-15 14:28:22 +000019
20* :class:`BZ2File` class implements a complete file interface, including
21 :meth:`readline`, :meth:`readlines`, :meth:`writelines`, :meth:`seek`, etc;
22
23* :class:`BZ2File` class implements emulated :meth:`seek` support;
24
25* :class:`BZ2File` class implements universal newline support;
26
27* :class:`BZ2File` class offers an optimized line iteration using the readahead
28 algorithm borrowed from file objects;
29
30* Sequential (de)compression supported by :class:`BZ2Compressor` and
31 :class:`BZ2Decompressor` classes;
32
33* One-shot (de)compression supported by :func:`compress` and :func:`decompress`
34 functions;
35
Guido van Rossum77677112007-11-05 19:43:04 +000036* Thread safety uses individual locking mechanism.
Georg Brandl116aa622007-08-15 14:28:22 +000037
38
39(De)compression of files
40------------------------
41
42Handling of compressed files is offered by the :class:`BZ2File` class.
43
44
Georg Brandl0d8f0732009-04-05 22:20:44 +000045.. class:: BZ2File(filename, mode='r', buffering=0, compresslevel=9)
Georg Brandl116aa622007-08-15 14:28:22 +000046
Benjamin Petersone41251e2008-04-25 01:59:09 +000047 Open a bz2 file. Mode can be either ``'r'`` or ``'w'``, for reading (default)
Georg Brandl116aa622007-08-15 14:28:22 +000048 or writing. When opened for writing, the file will be created if it doesn't
Benjamin Petersone41251e2008-04-25 01:59:09 +000049 exist, and truncated otherwise. If *buffering* is given, ``0`` means
50 unbuffered, and larger numbers specify the buffer size; the default is
51 ``0``. If *compresslevel* is given, it must be a number between ``1`` and
52 ``9``; the default is ``9``. Add a ``'U'`` to mode to open the file for input
53 with universal newline support. Any line ending in the input file will be
54 seen as a ``'\n'`` in Python. Also, a file so opened gains the attribute
Georg Brandl116aa622007-08-15 14:28:22 +000055 :attr:`newlines`; the value for this attribute is one of ``None`` (no newline
Benjamin Petersone41251e2008-04-25 01:59:09 +000056 read yet), ``'\r'``, ``'\n'``, ``'\r\n'`` or a tuple containing all the
57 newline types seen. Universal newlines are available only when
58 reading. Instances support iteration in the same way as normal :class:`file`
59 instances.
Georg Brandl116aa622007-08-15 14:28:22 +000060
Benjamin Petersone0124bd2009-03-09 21:04:33 +000061 :class:`BZ2File` supports the :keyword:`with` statement.
62
Benjamin Peterson10745a92009-03-09 21:08:47 +000063 .. versionchanged:: 3.1
Benjamin Petersone0124bd2009-03-09 21:04:33 +000064 Support for the :keyword:`with` statement was added.
65
Georg Brandl116aa622007-08-15 14:28:22 +000066
Benjamin Petersone41251e2008-04-25 01:59:09 +000067 .. method:: close()
Georg Brandl116aa622007-08-15 14:28:22 +000068
Benjamin Petersone41251e2008-04-25 01:59:09 +000069 Close the file. Sets data attribute :attr:`closed` to true. A closed file
70 cannot be used for further I/O operations. :meth:`close` may be called
71 more than once without error.
Georg Brandl116aa622007-08-15 14:28:22 +000072
73
Benjamin Petersone41251e2008-04-25 01:59:09 +000074 .. method:: read([size])
Georg Brandl116aa622007-08-15 14:28:22 +000075
Ezio Melotti6540a822010-03-12 22:45:38 +000076 Read at most *size* uncompressed bytes, returned as a byte string. If the
Benjamin Petersone41251e2008-04-25 01:59:09 +000077 *size* argument is negative or omitted, read until EOF is reached.
Georg Brandl116aa622007-08-15 14:28:22 +000078
79
Benjamin Petersone41251e2008-04-25 01:59:09 +000080 .. method:: readline([size])
Georg Brandl116aa622007-08-15 14:28:22 +000081
Ezio Melotti6540a822010-03-12 22:45:38 +000082 Return the next line from the file, as a byte string, retaining newline.
83 A non-negative *size* argument limits the maximum number of bytes to
84 return (an incomplete line may be returned then). Return an empty byte
85 string at EOF.
Georg Brandl116aa622007-08-15 14:28:22 +000086
87
Benjamin Petersone41251e2008-04-25 01:59:09 +000088 .. method:: readlines([size])
Georg Brandl116aa622007-08-15 14:28:22 +000089
Benjamin Petersone41251e2008-04-25 01:59:09 +000090 Return a list of lines read. The optional *size* argument, if given, is an
91 approximate bound on the total number of bytes in the lines returned.
Georg Brandl116aa622007-08-15 14:28:22 +000092
93
Benjamin Petersone41251e2008-04-25 01:59:09 +000094 .. method:: seek(offset[, whence])
Georg Brandl116aa622007-08-15 14:28:22 +000095
Benjamin Petersone41251e2008-04-25 01:59:09 +000096 Move to new file position. Argument *offset* is a byte count. Optional
97 argument *whence* defaults to ``os.SEEK_SET`` or ``0`` (offset from start
98 of file; offset should be ``>= 0``); other values are ``os.SEEK_CUR`` or
99 ``1`` (move relative to current position; offset can be positive or
100 negative), and ``os.SEEK_END`` or ``2`` (move relative to end of file;
101 offset is usually negative, although many platforms allow seeking beyond
102 the end of a file).
Georg Brandl116aa622007-08-15 14:28:22 +0000103
Benjamin Petersone41251e2008-04-25 01:59:09 +0000104 Note that seeking of bz2 files is emulated, and depending on the
105 parameters the operation may be extremely slow.
Georg Brandl116aa622007-08-15 14:28:22 +0000106
107
Benjamin Petersone41251e2008-04-25 01:59:09 +0000108 .. method:: tell()
Georg Brandl116aa622007-08-15 14:28:22 +0000109
Benjamin Petersone41251e2008-04-25 01:59:09 +0000110 Return the current file position, an integer.
Georg Brandl116aa622007-08-15 14:28:22 +0000111
112
Benjamin Petersone41251e2008-04-25 01:59:09 +0000113 .. method:: write(data)
Georg Brandl116aa622007-08-15 14:28:22 +0000114
Ezio Melotti6540a822010-03-12 22:45:38 +0000115 Write the byte string *data* to file. Note that due to buffering,
116 :meth:`close` may be needed before the file on disk reflects the data
117 written.
Georg Brandl116aa622007-08-15 14:28:22 +0000118
119
Ezio Melotti6540a822010-03-12 22:45:38 +0000120 .. method:: writelines(sequence_of_byte_strings)
Georg Brandl116aa622007-08-15 14:28:22 +0000121
Ezio Melotti6540a822010-03-12 22:45:38 +0000122 Write the sequence of byte strings to the file. Note that newlines are not
123 added. The sequence can be any iterable object producing byte strings.
124 This is equivalent to calling write() for each byte string.
Georg Brandl116aa622007-08-15 14:28:22 +0000125
126
127Sequential (de)compression
128--------------------------
129
130Sequential compression and decompression is done using the classes
131:class:`BZ2Compressor` and :class:`BZ2Decompressor`.
132
133
Georg Brandl0d8f0732009-04-05 22:20:44 +0000134.. class:: BZ2Compressor(compresslevel=9)
Georg Brandl116aa622007-08-15 14:28:22 +0000135
136 Create a new compressor object. This object may be used to compress data
Benjamin Petersone41251e2008-04-25 01:59:09 +0000137 sequentially. If you want to compress data in one shot, use the
138 :func:`compress` function instead. The *compresslevel* parameter, if given,
139 must be a number between ``1`` and ``9``; the default is ``9``.
Georg Brandl116aa622007-08-15 14:28:22 +0000140
Benjamin Petersone41251e2008-04-25 01:59:09 +0000141 .. method:: compress(data)
Georg Brandl116aa622007-08-15 14:28:22 +0000142
Benjamin Petersone41251e2008-04-25 01:59:09 +0000143 Provide more data to the compressor object. It will return chunks of
144 compressed data whenever possible. When you've finished providing data to
145 compress, call the :meth:`flush` method to finish the compression process,
146 and return what is left in internal buffers.
Georg Brandl116aa622007-08-15 14:28:22 +0000147
148
Benjamin Petersone41251e2008-04-25 01:59:09 +0000149 .. method:: flush()
Georg Brandl116aa622007-08-15 14:28:22 +0000150
Benjamin Petersone41251e2008-04-25 01:59:09 +0000151 Finish the compression process and return what is left in internal
152 buffers. You must not use the compressor object after calling this method.
Georg Brandl116aa622007-08-15 14:28:22 +0000153
154
155.. class:: BZ2Decompressor()
156
157 Create a new decompressor object. This object may be used to decompress data
158 sequentially. If you want to decompress data in one shot, use the
159 :func:`decompress` function instead.
160
Benjamin Petersone41251e2008-04-25 01:59:09 +0000161 .. method:: decompress(data)
Georg Brandl116aa622007-08-15 14:28:22 +0000162
Benjamin Petersone41251e2008-04-25 01:59:09 +0000163 Provide more data to the decompressor object. It will return chunks of
164 decompressed data whenever possible. If you try to decompress data after
165 the end of stream is found, :exc:`EOFError` will be raised. If any data
166 was found after the end of stream, it'll be ignored and saved in
167 :attr:`unused_data` attribute.
Georg Brandl116aa622007-08-15 14:28:22 +0000168
169
170One-shot (de)compression
171------------------------
172
173One-shot compression and decompression is provided through the :func:`compress`
174and :func:`decompress` functions.
175
176
Georg Brandl0d8f0732009-04-05 22:20:44 +0000177.. function:: compress(data, compresslevel=9)
Georg Brandl116aa622007-08-15 14:28:22 +0000178
Benjamin Petersone41251e2008-04-25 01:59:09 +0000179 Compress *data* in one shot. If you want to compress data sequentially, use
180 an instance of :class:`BZ2Compressor` instead. The *compresslevel* parameter,
181 if given, must be a number between ``1`` and ``9``; the default is ``9``.
Georg Brandl116aa622007-08-15 14:28:22 +0000182
183
184.. function:: decompress(data)
185
Benjamin Petersone41251e2008-04-25 01:59:09 +0000186 Decompress *data* in one shot. If you want to decompress data sequentially,
187 use an instance of :class:`BZ2Decompressor` instead.
Georg Brandl116aa622007-08-15 14:28:22 +0000188