Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 1 | |
| 2 | :mod:`bz2` --- Compression compatible with :program:`bzip2` |
| 3 | =========================================================== |
| 4 | |
| 5 | .. module:: bz2 |
| 6 | :synopsis: Interface to compression and decompression routines compatible with bzip2. |
| 7 | .. moduleauthor:: Gustavo Niemeyer <niemeyer@conectiva.com> |
| 8 | .. sectionauthor:: Gustavo Niemeyer <niemeyer@conectiva.com> |
| 9 | |
| 10 | |
| 11 | .. versionadded:: 2.3 |
| 12 | |
| 13 | This module provides a comprehensive interface for the bz2 compression library. |
| 14 | It implements a complete file interface, one-shot (de)compression functions, and |
| 15 | types for sequential (de)compression. |
| 16 | |
Mark Summerfield | aea6e59 | 2007-11-05 09:22:48 +0000 | [diff] [blame] | 17 | For other archive formats, see the :mod:`gzip`, :mod:`zipfile`, and |
| 18 | :mod:`tarfile` modules. |
| 19 | |
| 20 | Here is a summary of the features offered by the bz2 module: |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 21 | |
| 22 | * :class:`BZ2File` class implements a complete file interface, including |
Ezio Melotti | c4785a7 | 2010-03-13 00:15:36 +0000 | [diff] [blame] | 23 | :meth:`~BZ2File.readline`, :meth:`~BZ2File.readlines`, |
| 24 | :meth:`~BZ2File.writelines`, :meth:`~BZ2File.seek`, etc; |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 25 | |
Ezio Melotti | c4785a7 | 2010-03-13 00:15:36 +0000 | [diff] [blame] | 26 | * :class:`BZ2File` class implements emulated :meth:`~BZ2File.seek` support; |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 27 | |
| 28 | * :class:`BZ2File` class implements universal newline support; |
| 29 | |
| 30 | * :class:`BZ2File` class offers an optimized line iteration using the readahead |
| 31 | algorithm borrowed from file objects; |
| 32 | |
| 33 | * Sequential (de)compression supported by :class:`BZ2Compressor` and |
| 34 | :class:`BZ2Decompressor` classes; |
| 35 | |
| 36 | * One-shot (de)compression supported by :func:`compress` and :func:`decompress` |
| 37 | functions; |
| 38 | |
Mark Summerfield | aea6e59 | 2007-11-05 09:22:48 +0000 | [diff] [blame] | 39 | * Thread safety uses individual locking mechanism. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 40 | |
| 41 | |
| 42 | (De)compression of files |
| 43 | ------------------------ |
| 44 | |
| 45 | Handling of compressed files is offered by the :class:`BZ2File` class. |
| 46 | |
| 47 | |
| 48 | .. class:: BZ2File(filename[, mode[, buffering[, compresslevel]]]) |
| 49 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 50 | Open a bz2 file. Mode can be either ``'r'`` or ``'w'``, for reading (default) |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 51 | or writing. When opened for writing, the file will be created if it doesn't |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 52 | exist, and truncated otherwise. If *buffering* is given, ``0`` means |
| 53 | unbuffered, and larger numbers specify the buffer size; the default is |
| 54 | ``0``. If *compresslevel* is given, it must be a number between ``1`` and |
| 55 | ``9``; the default is ``9``. Add a ``'U'`` to mode to open the file for input |
| 56 | with universal newline support. Any line ending in the input file will be |
| 57 | seen as a ``'\n'`` in Python. Also, a file so opened gains the attribute |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 58 | :attr:`newlines`; the value for this attribute is one of ``None`` (no newline |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 59 | read yet), ``'\r'``, ``'\n'``, ``'\r\n'`` or a tuple containing all the |
| 60 | newline types seen. Universal newlines are available only when |
| 61 | reading. Instances support iteration in the same way as normal :class:`file` |
| 62 | instances. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 63 | |
Benjamin Peterson | 6d83429 | 2009-03-09 20:38:56 +0000 | [diff] [blame] | 64 | :class:`BZ2File` supports the :keyword:`with` statement. |
| 65 | |
| 66 | .. versionchanged:: 2.7 |
| 67 | Support for the :keyword:`with` statement was added. |
| 68 | |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 69 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 70 | .. method:: close() |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 71 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 72 | Close the file. Sets data attribute :attr:`closed` to true. A closed file |
| 73 | cannot be used for further I/O operations. :meth:`close` may be called |
| 74 | more than once without error. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 75 | |
| 76 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 77 | .. method:: read([size]) |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 78 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 79 | Read at most *size* uncompressed bytes, returned as a string. If the |
| 80 | *size* argument is negative or omitted, read until EOF is reached. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 81 | |
| 82 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 83 | .. method:: readline([size]) |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 84 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 85 | Return the next line from the file, as a string, retaining newline. A |
| 86 | non-negative *size* argument limits the maximum number of bytes to return |
| 87 | (an incomplete line may be returned then). Return an empty string at EOF. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 88 | |
| 89 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 90 | .. method:: readlines([size]) |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 91 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 92 | Return a list of lines read. The optional *size* argument, if given, is an |
| 93 | approximate bound on the total number of bytes in the lines returned. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 94 | |
| 95 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 96 | .. method:: xreadlines() |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 97 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 98 | For backward compatibility. :class:`BZ2File` objects now include the |
| 99 | performance optimizations previously implemented in the :mod:`xreadlines` |
| 100 | module. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 101 | |
Georg Brandl | c62ef8b | 2009-01-03 20:55:06 +0000 | [diff] [blame] | 102 | .. deprecated:: 2.3 |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 103 | This exists only for compatibility with the method by this name on |
| 104 | :class:`file` objects, which is deprecated. Use ``for line in file`` |
| 105 | instead. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 106 | |
| 107 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 108 | .. method:: seek(offset[, whence]) |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 109 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 110 | Move to new file position. Argument *offset* is a byte count. Optional |
| 111 | argument *whence* defaults to ``os.SEEK_SET`` or ``0`` (offset from start |
| 112 | of file; offset should be ``>= 0``); other values are ``os.SEEK_CUR`` or |
| 113 | ``1`` (move relative to current position; offset can be positive or |
| 114 | negative), and ``os.SEEK_END`` or ``2`` (move relative to end of file; |
| 115 | offset is usually negative, although many platforms allow seeking beyond |
| 116 | the end of a file). |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 117 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 118 | Note that seeking of bz2 files is emulated, and depending on the |
| 119 | parameters the operation may be extremely slow. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 120 | |
| 121 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 122 | .. method:: tell() |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 123 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 124 | Return the current file position, an integer (may be a long integer). |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 125 | |
| 126 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 127 | .. method:: write(data) |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 128 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 129 | Write string *data* to file. Note that due to buffering, :meth:`close` may |
| 130 | be needed before the file on disk reflects the data written. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 131 | |
| 132 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 133 | .. method:: writelines(sequence_of_strings) |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 134 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 135 | Write the sequence of strings to the file. Note that newlines are not |
| 136 | added. The sequence can be any iterable object producing strings. This is |
| 137 | equivalent to calling write() for each string. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 138 | |
| 139 | |
| 140 | Sequential (de)compression |
| 141 | -------------------------- |
| 142 | |
| 143 | Sequential compression and decompression is done using the classes |
| 144 | :class:`BZ2Compressor` and :class:`BZ2Decompressor`. |
| 145 | |
| 146 | |
| 147 | .. class:: BZ2Compressor([compresslevel]) |
| 148 | |
| 149 | Create a new compressor object. This object may be used to compress data |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 150 | sequentially. If you want to compress data in one shot, use the |
| 151 | :func:`compress` function instead. The *compresslevel* parameter, if given, |
| 152 | must be a number between ``1`` and ``9``; the default is ``9``. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 153 | |
| 154 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 155 | .. method:: compress(data) |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 156 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 157 | Provide more data to the compressor object. It will return chunks of |
| 158 | compressed data whenever possible. When you've finished providing data to |
| 159 | compress, call the :meth:`flush` method to finish the compression process, |
| 160 | and return what is left in internal buffers. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 161 | |
| 162 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 163 | .. method:: flush() |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 164 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 165 | Finish the compression process and return what is left in internal |
| 166 | buffers. You must not use the compressor object after calling this method. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 167 | |
| 168 | |
| 169 | .. class:: BZ2Decompressor() |
| 170 | |
| 171 | Create a new decompressor object. This object may be used to decompress data |
| 172 | sequentially. If you want to decompress data in one shot, use the |
| 173 | :func:`decompress` function instead. |
| 174 | |
| 175 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 176 | .. method:: decompress(data) |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 177 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 178 | Provide more data to the decompressor object. It will return chunks of |
| 179 | decompressed data whenever possible. If you try to decompress data after |
| 180 | the end of stream is found, :exc:`EOFError` will be raised. If any data |
| 181 | was found after the end of stream, it'll be ignored and saved in |
| 182 | :attr:`unused_data` attribute. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 183 | |
| 184 | |
| 185 | One-shot (de)compression |
| 186 | ------------------------ |
| 187 | |
| 188 | One-shot compression and decompression is provided through the :func:`compress` |
| 189 | and :func:`decompress` functions. |
| 190 | |
| 191 | |
| 192 | .. function:: compress(data[, compresslevel]) |
| 193 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 194 | Compress *data* in one shot. If you want to compress data sequentially, use |
| 195 | an instance of :class:`BZ2Compressor` instead. The *compresslevel* parameter, |
| 196 | if given, must be a number between ``1`` and ``9``; the default is ``9``. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 197 | |
| 198 | |
| 199 | .. function:: decompress(data) |
| 200 | |
Benjamin Peterson | c7b0592 | 2008-04-25 01:29:10 +0000 | [diff] [blame] | 201 | Decompress *data* in one shot. If you want to decompress data sequentially, |
| 202 | use an instance of :class:`BZ2Decompressor` instead. |
Georg Brandl | 8ec7f65 | 2007-08-15 14:28:01 +0000 | [diff] [blame] | 203 | |