blob: 98d8679fa3dcda3d359101f0a8edf59470522c89 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`binascii` --- Convert between binary and ASCII
2====================================================
3
4.. module:: binascii
5 :synopsis: Tools for converting between binary and various ASCII-encoded binary
6 representations.
7
Georg Brandl116aa622007-08-15 14:28:22 +00008.. index::
9 module: uu
10 module: base64
11 module: binhex
12
Terry Jan Reedyfa089b92016-06-11 15:02:54 -040013--------------
14
Georg Brandl116aa622007-08-15 14:28:22 +000015The :mod:`binascii` module contains a number of methods to convert between
16binary and various ASCII-encoded binary representations. Normally, you will not
17use these functions directly but use wrapper modules like :mod:`uu`,
18:mod:`base64`, or :mod:`binhex` instead. The :mod:`binascii` module contains
19low-level functions written in C for greater speed that are used by the
20higher-level modules.
21
Florent Xiclunaf1046ca2010-07-27 21:20:15 +000022.. note::
23
Antoine Pitrou08316762011-12-20 13:58:41 +010024 ``a2b_*`` functions accept Unicode strings containing only ASCII characters.
Serhiy Storchakae5ea1ab2016-05-18 13:54:54 +030025 Other functions only accept :term:`bytes-like objects <bytes-like object>` (such as
Ezio Melottic228e962013-05-04 18:06:34 +030026 :class:`bytes`, :class:`bytearray` and other objects that support the buffer
27 protocol).
Antoine Pitrou08316762011-12-20 13:58:41 +010028
29 .. versionchanged:: 3.3
30 ASCII-only unicode strings are now accepted by the ``a2b_*`` functions.
31
Florent Xiclunaf1046ca2010-07-27 21:20:15 +000032
Georg Brandl116aa622007-08-15 14:28:22 +000033The :mod:`binascii` module defines the following functions:
34
35
36.. function:: a2b_uu(string)
37
38 Convert a single line of uuencoded data back to binary and return the binary
39 data. Lines normally contain 45 (binary) bytes, except for the last line. Line
40 data may be followed by whitespace.
41
42
Xiang Zhang13f1f422017-05-03 11:16:21 +080043.. function:: b2a_uu(data, *, backtick=False)
Georg Brandl116aa622007-08-15 14:28:22 +000044
45 Convert binary data to a line of ASCII characters, the return value is the
46 converted line, including a newline char. The length of *data* should be at most
Xiang Zhang13f1f422017-05-03 11:16:21 +080047 45. If *backtick* is true, zeros are represented by ``'`'`` instead of spaces.
48
49 .. versionchanged:: 3.7
50 Added the *backtick* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +000051
52
53.. function:: a2b_base64(string)
54
55 Convert a block of base64 data back to binary and return the binary data. More
56 than one line may be passed at a time.
57
58
Xiang Zhang13f1f422017-05-03 11:16:21 +080059.. function:: b2a_base64(data, *, newline=True)
Georg Brandl116aa622007-08-15 14:28:22 +000060
61 Convert binary data to a line of ASCII characters in base64 coding. The return
Victor Stinnere84c9762015-10-11 11:01:02 +020062 value is the converted line, including a newline char if *newline* is
R David Murrayd9919632015-12-13 18:11:07 -050063 true. The output of this function conforms to :rfc:`3548`.
Victor Stinnere84c9762015-10-11 11:01:02 +020064
65 .. versionchanged:: 3.6
66 Added the *newline* parameter.
Georg Brandl116aa622007-08-15 14:28:22 +000067
68
Martin Panterbf19d162015-09-09 01:01:13 +000069.. function:: a2b_qp(data, header=False)
Georg Brandl116aa622007-08-15 14:28:22 +000070
71 Convert a block of quoted-printable data back to binary and return the binary
72 data. More than one line may be passed at a time. If the optional argument
73 *header* is present and true, underscores will be decoded as spaces.
74
75
Georg Brandlb868a662009-04-02 02:56:10 +000076.. function:: b2a_qp(data, quotetabs=False, istext=True, header=False)
Georg Brandl116aa622007-08-15 14:28:22 +000077
78 Convert binary data to a line(s) of ASCII characters in quoted-printable
79 encoding. The return value is the converted line(s). If the optional argument
80 *quotetabs* is present and true, all tabs and spaces will be encoded. If the
81 optional argument *istext* is present and true, newlines are not encoded but
82 trailing whitespace will be encoded. If the optional argument *header* is
Serhiy Storchaka0a36ac12018-05-31 07:39:00 +030083 present and true, spaces will be encoded as underscores per :rfc:`1522`. If the
Georg Brandl116aa622007-08-15 14:28:22 +000084 optional argument *header* is present and false, newline characters will be
85 encoded as well; otherwise linefeed conversion might corrupt the binary data
86 stream.
87
88
89.. function:: a2b_hqx(string)
90
91 Convert binhex4 formatted ASCII data to binary, without doing RLE-decompression.
92 The string should contain a complete number of binary bytes, or (in case of the
93 last portion of the binhex4 data) have the remaining bits zero.
94
95
96.. function:: rledecode_hqx(data)
97
98 Perform RLE-decompression on the data, as per the binhex4 standard. The
99 algorithm uses ``0x90`` after a byte as a repeat indicator, followed by a count.
100 A count of ``0`` specifies a byte value of ``0x90``. The routine returns the
101 decompressed data, unless data input data ends in an orphaned repeat indicator,
102 in which case the :exc:`Incomplete` exception is raised.
103
Florent Xiclunaf1046ca2010-07-27 21:20:15 +0000104 .. versionchanged:: 3.2
Georg Brandl67b21b72010-08-17 15:07:14 +0000105 Accept only bytestring or bytearray objects as input.
Florent Xiclunaf1046ca2010-07-27 21:20:15 +0000106
Georg Brandl116aa622007-08-15 14:28:22 +0000107
108.. function:: rlecode_hqx(data)
109
110 Perform binhex4 style RLE-compression on *data* and return the result.
111
112
113.. function:: b2a_hqx(data)
114
115 Perform hexbin4 binary-to-ASCII translation and return the resulting string. The
116 argument should already be RLE-coded, and have a length divisible by 3 (except
117 possibly the last fragment).
118
119
Martin Panterb82032f2015-12-11 05:19:29 +0000120.. function:: crc_hqx(data, value)
Georg Brandl116aa622007-08-15 14:28:22 +0000121
Martin Panter3310e142016-12-24 07:36:44 +0000122 Compute a 16-bit CRC value of *data*, starting with *value* as the
123 initial CRC, and return the result. This uses the CRC-CCITT polynomial
124 *x*:sup:`16` + *x*:sup:`12` + *x*:sup:`5` + 1, often represented as
125 0x1021. This CRC is used in the binhex4 format.
Georg Brandl116aa622007-08-15 14:28:22 +0000126
127
Martin Panterb82032f2015-12-11 05:19:29 +0000128.. function:: crc32(data[, value])
Georg Brandl116aa622007-08-15 14:28:22 +0000129
Martin Panterb82032f2015-12-11 05:19:29 +0000130 Compute CRC-32, the 32-bit checksum of *data*, starting with an
131 initial CRC of *value*. The default initial CRC is zero. The algorithm
Georg Brandl116aa622007-08-15 14:28:22 +0000132 is consistent with the ZIP file checksum. Since the algorithm is designed for
133 use as a checksum algorithm, it is not suitable for use as a general hash
134 algorithm. Use as follows::
135
Georg Brandlede6c2a2010-01-05 10:22:04 +0000136 print(binascii.crc32(b"hello world"))
Georg Brandl116aa622007-08-15 14:28:22 +0000137 # Or, in two pieces:
Georg Brandlede6c2a2010-01-05 10:22:04 +0000138 crc = binascii.crc32(b"hello")
Martin Panterb82032f2015-12-11 05:19:29 +0000139 crc = binascii.crc32(b" world", crc)
Georg Brandlede6c2a2010-01-05 10:22:04 +0000140 print('crc32 = {:#010x}'.format(crc))
Benjamin Peterson058e31e2009-01-16 03:54:08 +0000141
Martin Panterb82032f2015-12-11 05:19:29 +0000142 .. versionchanged:: 3.0
143 The result is always unsigned.
144 To generate the same numeric value across all Python versions and
145 platforms, use ``crc32(data) & 0xffffffff``.
Benjamin Peterson058e31e2009-01-16 03:54:08 +0000146
Georg Brandl116aa622007-08-15 14:28:22 +0000147
Gregory P. Smith0c2f9302019-05-29 11:46:58 -0700148.. function:: b2a_hex(data[, sep[, bytes_per_sep=1]])
149 hexlify(data[, sep[, bytes_per_sep=1]])
Georg Brandl116aa622007-08-15 14:28:22 +0000150
151 Return the hexadecimal representation of the binary *data*. Every byte of
152 *data* is converted into the corresponding 2-digit hex representation. The
R David Murray5fdb64b2013-11-03 13:21:38 -0500153 returned bytes object is therefore twice as long as the length of *data*.
Georg Brandl116aa622007-08-15 14:28:22 +0000154
Raymond Hettinger56edf3a2018-12-25 17:53:36 -0800155 Similar functionality (but returning a text string) is also conveniently
156 accessible using the :meth:`bytes.hex` method.
Georg Brandl116aa622007-08-15 14:28:22 +0000157
Gregory P. Smith0c2f9302019-05-29 11:46:58 -0700158 If *sep* is specified, it must be a single character str or bytes object.
159 It will be inserted in the output after every *bytes_per_sep* input bytes.
160 Separator placement is counted from the right end of the output by default,
161 if you wish to count from the left, supply a negative *bytes_per_sep* value.
162
163 >>> import binascii
164 >>> binascii.b2a_hex(b'\xb9\x01\xef')
165 b'b901ef'
166 >>> binascii.hexlify(b'\xb9\x01\xef', '-')
167 b'b9-01-ef'
168 >>> binascii.b2a_hex(b'\xb9\x01\xef', b'_', 2)
169 b'b9_01ef'
170 >>> binascii.b2a_hex(b'\xb9\x01\xef', b' ', -2)
171 b'b901 ef'
172
173 .. versionchanged:: 3.8
174 The *sep* and *bytes_per_sep* parameters were added.
175
Georg Brandl116aa622007-08-15 14:28:22 +0000176.. function:: a2b_hex(hexstr)
177 unhexlify(hexstr)
178
179 Return the binary data represented by the hexadecimal string *hexstr*. This
180 function is the inverse of :func:`b2a_hex`. *hexstr* must contain an even number
Martin Panter58dd7642016-05-29 00:48:54 +0000181 of hexadecimal digits (which can be upper or lower case), otherwise an
182 :exc:`Error` exception is raised.
Georg Brandl116aa622007-08-15 14:28:22 +0000183
Raymond Hettinger56edf3a2018-12-25 17:53:36 -0800184 Similar functionality (accepting only text string arguments, but more
185 liberal towards whitespace) is also accessible using the
186 :meth:`bytes.fromhex` class method.
Georg Brandl116aa622007-08-15 14:28:22 +0000187
188.. exception:: Error
189
190 Exception raised on errors. These are usually programming errors.
191
192
193.. exception:: Incomplete
194
195 Exception raised on incomplete data. These are usually not programming errors,
196 but may be handled by reading a little more data and trying again.
197
198
199.. seealso::
200
201 Module :mod:`base64`
R David Murray2b4f47e2015-12-13 18:04:27 -0500202 Support for RFC compliant base64-style encoding in base 16, 32, 64,
203 and 85.
Georg Brandl116aa622007-08-15 14:28:22 +0000204
205 Module :mod:`binhex`
206 Support for the binhex format used on the Macintosh.
207
208 Module :mod:`uu`
209 Support for UU encoding used on Unix.
210
211 Module :mod:`quopri`
212 Support for quoted-printable encoding used in MIME email messages.