blob: 07152c224f2ff0865aee9561757733f69c5e2d80 [file] [log] [blame]
R David Murray79cf3ba2012-05-27 17:10:36 -04001:mod:`email.header`: Internationalized headers
2----------------------------------------------
Georg Brandl116aa622007-08-15 14:28:22 +00003
4.. module:: email.header
5 :synopsis: Representing non-ASCII headers
6
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04007**Source code:** :source:`Lib/email/header.py`
8
9--------------
Georg Brandl116aa622007-08-15 14:28:22 +000010
R David Murray29d1bc02016-09-07 21:15:59 -040011This module is part of the legacy (``Compat32``) email API. In the current API
12encoding and decoding of headers is handled transparently by the
13dictionary-like API of the :class:`~email.message.EmailMessage` class. In
14addition to uses in legacy code, this module can be useful in applications that
15need to completely control the character sets used when encoding headers.
16
17The remaining text in this section is the original documentation of the module.
18
Georg Brandl116aa622007-08-15 14:28:22 +000019:rfc:`2822` is the base standard that describes the format of email messages.
20It derives from the older :rfc:`822` standard which came into widespread use at
21a time when most email was composed of ASCII characters only. :rfc:`2822` is a
22specification written assuming email contains only 7-bit ASCII characters.
23
24Of course, as email has been deployed worldwide, it has become
25internationalized, such that language specific character sets can now be used in
26email messages. The base standard still requires email messages to be
27transferred using only 7-bit ASCII characters, so a slew of RFCs have been
28written describing how to encode email containing non-ASCII characters into
29:rfc:`2822`\ -compliant format. These RFCs include :rfc:`2045`, :rfc:`2046`,
30:rfc:`2047`, and :rfc:`2231`. The :mod:`email` package supports these standards
31in its :mod:`email.header` and :mod:`email.charset` modules.
32
33If you want to include non-ASCII characters in your email headers, say in the
34:mailheader:`Subject` or :mailheader:`To` fields, you should use the
Georg Brandl3638e482009-04-27 16:46:17 +000035:class:`Header` class and assign the field in the :class:`~email.message.Message`
36object to an instance of :class:`Header` instead of using a string for the header
37value. Import the :class:`Header` class from the :mod:`email.header` module.
38For example::
Georg Brandl116aa622007-08-15 14:28:22 +000039
40 >>> from email.message import Message
41 >>> from email.header import Header
42 >>> msg = Message()
43 >>> h = Header('p\xf6stal', 'iso-8859-1')
44 >>> msg['Subject'] = h
Andrew Svetlov199b78d2012-08-12 14:49:59 +030045 >>> msg.as_string()
46 'Subject: =?iso-8859-1?q?p=F6stal?=\n\n'
Georg Brandl116aa622007-08-15 14:28:22 +000047
48
49
50Notice here how we wanted the :mailheader:`Subject` field to contain a non-ASCII
51character? We did this by creating a :class:`Header` instance and passing in
52the character set that the byte string was encoded in. When the subsequent
Georg Brandl3638e482009-04-27 16:46:17 +000053:class:`~email.message.Message` instance was flattened, the :mailheader:`Subject`
54field was properly :rfc:`2047` encoded. MIME-aware mail readers would show this
55header using the embedded ISO-8859-1 character.
Georg Brandl116aa622007-08-15 14:28:22 +000056
Georg Brandl116aa622007-08-15 14:28:22 +000057Here is the :class:`Header` class description:
58
59
Georg Brandl3f076d82009-05-17 11:28:33 +000060.. class:: Header(s=None, charset=None, maxlinelen=None, header_name=None, continuation_ws=' ', errors='strict')
Georg Brandl116aa622007-08-15 14:28:22 +000061
62 Create a MIME-compliant header that can contain strings in different character
63 sets.
64
65 Optional *s* is the initial header value. If ``None`` (the default), the
66 initial header value is not set. You can later append to the header with
Georg Brandlf6945182008-02-01 11:56:49 +000067 :meth:`append` method calls. *s* may be an instance of :class:`bytes` or
68 :class:`str`, but see the :meth:`append` documentation for semantics.
Georg Brandl116aa622007-08-15 14:28:22 +000069
70 Optional *charset* serves two purposes: it has the same meaning as the *charset*
71 argument to the :meth:`append` method. It also sets the default character set
72 for all subsequent :meth:`append` calls that omit the *charset* argument. If
73 *charset* is not provided in the constructor (the default), the ``us-ascii``
74 character set is used both as *s*'s initial charset and as the default for
75 subsequent :meth:`append` calls.
76
R. David Murrayef1a8b62010-12-29 19:06:48 +000077 The maximum line length can be specified explicitly via *maxlinelen*. For
Georg Brandl116aa622007-08-15 14:28:22 +000078 splitting the first line to a shorter value (to account for the field header
79 which isn't included in *s*, e.g. :mailheader:`Subject`) pass in the name of the
80 field in *header_name*. The default *maxlinelen* is 76, and the default value
81 for *header_name* is ``None``, meaning it is not taken into account for the
82 first line of a long, split header.
83
Georg Brandl3f076d82009-05-17 11:28:33 +000084 Optional *continuation_ws* must be :rfc:`2822`\ -compliant folding
85 whitespace, and is usually either a space or a hard tab character. This
86 character will be prepended to continuation lines. *continuation_ws*
87 defaults to a single space character.
Georg Brandl116aa622007-08-15 14:28:22 +000088
Benjamin Petersone41251e2008-04-25 01:59:09 +000089 Optional *errors* is passed straight through to the :meth:`append` method.
Georg Brandl116aa622007-08-15 14:28:22 +000090
91
Georg Brandl3f076d82009-05-17 11:28:33 +000092 .. method:: append(s, charset=None, errors='strict')
Georg Brandl116aa622007-08-15 14:28:22 +000093
Benjamin Petersone41251e2008-04-25 01:59:09 +000094 Append the string *s* to the MIME header.
Georg Brandl116aa622007-08-15 14:28:22 +000095
Georg Brandl3638e482009-04-27 16:46:17 +000096 Optional *charset*, if given, should be a :class:`~email.charset.Charset`
97 instance (see :mod:`email.charset`) or the name of a character set, which
98 will be converted to a :class:`~email.charset.Charset` instance. A value
99 of ``None`` (the default) means that the *charset* given in the constructor
100 is used.
Georg Brandl116aa622007-08-15 14:28:22 +0000101
Benjamin Petersone41251e2008-04-25 01:59:09 +0000102 *s* may be an instance of :class:`bytes` or :class:`str`. If it is an
103 instance of :class:`bytes`, then *charset* is the encoding of that byte
104 string, and a :exc:`UnicodeError` will be raised if the string cannot be
105 decoded with that character set.
Georg Brandl116aa622007-08-15 14:28:22 +0000106
Benjamin Petersone41251e2008-04-25 01:59:09 +0000107 If *s* is an instance of :class:`str`, then *charset* is a hint specifying
R. David Murray477efb32011-01-05 01:39:32 +0000108 the character set of the characters in the string.
Georg Brandl116aa622007-08-15 14:28:22 +0000109
R. David Murray477efb32011-01-05 01:39:32 +0000110 In either case, when producing an :rfc:`2822`\ -compliant header using
111 :rfc:`2047` rules, the string will be encoded using the output codec of
112 the charset. If the string cannot be encoded using the output codec, a
113 UnicodeError will be raised.
114
115 Optional *errors* is passed as the errors argument to the decode call
116 if *s* is a byte string.
Georg Brandl116aa622007-08-15 14:28:22 +0000117
118
R. David Murray8451c4b2010-10-23 22:19:56 +0000119 .. method:: encode(splitchars=';, \\t', maxlinelen=None, linesep='\\n')
Georg Brandl116aa622007-08-15 14:28:22 +0000120
Benjamin Petersone41251e2008-04-25 01:59:09 +0000121 Encode a message header into an RFC-compliant format, possibly wrapping
122 long lines and encapsulating non-ASCII parts in base64 or quoted-printable
R David Murray01581ee2011-04-18 10:04:34 -0400123 encodings.
124
125 Optional *splitchars* is a string containing characters which should be
126 given extra weight by the splitting algorithm during normal header
127 wrapping. This is in very rough support of :RFC:`2822`\'s 'higher level
128 syntactic breaks': split points preceded by a splitchar are preferred
129 during line splitting, with the characters preferred in the order in
130 which they appear in the string. Space and tab may be included in the
131 string to indicate whether preference should be given to one over the
132 other as a split point when other split chars do not appear in the line
R David Murray530cc092011-04-18 15:54:58 -0400133 being split. Splitchars does not affect :RFC:`2047` encoded lines.
Georg Brandl116aa622007-08-15 14:28:22 +0000134
Georg Brandl3f076d82009-05-17 11:28:33 +0000135 *maxlinelen*, if given, overrides the instance's value for the maximum
136 line length.
137
R. David Murray8451c4b2010-10-23 22:19:56 +0000138 *linesep* specifies the characters used to separate the lines of the
139 folded header. It defaults to the most useful value for Python
140 application code (``\n``), but ``\r\n`` can be specified in order
141 to produce headers with RFC-compliant line separators.
142
Georg Brandl872a7022010-10-24 14:32:45 +0000143 .. versionchanged:: 3.2
144 Added the *linesep* argument.
R. David Murray8451c4b2010-10-23 22:19:56 +0000145
Georg Brandl3f076d82009-05-17 11:28:33 +0000146
Benjamin Petersone41251e2008-04-25 01:59:09 +0000147 The :class:`Header` class also provides a number of methods to support
148 standard operators and built-in functions.
Georg Brandl116aa622007-08-15 14:28:22 +0000149
Benjamin Petersone41251e2008-04-25 01:59:09 +0000150 .. method:: __str__()
Georg Brandl116aa622007-08-15 14:28:22 +0000151
R. David Murray92532142011-01-07 23:25:30 +0000152 Returns an approximation of the :class:`Header` as a string, using an
153 unlimited line length. All pieces are converted to unicode using the
154 specified encoding and joined together appropriately. Any pieces with a
Éric Araujo941afed2011-09-01 02:47:34 +0200155 charset of ``'unknown-8bit'`` are decoded as ASCII using the ``'replace'``
R. David Murray92532142011-01-07 23:25:30 +0000156 error handler.
157
158 .. versionchanged:: 3.2
Éric Araujo941afed2011-09-01 02:47:34 +0200159 Added handling for the ``'unknown-8bit'`` charset.
Benjamin Petersone41251e2008-04-25 01:59:09 +0000160
Georg Brandlb30f3302011-01-06 09:23:56 +0000161
Benjamin Petersone41251e2008-04-25 01:59:09 +0000162 .. method:: __eq__(other)
163
164 This method allows you to compare two :class:`Header` instances for
165 equality.
Georg Brandl116aa622007-08-15 14:28:22 +0000166
167
Benjamin Petersone41251e2008-04-25 01:59:09 +0000168 .. method:: __ne__(other)
Georg Brandl116aa622007-08-15 14:28:22 +0000169
Benjamin Petersone41251e2008-04-25 01:59:09 +0000170 This method allows you to compare two :class:`Header` instances for
171 inequality.
Georg Brandl116aa622007-08-15 14:28:22 +0000172
173The :mod:`email.header` module also provides the following convenient functions.
174
175
176.. function:: decode_header(header)
177
178 Decode a message header value without converting the character set. The header
179 value is in *header*.
180
181 This function returns a list of ``(decoded_string, charset)`` pairs containing
182 each of the decoded parts of the header. *charset* is ``None`` for non-encoded
183 parts of the header, otherwise a lower case string containing the name of the
184 character set specified in the encoded string.
185
186 Here's an example::
187
188 >>> from email.header import decode_header
189 >>> decode_header('=?iso-8859-1?q?p=F6stal?=')
Andrew Svetlov199b78d2012-08-12 14:49:59 +0300190 [(b'p\xf6stal', 'iso-8859-1')]
Georg Brandl116aa622007-08-15 14:28:22 +0000191
192
Georg Brandl3f076d82009-05-17 11:28:33 +0000193.. function:: make_header(decoded_seq, maxlinelen=None, header_name=None, continuation_ws=' ')
Georg Brandl116aa622007-08-15 14:28:22 +0000194
195 Create a :class:`Header` instance from a sequence of pairs as returned by
196 :func:`decode_header`.
197
198 :func:`decode_header` takes a header value string and returns a sequence of
199 pairs of the format ``(decoded_string, charset)`` where *charset* is the name of
200 the character set.
201
Georg Brandl3f076d82009-05-17 11:28:33 +0000202 This function takes one of those sequence of pairs and returns a
203 :class:`Header` instance. Optional *maxlinelen*, *header_name*, and
204 *continuation_ws* are as in the :class:`Header` constructor.
Georg Brandl116aa622007-08-15 14:28:22 +0000205