R David Murray | 79cf3ba | 2012-05-27 17:10:36 -0400 | [diff] [blame] | 1 | :mod:`email.header`: Internationalized headers |
| 2 | ---------------------------------------------- |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 3 | |
| 4 | .. module:: email.header |
| 5 | :synopsis: Representing non-ASCII headers |
| 6 | |
| 7 | |
| 8 | :rfc:`2822` is the base standard that describes the format of email messages. |
| 9 | It derives from the older :rfc:`822` standard which came into widespread use at |
| 10 | a time when most email was composed of ASCII characters only. :rfc:`2822` is a |
| 11 | specification written assuming email contains only 7-bit ASCII characters. |
| 12 | |
| 13 | Of course, as email has been deployed worldwide, it has become |
| 14 | internationalized, such that language specific character sets can now be used in |
| 15 | email messages. The base standard still requires email messages to be |
| 16 | transferred using only 7-bit ASCII characters, so a slew of RFCs have been |
| 17 | written describing how to encode email containing non-ASCII characters into |
| 18 | :rfc:`2822`\ -compliant format. These RFCs include :rfc:`2045`, :rfc:`2046`, |
| 19 | :rfc:`2047`, and :rfc:`2231`. The :mod:`email` package supports these standards |
| 20 | in its :mod:`email.header` and :mod:`email.charset` modules. |
| 21 | |
| 22 | If you want to include non-ASCII characters in your email headers, say in the |
| 23 | :mailheader:`Subject` or :mailheader:`To` fields, you should use the |
Georg Brandl | 3638e48 | 2009-04-27 16:46:17 +0000 | [diff] [blame] | 24 | :class:`Header` class and assign the field in the :class:`~email.message.Message` |
| 25 | object to an instance of :class:`Header` instead of using a string for the header |
| 26 | value. Import the :class:`Header` class from the :mod:`email.header` module. |
| 27 | For example:: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 28 | |
| 29 | >>> from email.message import Message |
| 30 | >>> from email.header import Header |
| 31 | >>> msg = Message() |
| 32 | >>> h = Header('p\xf6stal', 'iso-8859-1') |
| 33 | >>> msg['Subject'] = h |
Andrew Svetlov | 199b78d | 2012-08-12 14:49:59 +0300 | [diff] [blame] | 34 | >>> msg.as_string() |
| 35 | 'Subject: =?iso-8859-1?q?p=F6stal?=\n\n' |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 36 | |
| 37 | |
| 38 | |
| 39 | Notice here how we wanted the :mailheader:`Subject` field to contain a non-ASCII |
| 40 | character? We did this by creating a :class:`Header` instance and passing in |
| 41 | the character set that the byte string was encoded in. When the subsequent |
Georg Brandl | 3638e48 | 2009-04-27 16:46:17 +0000 | [diff] [blame] | 42 | :class:`~email.message.Message` instance was flattened, the :mailheader:`Subject` |
| 43 | field was properly :rfc:`2047` encoded. MIME-aware mail readers would show this |
| 44 | header using the embedded ISO-8859-1 character. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 45 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 46 | Here is the :class:`Header` class description: |
| 47 | |
| 48 | |
Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 49 | .. class:: Header(s=None, charset=None, maxlinelen=None, header_name=None, continuation_ws=' ', errors='strict') |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 50 | |
| 51 | Create a MIME-compliant header that can contain strings in different character |
| 52 | sets. |
| 53 | |
| 54 | Optional *s* is the initial header value. If ``None`` (the default), the |
| 55 | initial header value is not set. You can later append to the header with |
Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 56 | :meth:`append` method calls. *s* may be an instance of :class:`bytes` or |
| 57 | :class:`str`, but see the :meth:`append` documentation for semantics. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 58 | |
| 59 | Optional *charset* serves two purposes: it has the same meaning as the *charset* |
| 60 | argument to the :meth:`append` method. It also sets the default character set |
| 61 | for all subsequent :meth:`append` calls that omit the *charset* argument. If |
| 62 | *charset* is not provided in the constructor (the default), the ``us-ascii`` |
| 63 | character set is used both as *s*'s initial charset and as the default for |
| 64 | subsequent :meth:`append` calls. |
| 65 | |
R. David Murray | ef1a8b6 | 2010-12-29 19:06:48 +0000 | [diff] [blame] | 66 | The maximum line length can be specified explicitly via *maxlinelen*. For |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 67 | splitting the first line to a shorter value (to account for the field header |
| 68 | which isn't included in *s*, e.g. :mailheader:`Subject`) pass in the name of the |
| 69 | field in *header_name*. The default *maxlinelen* is 76, and the default value |
| 70 | for *header_name* is ``None``, meaning it is not taken into account for the |
| 71 | first line of a long, split header. |
| 72 | |
Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 73 | Optional *continuation_ws* must be :rfc:`2822`\ -compliant folding |
| 74 | whitespace, and is usually either a space or a hard tab character. This |
| 75 | character will be prepended to continuation lines. *continuation_ws* |
| 76 | defaults to a single space character. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 77 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 78 | Optional *errors* is passed straight through to the :meth:`append` method. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 79 | |
| 80 | |
Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 81 | .. method:: append(s, charset=None, errors='strict') |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 82 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 83 | Append the string *s* to the MIME header. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 84 | |
Georg Brandl | 3638e48 | 2009-04-27 16:46:17 +0000 | [diff] [blame] | 85 | Optional *charset*, if given, should be a :class:`~email.charset.Charset` |
| 86 | instance (see :mod:`email.charset`) or the name of a character set, which |
| 87 | will be converted to a :class:`~email.charset.Charset` instance. A value |
| 88 | of ``None`` (the default) means that the *charset* given in the constructor |
| 89 | is used. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 90 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 91 | *s* may be an instance of :class:`bytes` or :class:`str`. If it is an |
| 92 | instance of :class:`bytes`, then *charset* is the encoding of that byte |
| 93 | string, and a :exc:`UnicodeError` will be raised if the string cannot be |
| 94 | decoded with that character set. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 95 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 96 | If *s* is an instance of :class:`str`, then *charset* is a hint specifying |
R. David Murray | 477efb3 | 2011-01-05 01:39:32 +0000 | [diff] [blame] | 97 | the character set of the characters in the string. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 98 | |
R. David Murray | 477efb3 | 2011-01-05 01:39:32 +0000 | [diff] [blame] | 99 | In either case, when producing an :rfc:`2822`\ -compliant header using |
| 100 | :rfc:`2047` rules, the string will be encoded using the output codec of |
| 101 | the charset. If the string cannot be encoded using the output codec, a |
| 102 | UnicodeError will be raised. |
| 103 | |
| 104 | Optional *errors* is passed as the errors argument to the decode call |
| 105 | if *s* is a byte string. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 106 | |
| 107 | |
R. David Murray | 8451c4b | 2010-10-23 22:19:56 +0000 | [diff] [blame] | 108 | .. method:: encode(splitchars=';, \\t', maxlinelen=None, linesep='\\n') |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 109 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 110 | Encode a message header into an RFC-compliant format, possibly wrapping |
| 111 | long lines and encapsulating non-ASCII parts in base64 or quoted-printable |
R David Murray | 01581ee | 2011-04-18 10:04:34 -0400 | [diff] [blame] | 112 | encodings. |
| 113 | |
| 114 | Optional *splitchars* is a string containing characters which should be |
| 115 | given extra weight by the splitting algorithm during normal header |
| 116 | wrapping. This is in very rough support of :RFC:`2822`\'s 'higher level |
| 117 | syntactic breaks': split points preceded by a splitchar are preferred |
| 118 | during line splitting, with the characters preferred in the order in |
| 119 | which they appear in the string. Space and tab may be included in the |
| 120 | string to indicate whether preference should be given to one over the |
| 121 | other as a split point when other split chars do not appear in the line |
R David Murray | 530cc09 | 2011-04-18 15:54:58 -0400 | [diff] [blame] | 122 | being split. Splitchars does not affect :RFC:`2047` encoded lines. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 123 | |
Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 124 | *maxlinelen*, if given, overrides the instance's value for the maximum |
| 125 | line length. |
| 126 | |
R. David Murray | 8451c4b | 2010-10-23 22:19:56 +0000 | [diff] [blame] | 127 | *linesep* specifies the characters used to separate the lines of the |
| 128 | folded header. It defaults to the most useful value for Python |
| 129 | application code (``\n``), but ``\r\n`` can be specified in order |
| 130 | to produce headers with RFC-compliant line separators. |
| 131 | |
Georg Brandl | 872a702 | 2010-10-24 14:32:45 +0000 | [diff] [blame] | 132 | .. versionchanged:: 3.2 |
| 133 | Added the *linesep* argument. |
R. David Murray | 8451c4b | 2010-10-23 22:19:56 +0000 | [diff] [blame] | 134 | |
Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 135 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 136 | The :class:`Header` class also provides a number of methods to support |
| 137 | standard operators and built-in functions. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 138 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 139 | .. method:: __str__() |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 140 | |
R. David Murray | 9253214 | 2011-01-07 23:25:30 +0000 | [diff] [blame] | 141 | Returns an approximation of the :class:`Header` as a string, using an |
| 142 | unlimited line length. All pieces are converted to unicode using the |
| 143 | specified encoding and joined together appropriately. Any pieces with a |
Éric Araujo | 941afed | 2011-09-01 02:47:34 +0200 | [diff] [blame] | 144 | charset of ``'unknown-8bit'`` are decoded as ASCII using the ``'replace'`` |
R. David Murray | 9253214 | 2011-01-07 23:25:30 +0000 | [diff] [blame] | 145 | error handler. |
| 146 | |
| 147 | .. versionchanged:: 3.2 |
Éric Araujo | 941afed | 2011-09-01 02:47:34 +0200 | [diff] [blame] | 148 | Added handling for the ``'unknown-8bit'`` charset. |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 149 | |
Georg Brandl | b30f330 | 2011-01-06 09:23:56 +0000 | [diff] [blame] | 150 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 151 | .. method:: __eq__(other) |
| 152 | |
| 153 | This method allows you to compare two :class:`Header` instances for |
| 154 | equality. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 155 | |
| 156 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 157 | .. method:: __ne__(other) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 158 | |
Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 159 | This method allows you to compare two :class:`Header` instances for |
| 160 | inequality. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 161 | |
| 162 | The :mod:`email.header` module also provides the following convenient functions. |
| 163 | |
| 164 | |
| 165 | .. function:: decode_header(header) |
| 166 | |
| 167 | Decode a message header value without converting the character set. The header |
| 168 | value is in *header*. |
| 169 | |
| 170 | This function returns a list of ``(decoded_string, charset)`` pairs containing |
| 171 | each of the decoded parts of the header. *charset* is ``None`` for non-encoded |
| 172 | parts of the header, otherwise a lower case string containing the name of the |
| 173 | character set specified in the encoded string. |
| 174 | |
| 175 | Here's an example:: |
| 176 | |
| 177 | >>> from email.header import decode_header |
| 178 | >>> decode_header('=?iso-8859-1?q?p=F6stal?=') |
Andrew Svetlov | 199b78d | 2012-08-12 14:49:59 +0300 | [diff] [blame] | 179 | [(b'p\xf6stal', 'iso-8859-1')] |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 180 | |
| 181 | |
Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 182 | .. function:: make_header(decoded_seq, maxlinelen=None, header_name=None, continuation_ws=' ') |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 183 | |
| 184 | Create a :class:`Header` instance from a sequence of pairs as returned by |
| 185 | :func:`decode_header`. |
| 186 | |
| 187 | :func:`decode_header` takes a header value string and returns a sequence of |
| 188 | pairs of the format ``(decoded_string, charset)`` where *charset* is the name of |
| 189 | the character set. |
| 190 | |
Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 191 | This function takes one of those sequence of pairs and returns a |
| 192 | :class:`Header` instance. Optional *maxlinelen*, *header_name*, and |
| 193 | *continuation_ws* are as in the :class:`Header` constructor. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 194 | |