| R David Murray | 79cf3ba | 2012-05-27 17:10:36 -0400 | [diff] [blame] | 1 | :mod:`email.header`: Internationalized headers | 
|  | 2 | ---------------------------------------------- | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 3 |  | 
|  | 4 | .. module:: email.header | 
|  | 5 | :synopsis: Representing non-ASCII headers | 
|  | 6 |  | 
|  | 7 |  | 
|  | 8 | :rfc:`2822` is the base standard that describes the format of email messages. | 
|  | 9 | It derives from the older :rfc:`822` standard which came into widespread use at | 
|  | 10 | a time when most email was composed of ASCII characters only.  :rfc:`2822` is a | 
|  | 11 | specification written assuming email contains only 7-bit ASCII characters. | 
|  | 12 |  | 
|  | 13 | Of course, as email has been deployed worldwide, it has become | 
|  | 14 | internationalized, such that language specific character sets can now be used in | 
|  | 15 | email messages.  The base standard still requires email messages to be | 
|  | 16 | transferred using only 7-bit ASCII characters, so a slew of RFCs have been | 
|  | 17 | written describing how to encode email containing non-ASCII characters into | 
|  | 18 | :rfc:`2822`\ -compliant format. These RFCs include :rfc:`2045`, :rfc:`2046`, | 
|  | 19 | :rfc:`2047`, and :rfc:`2231`. The :mod:`email` package supports these standards | 
|  | 20 | in its :mod:`email.header` and :mod:`email.charset` modules. | 
|  | 21 |  | 
|  | 22 | If you want to include non-ASCII characters in your email headers, say in the | 
|  | 23 | :mailheader:`Subject` or :mailheader:`To` fields, you should use the | 
| Georg Brandl | 3638e48 | 2009-04-27 16:46:17 +0000 | [diff] [blame] | 24 | :class:`Header` class and assign the field in the :class:`~email.message.Message` | 
|  | 25 | object to an instance of :class:`Header` instead of using a string for the header | 
|  | 26 | value.  Import the :class:`Header` class from the :mod:`email.header` module. | 
|  | 27 | For example:: | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 28 |  | 
|  | 29 | >>> from email.message import Message | 
|  | 30 | >>> from email.header import Header | 
|  | 31 | >>> msg = Message() | 
|  | 32 | >>> h = Header('p\xf6stal', 'iso-8859-1') | 
|  | 33 | >>> msg['Subject'] = h | 
| Andrew Svetlov | 199b78d | 2012-08-12 14:49:59 +0300 | [diff] [blame] | 34 | >>> msg.as_string() | 
|  | 35 | 'Subject: =?iso-8859-1?q?p=F6stal?=\n\n' | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 36 |  | 
|  | 37 |  | 
|  | 38 |  | 
|  | 39 | Notice here how we wanted the :mailheader:`Subject` field to contain a non-ASCII | 
|  | 40 | character?  We did this by creating a :class:`Header` instance and passing in | 
|  | 41 | the character set that the byte string was encoded in.  When the subsequent | 
| Georg Brandl | 3638e48 | 2009-04-27 16:46:17 +0000 | [diff] [blame] | 42 | :class:`~email.message.Message` instance was flattened, the :mailheader:`Subject` | 
|  | 43 | field was properly :rfc:`2047` encoded.  MIME-aware mail readers would show this | 
|  | 44 | header using the embedded ISO-8859-1 character. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 45 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 46 | Here is the :class:`Header` class description: | 
|  | 47 |  | 
|  | 48 |  | 
| Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 49 | .. class:: Header(s=None, charset=None, maxlinelen=None, header_name=None, continuation_ws=' ', errors='strict') | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 50 |  | 
|  | 51 | Create a MIME-compliant header that can contain strings in different character | 
|  | 52 | sets. | 
|  | 53 |  | 
|  | 54 | Optional *s* is the initial header value.  If ``None`` (the default), the | 
|  | 55 | initial header value is not set.  You can later append to the header with | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 56 | :meth:`append` method calls.  *s* may be an instance of :class:`bytes` or | 
|  | 57 | :class:`str`, but see the :meth:`append` documentation for semantics. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 58 |  | 
|  | 59 | Optional *charset* serves two purposes: it has the same meaning as the *charset* | 
|  | 60 | argument to the :meth:`append` method.  It also sets the default character set | 
|  | 61 | for all subsequent :meth:`append` calls that omit the *charset* argument.  If | 
|  | 62 | *charset* is not provided in the constructor (the default), the ``us-ascii`` | 
|  | 63 | character set is used both as *s*'s initial charset and as the default for | 
|  | 64 | subsequent :meth:`append` calls. | 
|  | 65 |  | 
| R. David Murray | ef1a8b6 | 2010-12-29 19:06:48 +0000 | [diff] [blame] | 66 | The maximum line length can be specified explicitly via *maxlinelen*.  For | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 67 | splitting the first line to a shorter value (to account for the field header | 
|  | 68 | which isn't included in *s*, e.g. :mailheader:`Subject`) pass in the name of the | 
|  | 69 | field in *header_name*.  The default *maxlinelen* is 76, and the default value | 
|  | 70 | for *header_name* is ``None``, meaning it is not taken into account for the | 
|  | 71 | first line of a long, split header. | 
|  | 72 |  | 
| Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 73 | Optional *continuation_ws* must be :rfc:`2822`\ -compliant folding | 
|  | 74 | whitespace, and is usually either a space or a hard tab character.  This | 
|  | 75 | character will be prepended to continuation lines.  *continuation_ws* | 
|  | 76 | defaults to a single space character. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 77 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 78 | Optional *errors* is passed straight through to the :meth:`append` method. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 79 |  | 
|  | 80 |  | 
| Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 81 | .. method:: append(s, charset=None, errors='strict') | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 82 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 83 | Append the string *s* to the MIME header. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 84 |  | 
| Georg Brandl | 3638e48 | 2009-04-27 16:46:17 +0000 | [diff] [blame] | 85 | Optional *charset*, if given, should be a :class:`~email.charset.Charset` | 
|  | 86 | instance (see :mod:`email.charset`) or the name of a character set, which | 
|  | 87 | will be converted to a :class:`~email.charset.Charset` instance.  A value | 
|  | 88 | of ``None`` (the default) means that the *charset* given in the constructor | 
|  | 89 | is used. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 90 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 91 | *s* may be an instance of :class:`bytes` or :class:`str`.  If it is an | 
|  | 92 | instance of :class:`bytes`, then *charset* is the encoding of that byte | 
|  | 93 | string, and a :exc:`UnicodeError` will be raised if the string cannot be | 
|  | 94 | decoded with that character set. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 95 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 96 | If *s* is an instance of :class:`str`, then *charset* is a hint specifying | 
| R. David Murray | 477efb3 | 2011-01-05 01:39:32 +0000 | [diff] [blame] | 97 | the character set of the characters in the string. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 98 |  | 
| R. David Murray | 477efb3 | 2011-01-05 01:39:32 +0000 | [diff] [blame] | 99 | In either case, when producing an :rfc:`2822`\ -compliant header using | 
|  | 100 | :rfc:`2047` rules, the string will be encoded using the output codec of | 
|  | 101 | the charset.  If the string cannot be encoded using the output codec, a | 
|  | 102 | UnicodeError will be raised. | 
|  | 103 |  | 
|  | 104 | Optional *errors* is passed as the errors argument to the decode call | 
|  | 105 | if *s* is a byte string. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 106 |  | 
|  | 107 |  | 
| R. David Murray | 8451c4b | 2010-10-23 22:19:56 +0000 | [diff] [blame] | 108 | .. method:: encode(splitchars=';, \\t', maxlinelen=None, linesep='\\n') | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 109 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 110 | Encode a message header into an RFC-compliant format, possibly wrapping | 
|  | 111 | long lines and encapsulating non-ASCII parts in base64 or quoted-printable | 
| R David Murray | 01581ee | 2011-04-18 10:04:34 -0400 | [diff] [blame] | 112 | encodings. | 
|  | 113 |  | 
|  | 114 | Optional *splitchars* is a string containing characters which should be | 
|  | 115 | given extra weight by the splitting algorithm during normal header | 
|  | 116 | wrapping.  This is in very rough support of :RFC:`2822`\'s 'higher level | 
|  | 117 | syntactic breaks':  split points preceded by a splitchar are preferred | 
|  | 118 | during line splitting, with the characters preferred in the order in | 
|  | 119 | which they appear in the string.  Space and tab may be included in the | 
|  | 120 | string to indicate whether preference should be given to one over the | 
|  | 121 | other as a split point when other split chars do not appear in the line | 
| R David Murray | 530cc09 | 2011-04-18 15:54:58 -0400 | [diff] [blame] | 122 | being split.  Splitchars does not affect :RFC:`2047` encoded lines. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 123 |  | 
| Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 124 | *maxlinelen*, if given, overrides the instance's value for the maximum | 
|  | 125 | line length. | 
|  | 126 |  | 
| R. David Murray | 8451c4b | 2010-10-23 22:19:56 +0000 | [diff] [blame] | 127 | *linesep* specifies the characters used to separate the lines of the | 
|  | 128 | folded header.  It defaults to the most useful value for Python | 
|  | 129 | application code (``\n``), but ``\r\n`` can be specified in order | 
|  | 130 | to produce headers with RFC-compliant line separators. | 
|  | 131 |  | 
| Georg Brandl | 872a702 | 2010-10-24 14:32:45 +0000 | [diff] [blame] | 132 | .. versionchanged:: 3.2 | 
|  | 133 | Added the *linesep* argument. | 
| R. David Murray | 8451c4b | 2010-10-23 22:19:56 +0000 | [diff] [blame] | 134 |  | 
| Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 135 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 136 | The :class:`Header` class also provides a number of methods to support | 
|  | 137 | standard operators and built-in functions. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 138 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 139 | .. method:: __str__() | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 140 |  | 
| R. David Murray | 9253214 | 2011-01-07 23:25:30 +0000 | [diff] [blame] | 141 | Returns an approximation of the :class:`Header` as a string, using an | 
|  | 142 | unlimited line length.  All pieces are converted to unicode using the | 
|  | 143 | specified encoding and joined together appropriately.  Any pieces with a | 
| Éric Araujo | 941afed | 2011-09-01 02:47:34 +0200 | [diff] [blame] | 144 | charset of ``'unknown-8bit'`` are decoded as ASCII using the ``'replace'`` | 
| R. David Murray | 9253214 | 2011-01-07 23:25:30 +0000 | [diff] [blame] | 145 | error handler. | 
|  | 146 |  | 
|  | 147 | .. versionchanged:: 3.2 | 
| Éric Araujo | 941afed | 2011-09-01 02:47:34 +0200 | [diff] [blame] | 148 | Added handling for the ``'unknown-8bit'`` charset. | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 149 |  | 
| Georg Brandl | b30f330 | 2011-01-06 09:23:56 +0000 | [diff] [blame] | 150 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 151 | .. method:: __eq__(other) | 
|  | 152 |  | 
|  | 153 | This method allows you to compare two :class:`Header` instances for | 
|  | 154 | equality. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 155 |  | 
|  | 156 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 157 | .. method:: __ne__(other) | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 158 |  | 
| Benjamin Peterson | e41251e | 2008-04-25 01:59:09 +0000 | [diff] [blame] | 159 | This method allows you to compare two :class:`Header` instances for | 
|  | 160 | inequality. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 161 |  | 
|  | 162 | The :mod:`email.header` module also provides the following convenient functions. | 
|  | 163 |  | 
|  | 164 |  | 
|  | 165 | .. function:: decode_header(header) | 
|  | 166 |  | 
|  | 167 | Decode a message header value without converting the character set. The header | 
|  | 168 | value is in *header*. | 
|  | 169 |  | 
|  | 170 | This function returns a list of ``(decoded_string, charset)`` pairs containing | 
|  | 171 | each of the decoded parts of the header.  *charset* is ``None`` for non-encoded | 
|  | 172 | parts of the header, otherwise a lower case string containing the name of the | 
|  | 173 | character set specified in the encoded string. | 
|  | 174 |  | 
|  | 175 | Here's an example:: | 
|  | 176 |  | 
|  | 177 | >>> from email.header import decode_header | 
|  | 178 | >>> decode_header('=?iso-8859-1?q?p=F6stal?=') | 
| Andrew Svetlov | 199b78d | 2012-08-12 14:49:59 +0300 | [diff] [blame] | 179 | [(b'p\xf6stal', 'iso-8859-1')] | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 180 |  | 
|  | 181 |  | 
| Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 182 | .. function:: make_header(decoded_seq, maxlinelen=None, header_name=None, continuation_ws=' ') | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 183 |  | 
|  | 184 | Create a :class:`Header` instance from a sequence of pairs as returned by | 
|  | 185 | :func:`decode_header`. | 
|  | 186 |  | 
|  | 187 | :func:`decode_header` takes a header value string and returns a sequence of | 
|  | 188 | pairs of the format ``(decoded_string, charset)`` where *charset* is the name of | 
|  | 189 | the character set. | 
|  | 190 |  | 
| Georg Brandl | 3f076d8 | 2009-05-17 11:28:33 +0000 | [diff] [blame] | 191 | This function takes one of those sequence of pairs and returns a | 
|  | 192 | :class:`Header` instance.  Optional *maxlinelen*, *header_name*, and | 
|  | 193 | *continuation_ws* are as in the :class:`Header` constructor. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 194 |  |