Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 1 | :mod:`json` --- JSON encoder and decoder |
| 2 | ======================================== |
| 3 | |
| 4 | .. module:: json |
| 5 | :synopsis: Encode and decode the JSON format. |
| 6 | .. moduleauthor:: Bob Ippolito <bob@redivi.com> |
| 7 | .. sectionauthor:: Bob Ippolito <bob@redivi.com> |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 8 | |
Antoine Pitrou | 331624b | 2012-08-24 19:37:23 +0200 | [diff] [blame] | 9 | `JSON (JavaScript Object Notation) <http://json.org>`_, specified by |
| 10 | :rfc:`4627`, is a lightweight data interchange format based on a subset of |
| 11 | `JavaScript <http://en.wikipedia.org/wiki/JavaScript>`_ syntax (`ECMA-262 3rd |
| 12 | edition <http://www.ecma-international.org/publications/files/ECMA-ST-ARCH/ECMA-262,%203rd%20edition,%20December%201999.pdf>`_). |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 13 | |
| 14 | :mod:`json` exposes an API familiar to users of the standard library |
| 15 | :mod:`marshal` and :mod:`pickle` modules. |
| 16 | |
| 17 | Encoding basic Python object hierarchies:: |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 18 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 19 | >>> import json |
| 20 | >>> json.dumps(['foo', {'bar': ('baz', None, 1.0, 2)}]) |
| 21 | '["foo", {"bar": ["baz", null, 1.0, 2]}]' |
Neal Norwitz | 752abd0 | 2008-05-13 04:55:24 +0000 | [diff] [blame] | 22 | >>> print(json.dumps("\"foo\bar")) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 23 | "\"foo\bar" |
Benjamin Peterson | 2505bc6 | 2008-05-15 02:17:58 +0000 | [diff] [blame] | 24 | >>> print(json.dumps('\u1234')) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 25 | "\u1234" |
Neal Norwitz | 752abd0 | 2008-05-13 04:55:24 +0000 | [diff] [blame] | 26 | >>> print(json.dumps('\\')) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 27 | "\\" |
Neal Norwitz | 752abd0 | 2008-05-13 04:55:24 +0000 | [diff] [blame] | 28 | >>> print(json.dumps({"c": 0, "b": 0, "a": 0}, sort_keys=True)) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 29 | {"a": 0, "b": 0, "c": 0} |
Benjamin Peterson | 2505bc6 | 2008-05-15 02:17:58 +0000 | [diff] [blame] | 30 | >>> from io import StringIO |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 31 | >>> io = StringIO() |
| 32 | >>> json.dump(['streaming API'], io) |
| 33 | >>> io.getvalue() |
| 34 | '["streaming API"]' |
| 35 | |
| 36 | Compact encoding:: |
| 37 | |
| 38 | >>> import json |
Éric Araujo | de579d4 | 2011-04-21 02:37:41 +0200 | [diff] [blame] | 39 | >>> json.dumps([1,2,3,{'4': 5, '6': 7}], separators=(',', ':')) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 40 | '[1,2,3,{"4":5,"6":7}]' |
| 41 | |
| 42 | Pretty printing:: |
| 43 | |
| 44 | >>> import json |
Ezio Melotti | d654ded | 2012-11-29 00:35:29 +0200 | [diff] [blame] | 45 | >>> print(json.dumps({'4': 5, '6': 7}, sort_keys=True, |
| 46 | ... indent=4, separators=(',', ': '))) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 47 | { |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 48 | "4": 5, |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 49 | "6": 7 |
| 50 | } |
| 51 | |
| 52 | Decoding JSON:: |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 53 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 54 | >>> import json |
| 55 | >>> json.loads('["foo", {"bar":["baz", null, 1.0, 2]}]') |
Benjamin Peterson | 2505bc6 | 2008-05-15 02:17:58 +0000 | [diff] [blame] | 56 | ['foo', {'bar': ['baz', None, 1.0, 2]}] |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 57 | >>> json.loads('"\\"foo\\bar"') |
Benjamin Peterson | 2505bc6 | 2008-05-15 02:17:58 +0000 | [diff] [blame] | 58 | '"foo\x08ar' |
| 59 | >>> from io import StringIO |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 60 | >>> io = StringIO('["streaming API"]') |
| 61 | >>> json.load(io) |
Benjamin Peterson | 2505bc6 | 2008-05-15 02:17:58 +0000 | [diff] [blame] | 62 | ['streaming API'] |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 63 | |
| 64 | Specializing JSON object decoding:: |
| 65 | |
| 66 | >>> import json |
| 67 | >>> def as_complex(dct): |
| 68 | ... if '__complex__' in dct: |
| 69 | ... return complex(dct['real'], dct['imag']) |
| 70 | ... return dct |
Benjamin Peterson | 2505bc6 | 2008-05-15 02:17:58 +0000 | [diff] [blame] | 71 | ... |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 72 | >>> json.loads('{"__complex__": true, "real": 1, "imag": 2}', |
| 73 | ... object_hook=as_complex) |
| 74 | (1+2j) |
| 75 | >>> import decimal |
| 76 | >>> json.loads('1.1', parse_float=decimal.Decimal) |
| 77 | Decimal('1.1') |
| 78 | |
| 79 | Extending :class:`JSONEncoder`:: |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 80 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 81 | >>> import json |
| 82 | >>> class ComplexEncoder(json.JSONEncoder): |
| 83 | ... def default(self, obj): |
| 84 | ... if isinstance(obj, complex): |
| 85 | ... return [obj.real, obj.imag] |
R David Murray | dd24617 | 2013-03-17 21:52:35 -0400 | [diff] [blame] | 86 | ... # Let the base class default method raise the TypeError |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 87 | ... return json.JSONEncoder.default(self, obj) |
Benjamin Peterson | 2505bc6 | 2008-05-15 02:17:58 +0000 | [diff] [blame] | 88 | ... |
Georg Brandl | 0bb73b8 | 2010-09-03 22:36:22 +0000 | [diff] [blame] | 89 | >>> json.dumps(2 + 1j, cls=ComplexEncoder) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 90 | '[2.0, 1.0]' |
| 91 | >>> ComplexEncoder().encode(2 + 1j) |
| 92 | '[2.0, 1.0]' |
| 93 | >>> list(ComplexEncoder().iterencode(2 + 1j)) |
Georg Brandl | 0bb73b8 | 2010-09-03 22:36:22 +0000 | [diff] [blame] | 94 | ['[2.0', ', 1.0', ']'] |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 95 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 96 | |
Ezio Melotti | 84e59aa | 2012-04-13 21:02:18 -0600 | [diff] [blame] | 97 | .. highlight:: bash |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 98 | |
| 99 | Using json.tool from the shell to validate and pretty-print:: |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 100 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 101 | $ echo '{"json":"obj"}' | python -mjson.tool |
| 102 | { |
| 103 | "json": "obj" |
| 104 | } |
Ezio Melotti | 84e59aa | 2012-04-13 21:02:18 -0600 | [diff] [blame] | 105 | $ echo '{1.2:3.4}' | python -mjson.tool |
Serhiy Storchaka | c510a04 | 2013-02-21 20:19:16 +0200 | [diff] [blame] | 106 | Expecting property name enclosed in double quotes: line 1 column 2 (char 1) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 107 | |
Ezio Melotti | 84e59aa | 2012-04-13 21:02:18 -0600 | [diff] [blame] | 108 | .. highlight:: python3 |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 109 | |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 110 | .. note:: |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 111 | |
Antoine Pitrou | 331624b | 2012-08-24 19:37:23 +0200 | [diff] [blame] | 112 | JSON is a subset of `YAML <http://yaml.org/>`_ 1.2. The JSON produced by |
| 113 | this module's default settings (in particular, the default *separators* |
| 114 | value) is also a subset of YAML 1.0 and 1.1. This module can thus also be |
| 115 | used as a YAML serializer. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 116 | |
| 117 | |
| 118 | Basic Usage |
| 119 | ----------- |
| 120 | |
Andrew Svetlov | 2ec53be | 2012-10-28 14:10:30 +0200 | [diff] [blame] | 121 | .. function:: dump(obj, fp, skipkeys=False, ensure_ascii=True, \ |
| 122 | check_circular=True, allow_nan=True, cls=None, \ |
| 123 | indent=None, separators=None, default=None, \ |
| 124 | sort_keys=False, **kw) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 125 | |
| 126 | Serialize *obj* as a JSON formatted stream to *fp* (a ``.write()``-supporting |
Ezio Melotti | 6d2bc6e | 2013-03-29 03:59:29 +0200 | [diff] [blame] | 127 | :term:`file-like object`) using this :ref:`conversion table |
| 128 | <py-to-json-table>`. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 129 | |
| 130 | If *skipkeys* is ``True`` (default: ``False``), then dict keys that are not |
Antoine Pitrou | 00d650b | 2011-01-21 21:37:32 +0000 | [diff] [blame] | 131 | of a basic type (:class:`str`, :class:`int`, :class:`float`, :class:`bool`, |
| 132 | ``None``) will be skipped instead of raising a :exc:`TypeError`. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 133 | |
Benjamin Peterson | c6b607d | 2009-05-02 12:36:44 +0000 | [diff] [blame] | 134 | The :mod:`json` module always produces :class:`str` objects, not |
| 135 | :class:`bytes` objects. Therefore, ``fp.write()`` must support :class:`str` |
| 136 | input. |
| 137 | |
Éric Araujo | 6f7aa00 | 2012-01-16 10:09:20 +0100 | [diff] [blame] | 138 | If *ensure_ascii* is ``True`` (the default), the output is guaranteed to |
| 139 | have all incoming non-ASCII characters escaped. If *ensure_ascii* is |
| 140 | ``False``, these characters will be output as-is. |
| 141 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 142 | If *check_circular* is ``False`` (default: ``True``), then the circular |
| 143 | reference check for container types will be skipped and a circular reference |
| 144 | will result in an :exc:`OverflowError` (or worse). |
| 145 | |
| 146 | If *allow_nan* is ``False`` (default: ``True``), then it will be a |
| 147 | :exc:`ValueError` to serialize out of range :class:`float` values (``nan``, |
| 148 | ``inf``, ``-inf``) in strict compliance of the JSON specification, instead of |
| 149 | using the JavaScript equivalents (``NaN``, ``Infinity``, ``-Infinity``). |
| 150 | |
Raymond Hettinger | b643ef8 | 2010-10-31 08:00:16 +0000 | [diff] [blame] | 151 | If *indent* is a non-negative integer or string, then JSON array elements and |
| 152 | object members will be pretty-printed with that indent level. An indent level |
R David Murray | d531548 | 2011-04-12 21:09:18 -0400 | [diff] [blame] | 153 | of 0, negative, or ``""`` will only insert newlines. ``None`` (the default) |
| 154 | selects the most compact representation. Using a positive integer indent |
Petri Lehtinen | 72c6eef | 2012-08-27 20:27:30 +0300 | [diff] [blame] | 155 | indents that many spaces per level. If *indent* is a string (such as ``"\t"``), |
R David Murray | d531548 | 2011-04-12 21:09:18 -0400 | [diff] [blame] | 156 | that string is used to indent each level. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 157 | |
Petri Lehtinen | 72b1426 | 2012-08-28 07:08:44 +0300 | [diff] [blame] | 158 | .. versionchanged:: 3.2 |
| 159 | Allow strings for *indent* in addition to integers. |
| 160 | |
Ezio Melotti | d654ded | 2012-11-29 00:35:29 +0200 | [diff] [blame] | 161 | .. note:: |
| 162 | |
| 163 | Since the default item separator is ``', '``, the output might include |
| 164 | trailing whitespace when *indent* is specified. You can use |
| 165 | ``separators=(',', ': ')`` to avoid this. |
| 166 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 167 | If *separators* is an ``(item_separator, dict_separator)`` tuple, then it |
| 168 | will be used instead of the default ``(', ', ': ')`` separators. ``(',', |
| 169 | ':')`` is the most compact JSON representation. |
| 170 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 171 | *default(obj)* is a function that should return a serializable version of |
| 172 | *obj* or raise :exc:`TypeError`. The default simply raises :exc:`TypeError`. |
| 173 | |
Andrew Svetlov | 2ec53be | 2012-10-28 14:10:30 +0200 | [diff] [blame] | 174 | If *sort_keys* is ``True`` (default: ``False``), then the output of |
| 175 | dictionaries will be sorted by key. |
| 176 | |
Georg Brandl | 1f01deb | 2009-01-03 22:47:39 +0000 | [diff] [blame] | 177 | To use a custom :class:`JSONEncoder` subclass (e.g. one that overrides the |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 178 | :meth:`default` method to serialize additional types), specify it with the |
Georg Brandl | d4460aa | 2010-10-15 17:03:02 +0000 | [diff] [blame] | 179 | *cls* kwarg; otherwise :class:`JSONEncoder` is used. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 180 | |
| 181 | |
Andrew Svetlov | 2ec53be | 2012-10-28 14:10:30 +0200 | [diff] [blame] | 182 | .. function:: dumps(obj, skipkeys=False, ensure_ascii=True, \ |
| 183 | check_circular=True, allow_nan=True, cls=None, \ |
| 184 | indent=None, separators=None, default=None, \ |
| 185 | sort_keys=False, **kw) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 186 | |
Ezio Melotti | 6d2bc6e | 2013-03-29 03:59:29 +0200 | [diff] [blame] | 187 | Serialize *obj* to a JSON formatted :class:`str` using this :ref:`conversion |
| 188 | table <py-to-json-table>`. The arguments have the same meaning as in |
| 189 | :func:`dump`. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 190 | |
Ezio Melotti | 60adf95 | 2011-04-15 07:37:00 +0300 | [diff] [blame] | 191 | .. note:: |
| 192 | |
Georg Brandl | 340d269 | 2011-04-16 16:54:15 +0200 | [diff] [blame] | 193 | Unlike :mod:`pickle` and :mod:`marshal`, JSON is not a framed protocol, |
| 194 | so trying to serialize multiple objects with repeated calls to |
| 195 | :func:`dump` using the same *fp* will result in an invalid JSON file. |
| 196 | |
Senthil Kumaran | f2123d2 | 2012-03-17 00:40:34 -0700 | [diff] [blame] | 197 | .. note:: |
| 198 | |
| 199 | Keys in key/value pairs of JSON are always of the type :class:`str`. When |
| 200 | a dictionary is converted into JSON, all the keys of the dictionary are |
Terry Jan Reedy | 9cbcc2f | 2013-03-08 19:35:15 -0500 | [diff] [blame] | 201 | coerced to strings. As a result of this, if a dictionary is converted |
Senthil Kumaran | f2123d2 | 2012-03-17 00:40:34 -0700 | [diff] [blame] | 202 | into JSON and then back into a dictionary, the dictionary may not equal |
| 203 | the original one. That is, ``loads(dumps(x)) != x`` if x has non-string |
| 204 | keys. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 205 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 206 | .. function:: load(fp, cls=None, object_hook=None, parse_float=None, parse_int=None, parse_constant=None, object_pairs_hook=None, **kw) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 207 | |
Antoine Pitrou | 15251a9 | 2012-08-24 19:49:08 +0200 | [diff] [blame] | 208 | Deserialize *fp* (a ``.read()``-supporting :term:`file-like object` |
Ezio Melotti | 6d2bc6e | 2013-03-29 03:59:29 +0200 | [diff] [blame] | 209 | containing a JSON document) to a Python object using this :ref:`conversion |
| 210 | table <json-to-py-table>`. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 211 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 212 | *object_hook* is an optional function that will be called with the result of |
Benjamin Peterson | 25c95f1 | 2009-05-08 20:42:26 +0000 | [diff] [blame] | 213 | any object literal decoded (a :class:`dict`). The return value of |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 214 | *object_hook* will be used instead of the :class:`dict`. This feature can be used |
Antoine Pitrou | 331624b | 2012-08-24 19:37:23 +0200 | [diff] [blame] | 215 | to implement custom decoders (e.g. `JSON-RPC <http://www.jsonrpc.org>`_ |
| 216 | class hinting). |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 217 | |
Raymond Hettinger | 9b8d069 | 2009-04-21 03:27:12 +0000 | [diff] [blame] | 218 | *object_pairs_hook* is an optional function that will be called with the |
Benjamin Peterson | 25c95f1 | 2009-05-08 20:42:26 +0000 | [diff] [blame] | 219 | result of any object literal decoded with an ordered list of pairs. The |
Raymond Hettinger | 9b8d069 | 2009-04-21 03:27:12 +0000 | [diff] [blame] | 220 | return value of *object_pairs_hook* will be used instead of the |
| 221 | :class:`dict`. This feature can be used to implement custom decoders that |
| 222 | rely on the order that the key and value pairs are decoded (for example, |
| 223 | :func:`collections.OrderedDict` will remember the order of insertion). If |
| 224 | *object_hook* is also defined, the *object_pairs_hook* takes priority. |
| 225 | |
| 226 | .. versionchanged:: 3.1 |
Hirokazu Yamamoto | ae9eb5c | 2009-04-26 03:34:06 +0000 | [diff] [blame] | 227 | Added support for *object_pairs_hook*. |
Raymond Hettinger | 9b8d069 | 2009-04-21 03:27:12 +0000 | [diff] [blame] | 228 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 229 | *parse_float*, if specified, will be called with the string of every JSON |
| 230 | float to be decoded. By default, this is equivalent to ``float(num_str)``. |
| 231 | This can be used to use another datatype or parser for JSON floats |
| 232 | (e.g. :class:`decimal.Decimal`). |
| 233 | |
| 234 | *parse_int*, if specified, will be called with the string of every JSON int |
| 235 | to be decoded. By default, this is equivalent to ``int(num_str)``. This can |
| 236 | be used to use another datatype or parser for JSON integers |
| 237 | (e.g. :class:`float`). |
| 238 | |
| 239 | *parse_constant*, if specified, will be called with one of the following |
Hynek Schlawack | 9729fd4 | 2012-05-16 19:01:04 +0200 | [diff] [blame] | 240 | strings: ``'-Infinity'``, ``'Infinity'``, ``'NaN'``. |
| 241 | This can be used to raise an exception if invalid JSON numbers |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 242 | are encountered. |
| 243 | |
Hynek Schlawack | f54c060 | 2012-05-20 18:32:53 +0200 | [diff] [blame] | 244 | .. versionchanged:: 3.1 |
Hynek Schlawack | 1203e83 | 2012-05-20 12:03:17 +0200 | [diff] [blame] | 245 | *parse_constant* doesn't get called on 'null', 'true', 'false' anymore. |
| 246 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 247 | To use a custom :class:`JSONDecoder` subclass, specify it with the ``cls`` |
Georg Brandl | d4460aa | 2010-10-15 17:03:02 +0000 | [diff] [blame] | 248 | kwarg; otherwise :class:`JSONDecoder` is used. Additional keyword arguments |
| 249 | will be passed to the constructor of the class. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 250 | |
| 251 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 252 | .. function:: loads(s, encoding=None, cls=None, object_hook=None, parse_float=None, parse_int=None, parse_constant=None, object_pairs_hook=None, **kw) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 253 | |
Antoine Pitrou | 00d650b | 2011-01-21 21:37:32 +0000 | [diff] [blame] | 254 | Deserialize *s* (a :class:`str` instance containing a JSON document) to a |
Ezio Melotti | 6d2bc6e | 2013-03-29 03:59:29 +0200 | [diff] [blame] | 255 | Python object using this :ref:`conversion table <json-to-py-table>`. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 256 | |
Antoine Pitrou | 00d650b | 2011-01-21 21:37:32 +0000 | [diff] [blame] | 257 | The other arguments have the same meaning as in :func:`load`, except |
| 258 | *encoding* which is ignored and deprecated. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 259 | |
| 260 | |
Antoine Pitrou | 331624b | 2012-08-24 19:37:23 +0200 | [diff] [blame] | 261 | Encoders and Decoders |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 262 | --------------------- |
| 263 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 264 | .. class:: JSONDecoder(object_hook=None, parse_float=None, parse_int=None, parse_constant=None, strict=True, object_pairs_hook=None) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 265 | |
| 266 | Simple JSON decoder. |
| 267 | |
| 268 | Performs the following translations in decoding by default: |
| 269 | |
Ezio Melotti | 6d2bc6e | 2013-03-29 03:59:29 +0200 | [diff] [blame] | 270 | .. _json-to-py-table: |
| 271 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 272 | +---------------+-------------------+ |
| 273 | | JSON | Python | |
| 274 | +===============+===================+ |
| 275 | | object | dict | |
| 276 | +---------------+-------------------+ |
| 277 | | array | list | |
| 278 | +---------------+-------------------+ |
Benjamin Peterson | c6b607d | 2009-05-02 12:36:44 +0000 | [diff] [blame] | 279 | | string | str | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 280 | +---------------+-------------------+ |
Georg Brandl | 639ce96 | 2009-04-11 18:18:16 +0000 | [diff] [blame] | 281 | | number (int) | int | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 282 | +---------------+-------------------+ |
| 283 | | number (real) | float | |
| 284 | +---------------+-------------------+ |
| 285 | | true | True | |
| 286 | +---------------+-------------------+ |
| 287 | | false | False | |
| 288 | +---------------+-------------------+ |
| 289 | | null | None | |
| 290 | +---------------+-------------------+ |
| 291 | |
| 292 | It also understands ``NaN``, ``Infinity``, and ``-Infinity`` as their |
| 293 | corresponding ``float`` values, which is outside the JSON spec. |
| 294 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 295 | *object_hook*, if specified, will be called with the result of every JSON |
| 296 | object decoded and its return value will be used in place of the given |
| 297 | :class:`dict`. This can be used to provide custom deserializations (e.g. to |
| 298 | support JSON-RPC class hinting). |
| 299 | |
Raymond Hettinger | 9b8d069 | 2009-04-21 03:27:12 +0000 | [diff] [blame] | 300 | *object_pairs_hook*, if specified will be called with the result of every |
| 301 | JSON object decoded with an ordered list of pairs. The return value of |
| 302 | *object_pairs_hook* will be used instead of the :class:`dict`. This |
| 303 | feature can be used to implement custom decoders that rely on the order |
| 304 | that the key and value pairs are decoded (for example, |
| 305 | :func:`collections.OrderedDict` will remember the order of insertion). If |
| 306 | *object_hook* is also defined, the *object_pairs_hook* takes priority. |
| 307 | |
| 308 | .. versionchanged:: 3.1 |
Hirokazu Yamamoto | ae9eb5c | 2009-04-26 03:34:06 +0000 | [diff] [blame] | 309 | Added support for *object_pairs_hook*. |
Raymond Hettinger | 9b8d069 | 2009-04-21 03:27:12 +0000 | [diff] [blame] | 310 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 311 | *parse_float*, if specified, will be called with the string of every JSON |
| 312 | float to be decoded. By default, this is equivalent to ``float(num_str)``. |
| 313 | This can be used to use another datatype or parser for JSON floats |
| 314 | (e.g. :class:`decimal.Decimal`). |
| 315 | |
| 316 | *parse_int*, if specified, will be called with the string of every JSON int |
| 317 | to be decoded. By default, this is equivalent to ``int(num_str)``. This can |
| 318 | be used to use another datatype or parser for JSON integers |
| 319 | (e.g. :class:`float`). |
| 320 | |
| 321 | *parse_constant*, if specified, will be called with one of the following |
| 322 | strings: ``'-Infinity'``, ``'Infinity'``, ``'NaN'``, ``'null'``, ``'true'``, |
| 323 | ``'false'``. This can be used to raise an exception if invalid JSON numbers |
| 324 | are encountered. |
| 325 | |
Georg Brandl | d4460aa | 2010-10-15 17:03:02 +0000 | [diff] [blame] | 326 | If *strict* is ``False`` (``True`` is the default), then control characters |
| 327 | will be allowed inside strings. Control characters in this context are |
| 328 | those with character codes in the 0-31 range, including ``'\t'`` (tab), |
| 329 | ``'\n'``, ``'\r'`` and ``'\0'``. |
| 330 | |
Felix Crux | bc4b8eb | 2013-08-12 17:39:51 -0400 | [diff] [blame^] | 331 | If the data being deserialized is not a valid JSON document, a |
| 332 | :exc:`ValueError` will be raised. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 333 | |
| 334 | .. method:: decode(s) |
| 335 | |
Benjamin Peterson | c6b607d | 2009-05-02 12:36:44 +0000 | [diff] [blame] | 336 | Return the Python representation of *s* (a :class:`str` instance |
| 337 | containing a JSON document) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 338 | |
| 339 | .. method:: raw_decode(s) |
| 340 | |
Benjamin Peterson | c6b607d | 2009-05-02 12:36:44 +0000 | [diff] [blame] | 341 | Decode a JSON document from *s* (a :class:`str` beginning with a |
| 342 | JSON document) and return a 2-tuple of the Python representation |
| 343 | and the index in *s* where the document ended. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 344 | |
| 345 | This can be used to decode a JSON document from a string that may have |
| 346 | extraneous data at the end. |
| 347 | |
| 348 | |
Georg Brandl | cd7f32b | 2009-06-08 09:13:45 +0000 | [diff] [blame] | 349 | .. class:: JSONEncoder(skipkeys=False, ensure_ascii=True, check_circular=True, allow_nan=True, sort_keys=False, indent=None, separators=None, default=None) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 350 | |
| 351 | Extensible JSON encoder for Python data structures. |
| 352 | |
| 353 | Supports the following objects and types by default: |
| 354 | |
Ezio Melotti | 6d2bc6e | 2013-03-29 03:59:29 +0200 | [diff] [blame] | 355 | .. _py-to-json-table: |
| 356 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 357 | +-------------------+---------------+ |
| 358 | | Python | JSON | |
| 359 | +===================+===============+ |
| 360 | | dict | object | |
| 361 | +-------------------+---------------+ |
| 362 | | list, tuple | array | |
| 363 | +-------------------+---------------+ |
Benjamin Peterson | c6b607d | 2009-05-02 12:36:44 +0000 | [diff] [blame] | 364 | | str | string | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 365 | +-------------------+---------------+ |
Georg Brandl | 639ce96 | 2009-04-11 18:18:16 +0000 | [diff] [blame] | 366 | | int, float | number | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 367 | +-------------------+---------------+ |
| 368 | | True | true | |
| 369 | +-------------------+---------------+ |
| 370 | | False | false | |
| 371 | +-------------------+---------------+ |
| 372 | | None | null | |
| 373 | +-------------------+---------------+ |
| 374 | |
| 375 | To extend this to recognize other objects, subclass and implement a |
| 376 | :meth:`default` method with another method that returns a serializable object |
| 377 | for ``o`` if possible, otherwise it should call the superclass implementation |
| 378 | (to raise :exc:`TypeError`). |
| 379 | |
| 380 | If *skipkeys* is ``False`` (the default), then it is a :exc:`TypeError` to |
Georg Brandl | 639ce96 | 2009-04-11 18:18:16 +0000 | [diff] [blame] | 381 | attempt encoding of keys that are not str, int, float or None. If |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 382 | *skipkeys* is ``True``, such items are simply skipped. |
| 383 | |
Benjamin Peterson | c6b607d | 2009-05-02 12:36:44 +0000 | [diff] [blame] | 384 | If *ensure_ascii* is ``True`` (the default), the output is guaranteed to |
| 385 | have all incoming non-ASCII characters escaped. If *ensure_ascii* is |
| 386 | ``False``, these characters will be output as-is. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 387 | |
| 388 | If *check_circular* is ``True`` (the default), then lists, dicts, and custom |
| 389 | encoded objects will be checked for circular references during encoding to |
| 390 | prevent an infinite recursion (which would cause an :exc:`OverflowError`). |
| 391 | Otherwise, no such check takes place. |
| 392 | |
| 393 | If *allow_nan* is ``True`` (the default), then ``NaN``, ``Infinity``, and |
| 394 | ``-Infinity`` will be encoded as such. This behavior is not JSON |
| 395 | specification compliant, but is consistent with most JavaScript based |
| 396 | encoders and decoders. Otherwise, it will be a :exc:`ValueError` to encode |
| 397 | such floats. |
| 398 | |
Georg Brandl | 6a74da3 | 2010-08-22 20:23:38 +0000 | [diff] [blame] | 399 | If *sort_keys* is ``True`` (default ``False``), then the output of dictionaries |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 400 | will be sorted by key; this is useful for regression tests to ensure that |
| 401 | JSON serializations can be compared on a day-to-day basis. |
| 402 | |
Petri Lehtinen | 72b1426 | 2012-08-28 07:08:44 +0300 | [diff] [blame] | 403 | If *indent* is a non-negative integer or string, then JSON array elements and |
| 404 | object members will be pretty-printed with that indent level. An indent level |
| 405 | of 0, negative, or ``""`` will only insert newlines. ``None`` (the default) |
| 406 | selects the most compact representation. Using a positive integer indent |
| 407 | indents that many spaces per level. If *indent* is a string (such as ``"\t"``), |
| 408 | that string is used to indent each level. |
| 409 | |
| 410 | .. versionchanged:: 3.2 |
| 411 | Allow strings for *indent* in addition to integers. |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 412 | |
Ezio Melotti | d654ded | 2012-11-29 00:35:29 +0200 | [diff] [blame] | 413 | .. note:: |
| 414 | |
| 415 | Since the default item separator is ``', '``, the output might include |
| 416 | trailing whitespace when *indent* is specified. You can use |
| 417 | ``separators=(',', ': ')`` to avoid this. |
| 418 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 419 | If specified, *separators* should be an ``(item_separator, key_separator)`` |
| 420 | tuple. The default is ``(', ', ': ')``. To get the most compact JSON |
| 421 | representation, you should specify ``(',', ':')`` to eliminate whitespace. |
| 422 | |
| 423 | If specified, *default* is a function that gets called for objects that can't |
| 424 | otherwise be serialized. It should return a JSON encodable version of the |
| 425 | object or raise a :exc:`TypeError`. |
| 426 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 427 | |
| 428 | .. method:: default(o) |
| 429 | |
| 430 | Implement this method in a subclass such that it returns a serializable |
| 431 | object for *o*, or calls the base implementation (to raise a |
| 432 | :exc:`TypeError`). |
| 433 | |
| 434 | For example, to support arbitrary iterators, you could implement default |
| 435 | like this:: |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 436 | |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 437 | def default(self, o): |
| 438 | try: |
Benjamin Peterson | e9bbc8b | 2008-09-28 02:06:32 +0000 | [diff] [blame] | 439 | iterable = iter(o) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 440 | except TypeError: |
Benjamin Peterson | e9bbc8b | 2008-09-28 02:06:32 +0000 | [diff] [blame] | 441 | pass |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 442 | else: |
| 443 | return list(iterable) |
R David Murray | dd24617 | 2013-03-17 21:52:35 -0400 | [diff] [blame] | 444 | # Let the base class default method raise the TypeError |
Georg Brandl | 0bb73b8 | 2010-09-03 22:36:22 +0000 | [diff] [blame] | 445 | return json.JSONEncoder.default(self, o) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 446 | |
| 447 | |
| 448 | .. method:: encode(o) |
| 449 | |
| 450 | Return a JSON string representation of a Python data structure, *o*. For |
| 451 | example:: |
| 452 | |
Georg Brandl | 0bb73b8 | 2010-09-03 22:36:22 +0000 | [diff] [blame] | 453 | >>> json.JSONEncoder().encode({"foo": ["bar", "baz"]}) |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 454 | '{"foo": ["bar", "baz"]}' |
| 455 | |
| 456 | |
| 457 | .. method:: iterencode(o) |
| 458 | |
| 459 | Encode the given object, *o*, and yield each string representation as |
| 460 | available. For example:: |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 461 | |
Georg Brandl | 0bb73b8 | 2010-09-03 22:36:22 +0000 | [diff] [blame] | 462 | for chunk in json.JSONEncoder().iterencode(bigobject): |
Christian Heimes | 9054000 | 2008-05-08 14:29:10 +0000 | [diff] [blame] | 463 | mysocket.write(chunk) |
Antoine Pitrou | 331624b | 2012-08-24 19:37:23 +0200 | [diff] [blame] | 464 | |
| 465 | |
| 466 | Standard Compliance |
| 467 | ------------------- |
| 468 | |
| 469 | The JSON format is specified by :rfc:`4627`. This section details this |
| 470 | module's level of compliance with the RFC. For simplicity, |
| 471 | :class:`JSONEncoder` and :class:`JSONDecoder` subclasses, and parameters other |
| 472 | than those explicitly mentioned, are not considered. |
| 473 | |
| 474 | This module does not comply with the RFC in a strict fashion, implementing some |
| 475 | extensions that are valid JavaScript but not valid JSON. In particular: |
| 476 | |
| 477 | - Top-level non-object, non-array values are accepted and output; |
| 478 | - Infinite and NaN number values are accepted and output; |
| 479 | - Repeated names within an object are accepted, and only the value of the last |
| 480 | name-value pair is used. |
| 481 | |
| 482 | Since the RFC permits RFC-compliant parsers to accept input texts that are not |
| 483 | RFC-compliant, this module's deserializer is technically RFC-compliant under |
| 484 | default settings. |
| 485 | |
| 486 | Character Encodings |
| 487 | ^^^^^^^^^^^^^^^^^^^ |
| 488 | |
| 489 | The RFC recommends that JSON be represented using either UTF-8, UTF-16, or |
| 490 | UTF-32, with UTF-8 being the default. |
| 491 | |
| 492 | As permitted, though not required, by the RFC, this module's serializer sets |
| 493 | *ensure_ascii=True* by default, thus escaping the output so that the resulting |
| 494 | strings only contain ASCII characters. |
| 495 | |
| 496 | Other than the *ensure_ascii* parameter, this module is defined strictly in |
| 497 | terms of conversion between Python objects and |
| 498 | :class:`Unicode strings <str>`, and thus does not otherwise address the issue |
| 499 | of character encodings. |
| 500 | |
| 501 | |
| 502 | Top-level Non-Object, Non-Array Values |
| 503 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| 504 | |
| 505 | The RFC specifies that the top-level value of a JSON text must be either a |
| 506 | JSON object or array (Python :class:`dict` or :class:`list`). This module's |
| 507 | deserializer also accepts input texts consisting solely of a |
| 508 | JSON null, boolean, number, or string value:: |
| 509 | |
| 510 | >>> just_a_json_string = '"spam and eggs"' # Not by itself a valid JSON text |
| 511 | >>> json.loads(just_a_json_string) |
| 512 | 'spam and eggs' |
| 513 | |
| 514 | This module itself does not include a way to request that such input texts be |
| 515 | regarded as illegal. Likewise, this module's serializer also accepts single |
| 516 | Python :data:`None`, :class:`bool`, numeric, and :class:`str` |
| 517 | values as input and will generate output texts consisting solely of a top-level |
| 518 | JSON null, boolean, number, or string value without raising an exception:: |
| 519 | |
| 520 | >>> neither_a_list_nor_a_dict = "spam and eggs" |
| 521 | >>> json.dumps(neither_a_list_nor_a_dict) # The result is not a valid JSON text |
| 522 | '"spam and eggs"' |
| 523 | |
| 524 | This module's serializer does not itself include a way to enforce the |
| 525 | aforementioned constraint. |
| 526 | |
| 527 | |
| 528 | Infinite and NaN Number Values |
| 529 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| 530 | |
| 531 | The RFC does not permit the representation of infinite or NaN number values. |
| 532 | Despite that, by default, this module accepts and outputs ``Infinity``, |
| 533 | ``-Infinity``, and ``NaN`` as if they were valid JSON number literal values:: |
| 534 | |
| 535 | >>> # Neither of these calls raises an exception, but the results are not valid JSON |
| 536 | >>> json.dumps(float('-inf')) |
| 537 | '-Infinity' |
| 538 | >>> json.dumps(float('nan')) |
| 539 | 'NaN' |
| 540 | >>> # Same when deserializing |
| 541 | >>> json.loads('-Infinity') |
| 542 | -inf |
| 543 | >>> json.loads('NaN') |
| 544 | nan |
| 545 | |
| 546 | In the serializer, the *allow_nan* parameter can be used to alter this |
| 547 | behavior. In the deserializer, the *parse_constant* parameter can be used to |
| 548 | alter this behavior. |
| 549 | |
| 550 | |
| 551 | Repeated Names Within an Object |
| 552 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| 553 | |
| 554 | The RFC specifies that the names within a JSON object should be unique, but |
| 555 | does not specify how repeated names in JSON objects should be handled. By |
| 556 | default, this module does not raise an exception; instead, it ignores all but |
| 557 | the last name-value pair for a given name:: |
| 558 | |
| 559 | >>> weird_json = '{"x": 1, "x": 2, "x": 3}' |
| 560 | >>> json.loads(weird_json) |
| 561 | {'x': 3} |
| 562 | |
| 563 | The *object_pairs_hook* parameter can be used to alter this behavior. |