blob: a9c8965d87b08a19653535c68d42546503f48714 [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001
2:mod:`collections` --- High-performance container datatypes
3===========================================================
4
5.. module:: collections
6 :synopsis: High-performance datatypes
7.. moduleauthor:: Raymond Hettinger <python@rcn.com>
8.. sectionauthor:: Raymond Hettinger <python@rcn.com>
9
Georg Brandl8ec7f652007-08-15 14:28:01 +000010.. versionadded:: 2.4
11
Georg Brandl4c8bbe62008-03-22 21:06:20 +000012.. testsetup:: *
13
14 from collections import *
15 import itertools
16 __name__ = '<doctest>'
17
Georg Brandl8ec7f652007-08-15 14:28:01 +000018This module implements high-performance container datatypes. Currently,
Raymond Hettingerbc512d32009-03-03 04:45:34 +000019there are three datatypes, :class:`Counter`, :class:`deque`, :class:`OrderedDict` and
Raymond Hettingerf746a1f2009-02-17 08:33:01 +000020:class:`defaultdict`, and one datatype factory function, :func:`namedtuple`.
Georg Brandl8ec7f652007-08-15 14:28:01 +000021
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000022The specialized containers provided in this module provide alternatives
Georg Brandl4c8bbe62008-03-22 21:06:20 +000023to Python's general purpose built-in containers, :class:`dict`,
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000024:class:`list`, :class:`set`, and :class:`tuple`.
25
Raymond Hettingerf746a1f2009-02-17 08:33:01 +000026.. versionchanged:: 2.4
27 Added :class:`deque`.
28
29.. versionchanged:: 2.5
30 Added :class:`defaultdict`.
31
32.. versionchanged:: 2.6
33 Added :func:`namedtuple` and added abstract base classes.
34
35.. versionchanged:: 2.7
Raymond Hettingerbc512d32009-03-03 04:45:34 +000036 Added :class:`Counter` and :class:`OrderedDict`.
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000037
38In addition to containers, the collections module provides some ABCs
Georg Brandl4c8bbe62008-03-22 21:06:20 +000039(abstract base classes) that can be used to test whether a class
Raymond Hettingerf746a1f2009-02-17 08:33:01 +000040provides a particular interface, for example, whether it is hashable or
Georg Brandl4c8bbe62008-03-22 21:06:20 +000041a mapping.
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000042
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000043
44ABCs - abstract base classes
45----------------------------
46
47The collections module offers the following ABCs:
48
Georg Brandldbc59872008-07-08 07:05:23 +000049========================= ===================== ====================== ====================================================
50ABC Inherits Abstract Methods Mixin Methods
51========================= ===================== ====================== ====================================================
52:class:`Container` ``__contains__``
53:class:`Hashable` ``__hash__``
54:class:`Iterable` ``__iter__``
55:class:`Iterator` :class:`Iterable` ``__next__`` ``__iter__``
Georg Brandl7044b112009-01-03 21:04:55 +000056:class:`Sized` ``__len__``
Georg Brandldbc59872008-07-08 07:05:23 +000057:class:`Callable` ``__call__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000058
Georg Brandldbc59872008-07-08 07:05:23 +000059:class:`Sequence` :class:`Sized`, ``__getitem__`` ``__contains__``. ``__iter__``, ``__reversed__``.
Raymond Hettinger1712baa2009-01-28 23:58:16 +000060 :class:`Iterable`, ``index``, and ``count``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000061 :class:`Container`
62
Raymond Hettinger1712baa2009-01-28 23:58:16 +000063:class:`MutableSequence` :class:`Sequence` ``__setitem__`` Inherited Sequence methods and
Georg Brandldbc59872008-07-08 07:05:23 +000064 ``__delitem__``, ``append``, ``reverse``, ``extend``, ``pop``,
Raymond Hettinger1712baa2009-01-28 23:58:16 +000065 and ``insert`` ``remove``, and ``__iadd__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000066
Raymond Hettinger1712baa2009-01-28 23:58:16 +000067:class:`Set` :class:`Sized`, ``__le__``, ``__lt__``, ``__eq__``, ``__ne__``,
68 :class:`Iterable`, ``__gt__``, ``__ge__``, ``__and__``, ``__or__``
69 :class:`Container` ``__sub__``, ``__xor__``, and ``isdisjoint``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000070
Georg Brandldbc59872008-07-08 07:05:23 +000071:class:`MutableSet` :class:`Set` ``add`` and Inherited Set methods and
72 ``discard`` ``clear``, ``pop``, ``remove``, ``__ior__``,
73 ``__iand__``, ``__ixor__``, and ``__isub__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000074
Raymond Hettinger1712baa2009-01-28 23:58:16 +000075:class:`Mapping` :class:`Sized`, ``__getitem__`` ``__contains__``, ``keys``, ``items``, ``values``,
76 :class:`Iterable`, ``get``, ``__eq__``, and ``__ne__``
77 :class:`Container`
Georg Brandlc62ef8b2009-01-03 20:55:06 +000078
Raymond Hettinger1712baa2009-01-28 23:58:16 +000079:class:`MutableMapping` :class:`Mapping` ``__setitem__`` and Inherited Mapping methods and
80 ``__delitem__`` ``pop``, ``popitem``, ``clear``, ``update``,
81 and ``setdefault``
82
Georg Brandlc62ef8b2009-01-03 20:55:06 +000083
Georg Brandldbc59872008-07-08 07:05:23 +000084:class:`MappingView` :class:`Sized` ``__len__``
85:class:`KeysView` :class:`MappingView`, ``__contains__``,
86 :class:`Set` ``__iter__``
87:class:`ItemsView` :class:`MappingView`, ``__contains__``,
88 :class:`Set` ``__iter__``
89:class:`ValuesView` :class:`MappingView` ``__contains__``, ``__iter__``
90========================= ===================== ====================== ====================================================
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000091
92These ABCs allow us to ask classes or instances if they provide
93particular functionality, for example::
94
95 size = None
96 if isinstance(myvar, collections.Sized):
Georg Brandl7044b112009-01-03 21:04:55 +000097 size = len(myvar)
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000098
99Several of the ABCs are also useful as mixins that make it easier to develop
100classes supporting container APIs. For example, to write a class supporting
101the full :class:`Set` API, it only necessary to supply the three underlying
102abstract methods: :meth:`__contains__`, :meth:`__iter__`, and :meth:`__len__`.
103The ABC supplies the remaining methods such as :meth:`__and__` and
104:meth:`isdisjoint` ::
105
106 class ListBasedSet(collections.Set):
107 ''' Alternate set implementation favoring space over speed
108 and not requiring the set elements to be hashable. '''
109 def __init__(self, iterable):
110 self.elements = lst = []
111 for value in iterable:
112 if value not in lst:
113 lst.append(value)
114 def __iter__(self):
115 return iter(self.elements)
116 def __contains__(self, value):
117 return value in self.elements
118 def __len__(self):
119 return len(self.elements)
120
121 s1 = ListBasedSet('abcdef')
122 s2 = ListBasedSet('defghi')
123 overlap = s1 & s2 # The __and__() method is supported automatically
124
125Notes on using :class:`Set` and :class:`MutableSet` as a mixin:
126
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000127(1)
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000128 Since some set operations create new sets, the default mixin methods need
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000129 a way to create new instances from an iterable. The class constructor is
130 assumed to have a signature in the form ``ClassName(iterable)``.
Raymond Hettinger96b42402008-05-23 17:34:34 +0000131 That assumption is factored-out to an internal classmethod called
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000132 :meth:`_from_iterable` which calls ``cls(iterable)`` to produce a new set.
133 If the :class:`Set` mixin is being used in a class with a different
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000134 constructor signature, you will need to override :meth:`from_iterable`
135 with a classmethod that can construct new instances from
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000136 an iterable argument.
137
138(2)
139 To override the comparisons (presumably for speed, as the
140 semantics are fixed), redefine :meth:`__le__` and
141 then the other operations will automatically follow suit.
142
143(3)
144 The :class:`Set` mixin provides a :meth:`_hash` method to compute a hash value
145 for the set; however, :meth:`__hash__` is not defined because not all sets
146 are hashable or immutable. To add set hashabilty using mixins,
147 inherit from both :meth:`Set` and :meth:`Hashable`, then define
148 ``__hash__ = Set._hash``.
149
150(For more about ABCs, see the :mod:`abc` module and :pep:`3119`.)
151
152
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000153:class:`Counter` objects
154------------------------
155
156A counter tool is provided to support convenient and rapid tallies.
157For example::
158
Raymond Hettinger939a3cc2009-02-04 11:31:30 +0000159 >>> # Tally occurrences of words in a list
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000160 >>> cnt = Counter()
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000161 >>> for word in ['red', 'blue', 'red', 'green', 'blue', 'blue']:
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000162 ... cnt[word] += 1
163 >>> cnt
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000164 Counter({'blue': 3, 'red': 2, 'green': 1})
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000165
Raymond Hettinger939a3cc2009-02-04 11:31:30 +0000166 >>> # Find the ten most common words in Hamlet
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000167 >>> import re
168 >>> words = re.findall('\w+', open('hamlet.txt').read().lower())
Raymond Hettinger196a0f72009-01-20 12:59:36 +0000169 >>> Counter(words).most_common(10)
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000170 [('the', 1143), ('and', 966), ('to', 762), ('of', 669), ('i', 631),
171 ('you', 554), ('a', 546), ('my', 514), ('hamlet', 471), ('in', 451)]
172
Raymond Hettinger82783852009-01-13 03:49:43 +0000173.. class:: Counter([iterable-or-mapping])
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000174
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000175 A :class:`Counter` is a :class:`dict` subclass for counting hashable objects.
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000176 It is an unordered collection where elements are stored as dictionary keys
177 and their counts are stored as dictionary values. Counts are allowed to be
178 any integer value including zero or negative counts. The :class:`Counter`
179 class is similar to bags or multisets in other languages.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000180
Raymond Hettinger82783852009-01-13 03:49:43 +0000181 Elements are counted from an *iterable* or initialized from another
182 *mapping* (or counter)::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000183
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000184 >>> c = Counter() # a new, empty counter
185 >>> c = Counter('gallahad') # a new counter from an iterable
186 >>> c = Counter({'red': 4, 'blue': 2}) # a new counter from a mapping
187 >>> c = Counter(cats=4, dogs=8) # a new counter from keyword args
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000188
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000189 Counter objects have a dictionary interface except that they return a zero
190 count for missing items instead of raising a :exc:`KeyError`::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000191
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000192 >>> c = Counter(['eggs', 'ham'])
Raymond Hettinger59894122009-01-14 00:15:21 +0000193 >>> c['bacon'] # count of a missing element is zero
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000194 0
195
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000196 Setting a count to zero does not remove an element from a counter.
197 Use ``del`` to remove it entirely:
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000198
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000199 >>> c['sausage'] = 0 # counter entry with a zero count
200 >>> del c['sausage'] # del actually removes the entry
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000201
202 .. versionadded:: 2.7
203
204
205 Counter objects support two methods beyond those available for all
206 dictionaries:
207
208 .. method:: elements()
209
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000210 Return an iterator over elements repeating each as many times as its
211 count. Elements are returned in arbitrary order. If an element's count
212 is less than one, :meth:`elements` will ignore it.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000213
Raymond Hettinger196a0f72009-01-20 12:59:36 +0000214 >>> c = Counter(a=4, b=2, c=0, d=-2)
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000215 >>> list(c.elements())
216 ['a', 'a', 'a', 'a', 'b', 'b']
217
218 .. method:: most_common([n])
219
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000220 Return a list of the *n* most common elements and their counts from the
Raymond Hettingerd507afd2009-02-04 10:52:32 +0000221 most common to the least. If *n* is not specified, :func:`most_common`
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000222 returns *all* elements in the counter. Elements with equal counts are
223 ordered arbitrarily::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000224
225 >>> Counter('abracadabra').most_common(3)
226 [('a', 5), ('r', 2), ('b', 2)]
227
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000228 The usual dictionary methods are available for :class:`Counter` objects
229 except for two which work differently for counters.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000230
231 .. method:: fromkeys(iterable)
232
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000233 This class method is not implemented for :class:`Counter` objects.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000234
Raymond Hettinger82783852009-01-13 03:49:43 +0000235 .. method:: update([iterable-or-mapping])
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000236
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000237 Elements are counted from an *iterable* or added-in from another
238 *mapping* (or counter). Like :meth:`dict.update` but adds counts
239 instead of replacing them. Also, the *iterable* is expected to be a
240 sequence of elements, not a sequence of ``(key, value)`` pairs.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000241
Raymond Hettingerfbcf7492009-01-13 08:38:14 +0000242Common patterns for working with :class:`Counter` objects::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000243
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000244 sum(c.values()) # total of all counts
245 c.clear() # reset all counts
246 list(c) # list unique elements
247 set(c) # convert to a set
248 dict(c) # convert to a regular dictionary
249 c.items() # convert to a list of (elem, cnt) pairs
250 Counter(dict(list_of_pairs)) # convert from a list of (elem, cnt) pairs
251 c.most_common()[:-n:-1] # n least common elements
252 c += Counter() # remove zero and negative counts
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000253
Raymond Hettingera6658532009-02-25 22:48:24 +0000254Several mathematical operations are provided for combining :class:`Counter`
255objects to produce multisets (counters that have counts greater than zero).
256Addition and subtraction combine counters by adding or subtracting the counts
257of corresponding elements. Intersection and union return the minimum and
258maximum of corresponding counts. Each operation can accept inputs with signed
259counts, but the output will exclude results with counts of zero or less.
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000260
Raymond Hettinger4571f342009-01-21 20:31:50 +0000261 >>> c = Counter(a=3, b=1)
262 >>> d = Counter(a=1, b=2)
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000263 >>> c + d # add two counters together: c[x] + d[x]
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000264 Counter({'a': 4, 'b': 3})
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000265 >>> c - d # subtract (keeping only positive counts)
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000266 Counter({'a': 2})
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000267 >>> c & d # intersection: min(c[x], d[x])
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000268 Counter({'a': 1, 'b': 1})
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000269 >>> c | d # union: max(c[x], d[x])
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000270 Counter({'a': 3, 'b': 2})
271
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000272.. seealso::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000273
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000274 * `Counter class <http://code.activestate.com/recipes/576611/>`_
275 adapted for Python 2.5 and an early `Bag recipe
276 <http://code.activestate.com/recipes/259174/>`_ for Python 2.4.
277
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000278 * `Bag class <http://www.gnu.org/software/smalltalk/manual-base/html_node/Bag.html>`_
279 in Smalltalk.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000280
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000281 * Wikipedia entry for `Multisets <http://en.wikipedia.org/wiki/Multiset>`_\.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000282
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000283 * `C++ multisets <http://www.demo2s.com/Tutorial/Cpp/0380__set-multiset/Catalog0380__set-multiset.htm>`_
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000284 tutorial with examples.
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000285
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000286 * For mathematical operations on multisets and their use cases, see
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000287 *Knuth, Donald. The Art of Computer Programming Volume II,
288 Section 4.6.3, Exercise 19*\.
289
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000290 * To enumerate all distinct multisets of a given size over a given set of
Raymond Hettingerd081abc2009-01-27 02:58:49 +0000291 elements, see :func:`itertools.combinations_with_replacement`.
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000292
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000293 map(Counter, combinations_with_replacement('ABC', 2)) --> AA AB AC BB BC CC
Raymond Hettingerfbcf7492009-01-13 08:38:14 +0000294
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000295
Georg Brandl8ec7f652007-08-15 14:28:01 +0000296:class:`deque` objects
297----------------------
298
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000299.. class:: deque([iterable[, maxlen]])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000300
301 Returns a new deque object initialized left-to-right (using :meth:`append`) with
302 data from *iterable*. If *iterable* is not specified, the new deque is empty.
303
304 Deques are a generalization of stacks and queues (the name is pronounced "deck"
305 and is short for "double-ended queue"). Deques support thread-safe, memory
306 efficient appends and pops from either side of the deque with approximately the
307 same O(1) performance in either direction.
308
309 Though :class:`list` objects support similar operations, they are optimized for
310 fast fixed-length operations and incur O(n) memory movement costs for
311 ``pop(0)`` and ``insert(0, v)`` operations which change both the size and
312 position of the underlying data representation.
313
314 .. versionadded:: 2.4
315
Raymond Hettinger68995862007-10-10 00:26:46 +0000316 If *maxlen* is not specified or is *None*, deques may grow to an
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000317 arbitrary length. Otherwise, the deque is bounded to the specified maximum
318 length. Once a bounded length deque is full, when new items are added, a
319 corresponding number of items are discarded from the opposite end. Bounded
320 length deques provide functionality similar to the ``tail`` filter in
321 Unix. They are also useful for tracking transactions and other pools of data
322 where only the most recent activity is of interest.
323
324 .. versionchanged:: 2.6
Georg Brandlb19be572007-12-29 10:57:00 +0000325 Added *maxlen* parameter.
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000326
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000327 Deque objects support the following methods:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000328
329
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000330 .. method:: append(x)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000331
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000332 Add *x* to the right side of the deque.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000333
334
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000335 .. method:: appendleft(x)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000336
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000337 Add *x* to the left side of the deque.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000338
339
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000340 .. method:: clear()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000341
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000342 Remove all elements from the deque leaving it with length 0.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000343
344
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000345 .. method:: extend(iterable)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000346
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000347 Extend the right side of the deque by appending elements from the iterable
348 argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000349
350
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000351 .. method:: extendleft(iterable)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000352
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000353 Extend the left side of the deque by appending elements from *iterable*.
354 Note, the series of left appends results in reversing the order of
355 elements in the iterable argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000356
357
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000358 .. method:: pop()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000359
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000360 Remove and return an element from the right side of the deque. If no
361 elements are present, raises an :exc:`IndexError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000362
363
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000364 .. method:: popleft()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000365
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000366 Remove and return an element from the left side of the deque. If no
367 elements are present, raises an :exc:`IndexError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000368
369
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000370 .. method:: remove(value)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000371
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000372 Removed the first occurrence of *value*. If not found, raises a
373 :exc:`ValueError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000374
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000375 .. versionadded:: 2.5
Georg Brandl8ec7f652007-08-15 14:28:01 +0000376
377
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000378 .. method:: rotate(n)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000379
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000380 Rotate the deque *n* steps to the right. If *n* is negative, rotate to
381 the left. Rotating one step to the right is equivalent to:
382 ``d.appendleft(d.pop())``.
383
Georg Brandl8ec7f652007-08-15 14:28:01 +0000384
385In addition to the above, deques support iteration, pickling, ``len(d)``,
386``reversed(d)``, ``copy.copy(d)``, ``copy.deepcopy(d)``, membership testing with
Benjamin Peterson5c4e0062008-10-16 18:52:14 +0000387the :keyword:`in` operator, and subscript references such as ``d[-1]``. Indexed
388access is O(1) at both ends but slows to O(n) in the middle. For fast random
389access, use lists instead.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000390
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000391Example:
392
393.. doctest::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000394
395 >>> from collections import deque
396 >>> d = deque('ghi') # make a new deque with three items
397 >>> for elem in d: # iterate over the deque's elements
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000398 ... print elem.upper()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000399 G
400 H
401 I
402
403 >>> d.append('j') # add a new entry to the right side
404 >>> d.appendleft('f') # add a new entry to the left side
405 >>> d # show the representation of the deque
406 deque(['f', 'g', 'h', 'i', 'j'])
407
408 >>> d.pop() # return and remove the rightmost item
409 'j'
410 >>> d.popleft() # return and remove the leftmost item
411 'f'
412 >>> list(d) # list the contents of the deque
413 ['g', 'h', 'i']
414 >>> d[0] # peek at leftmost item
415 'g'
416 >>> d[-1] # peek at rightmost item
417 'i'
418
419 >>> list(reversed(d)) # list the contents of a deque in reverse
420 ['i', 'h', 'g']
421 >>> 'h' in d # search the deque
422 True
423 >>> d.extend('jkl') # add multiple elements at once
424 >>> d
425 deque(['g', 'h', 'i', 'j', 'k', 'l'])
426 >>> d.rotate(1) # right rotation
427 >>> d
428 deque(['l', 'g', 'h', 'i', 'j', 'k'])
429 >>> d.rotate(-1) # left rotation
430 >>> d
431 deque(['g', 'h', 'i', 'j', 'k', 'l'])
432
433 >>> deque(reversed(d)) # make a new deque in reverse order
434 deque(['l', 'k', 'j', 'i', 'h', 'g'])
435 >>> d.clear() # empty the deque
436 >>> d.pop() # cannot pop from an empty deque
437 Traceback (most recent call last):
438 File "<pyshell#6>", line 1, in -toplevel-
439 d.pop()
440 IndexError: pop from an empty deque
441
442 >>> d.extendleft('abc') # extendleft() reverses the input order
443 >>> d
444 deque(['c', 'b', 'a'])
445
446
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000447:class:`deque` Recipes
448^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000449
450This section shows various approaches to working with deques.
451
452The :meth:`rotate` method provides a way to implement :class:`deque` slicing and
453deletion. For example, a pure python implementation of ``del d[n]`` relies on
454the :meth:`rotate` method to position elements to be popped::
455
456 def delete_nth(d, n):
457 d.rotate(-n)
458 d.popleft()
459 d.rotate(n)
460
461To implement :class:`deque` slicing, use a similar approach applying
462:meth:`rotate` to bring a target element to the left side of the deque. Remove
463old entries with :meth:`popleft`, add new entries with :meth:`extend`, and then
464reverse the rotation.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000465With minor variations on that approach, it is easy to implement Forth style
466stack manipulations such as ``dup``, ``drop``, ``swap``, ``over``, ``pick``,
467``rot``, and ``roll``.
468
Georg Brandl8ec7f652007-08-15 14:28:01 +0000469Multi-pass data reduction algorithms can be succinctly expressed and efficiently
470coded by extracting elements with multiple calls to :meth:`popleft`, applying
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000471a reduction function, and calling :meth:`append` to add the result back to the
472deque.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000473
474For example, building a balanced binary tree of nested lists entails reducing
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000475two adjacent nodes into one by grouping them in a list:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000476
477 >>> def maketree(iterable):
478 ... d = deque(iterable)
479 ... while len(d) > 1:
480 ... pair = [d.popleft(), d.popleft()]
481 ... d.append(pair)
482 ... return list(d)
483 ...
484 >>> print maketree('abcdefgh')
485 [[[['a', 'b'], ['c', 'd']], [['e', 'f'], ['g', 'h']]]]
486
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000487Bounded length deques provide functionality similar to the ``tail`` filter
488in Unix::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000489
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000490 def tail(filename, n=10):
491 'Return the last n lines of a file'
492 return deque(open(filename), n)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000493
Georg Brandl8ec7f652007-08-15 14:28:01 +0000494
495:class:`defaultdict` objects
496----------------------------
497
Georg Brandl8ec7f652007-08-15 14:28:01 +0000498.. class:: defaultdict([default_factory[, ...]])
499
500 Returns a new dictionary-like object. :class:`defaultdict` is a subclass of the
501 builtin :class:`dict` class. It overrides one method and adds one writable
502 instance variable. The remaining functionality is the same as for the
503 :class:`dict` class and is not documented here.
504
505 The first argument provides the initial value for the :attr:`default_factory`
506 attribute; it defaults to ``None``. All remaining arguments are treated the same
507 as if they were passed to the :class:`dict` constructor, including keyword
508 arguments.
509
510 .. versionadded:: 2.5
511
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000512 :class:`defaultdict` objects support the following method in addition to the
513 standard :class:`dict` operations:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000514
515
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000516 .. method:: defaultdict.__missing__(key)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000517
Skip Montanarob40890d2008-09-17 11:50:36 +0000518 If the :attr:`default_factory` attribute is ``None``, this raises a
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000519 :exc:`KeyError` exception with the *key* as argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000520
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000521 If :attr:`default_factory` is not ``None``, it is called without arguments
522 to provide a default value for the given *key*, this value is inserted in
523 the dictionary for the *key*, and returned.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000524
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000525 If calling :attr:`default_factory` raises an exception this exception is
526 propagated unchanged.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000527
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000528 This method is called by the :meth:`__getitem__` method of the
529 :class:`dict` class when the requested key is not found; whatever it
530 returns or raises is then returned or raised by :meth:`__getitem__`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000531
532
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000533 :class:`defaultdict` objects support the following instance variable:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000534
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000535
536 .. attribute:: defaultdict.default_factory
537
538 This attribute is used by the :meth:`__missing__` method; it is
539 initialized from the first argument to the constructor, if present, or to
540 ``None``, if absent.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000541
542
Georg Brandl8ec7f652007-08-15 14:28:01 +0000543:class:`defaultdict` Examples
544^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
545
546Using :class:`list` as the :attr:`default_factory`, it is easy to group a
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000547sequence of key-value pairs into a dictionary of lists:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000548
549 >>> s = [('yellow', 1), ('blue', 2), ('yellow', 3), ('blue', 4), ('red', 1)]
550 >>> d = defaultdict(list)
551 >>> for k, v in s:
552 ... d[k].append(v)
553 ...
554 >>> d.items()
555 [('blue', [2, 4]), ('red', [1]), ('yellow', [1, 3])]
556
557When each key is encountered for the first time, it is not already in the
558mapping; so an entry is automatically created using the :attr:`default_factory`
559function which returns an empty :class:`list`. The :meth:`list.append`
560operation then attaches the value to the new list. When keys are encountered
561again, the look-up proceeds normally (returning the list for that key) and the
562:meth:`list.append` operation adds another value to the list. This technique is
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000563simpler and faster than an equivalent technique using :meth:`dict.setdefault`:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000564
565 >>> d = {}
566 >>> for k, v in s:
567 ... d.setdefault(k, []).append(v)
568 ...
569 >>> d.items()
570 [('blue', [2, 4]), ('red', [1]), ('yellow', [1, 3])]
571
572Setting the :attr:`default_factory` to :class:`int` makes the
573:class:`defaultdict` useful for counting (like a bag or multiset in other
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000574languages):
Georg Brandl8ec7f652007-08-15 14:28:01 +0000575
576 >>> s = 'mississippi'
577 >>> d = defaultdict(int)
578 >>> for k in s:
579 ... d[k] += 1
580 ...
581 >>> d.items()
582 [('i', 4), ('p', 2), ('s', 4), ('m', 1)]
583
584When a letter is first encountered, it is missing from the mapping, so the
585:attr:`default_factory` function calls :func:`int` to supply a default count of
586zero. The increment operation then builds up the count for each letter.
587
588The function :func:`int` which always returns zero is just a special case of
589constant functions. A faster and more flexible way to create constant functions
590is to use :func:`itertools.repeat` which can supply any constant value (not just
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000591zero):
Georg Brandl8ec7f652007-08-15 14:28:01 +0000592
593 >>> def constant_factory(value):
594 ... return itertools.repeat(value).next
595 >>> d = defaultdict(constant_factory('<missing>'))
596 >>> d.update(name='John', action='ran')
597 >>> '%(name)s %(action)s to %(object)s' % d
598 'John ran to <missing>'
599
600Setting the :attr:`default_factory` to :class:`set` makes the
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000601:class:`defaultdict` useful for building a dictionary of sets:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000602
603 >>> s = [('red', 1), ('blue', 2), ('red', 3), ('blue', 4), ('red', 1), ('blue', 4)]
604 >>> d = defaultdict(set)
605 >>> for k, v in s:
606 ... d[k].add(v)
607 ...
608 >>> d.items()
609 [('blue', set([2, 4])), ('red', set([1, 3]))]
610
611
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000612:func:`namedtuple` Factory Function for Tuples with Named Fields
Georg Brandlb3255ed2008-01-07 16:43:47 +0000613----------------------------------------------------------------
Georg Brandl8ec7f652007-08-15 14:28:01 +0000614
Raymond Hettingercbab5942007-09-18 22:18:02 +0000615Named tuples assign meaning to each position in a tuple and allow for more readable,
616self-documenting code. They can be used wherever regular tuples are used, and
617they add the ability to access fields by name instead of position index.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000618
Raymond Hettinger322daea2009-02-10 01:24:05 +0000619.. function:: namedtuple(typename, field_names, [verbose], [rename])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000620
621 Returns a new tuple subclass named *typename*. The new subclass is used to
Georg Brandl907a7202008-02-22 12:31:45 +0000622 create tuple-like objects that have fields accessible by attribute lookup as
Georg Brandl8ec7f652007-08-15 14:28:01 +0000623 well as being indexable and iterable. Instances of the subclass also have a
Georg Brandl061d2e22008-11-23 19:17:25 +0000624 helpful docstring (with typename and field_names) and a helpful :meth:`__repr__`
Georg Brandl8ec7f652007-08-15 14:28:01 +0000625 method which lists the tuple contents in a ``name=value`` format.
626
Georg Brandl061d2e22008-11-23 19:17:25 +0000627 The *field_names* are a single string with each fieldname separated by whitespace
628 and/or commas, for example ``'x y'`` or ``'x, y'``. Alternatively, *field_names*
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000629 can be a sequence of strings such as ``['x', 'y']``.
Raymond Hettingerabfd8df2007-10-16 21:28:32 +0000630
631 Any valid Python identifier may be used for a fieldname except for names
Raymond Hettinger42da8742007-12-14 02:49:47 +0000632 starting with an underscore. Valid identifiers consist of letters, digits,
633 and underscores but do not start with a digit or underscore and cannot be
Raymond Hettingerabfd8df2007-10-16 21:28:32 +0000634 a :mod:`keyword` such as *class*, *for*, *return*, *global*, *pass*, *print*,
635 or *raise*.
Raymond Hettingercbab5942007-09-18 22:18:02 +0000636
Raymond Hettinger322daea2009-02-10 01:24:05 +0000637 If *rename* is true, invalid fieldnames are automatically replaced
638 with positional names. For example, ``['abc', 'def', 'ghi', 'abc']`` is
639 converted to ``['abc', '_2', 'ghi', '_4']``, eliminating the keyword
640 ``def`` and the duplicate fieldname ``abc``.
641
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000642 If *verbose* is true, the class definition is printed just before being built.
Raymond Hettingercbab5942007-09-18 22:18:02 +0000643
Raymond Hettingera48a2992007-10-08 21:26:58 +0000644 Named tuple instances do not have per-instance dictionaries, so they are
Raymond Hettinger7268e9d2007-09-20 03:03:43 +0000645 lightweight and require no more memory than regular tuples.
Raymond Hettingercbab5942007-09-18 22:18:02 +0000646
Georg Brandl8ec7f652007-08-15 14:28:01 +0000647 .. versionadded:: 2.6
648
Raymond Hettinger322daea2009-02-10 01:24:05 +0000649 .. versionchanged:: 2.7
650 added support for *rename*.
651
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000652Example:
653
654.. doctest::
655 :options: +NORMALIZE_WHITESPACE
Georg Brandl8ec7f652007-08-15 14:28:01 +0000656
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000657 >>> Point = namedtuple('Point', 'x y', verbose=True)
Raymond Hettingercbab5942007-09-18 22:18:02 +0000658 class Point(tuple):
659 'Point(x, y)'
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000660 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000661 __slots__ = ()
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000662 <BLANKLINE>
Raymond Hettingere0734e72008-01-04 03:22:53 +0000663 _fields = ('x', 'y')
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000664 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000665 def __new__(cls, x, y):
666 return tuple.__new__(cls, (x, y))
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000667 <BLANKLINE>
Raymond Hettinger02740f72008-01-05 01:35:43 +0000668 @classmethod
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000669 def _make(cls, iterable, new=tuple.__new__, len=len):
Raymond Hettinger02740f72008-01-05 01:35:43 +0000670 'Make a new Point object from a sequence or iterable'
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000671 result = new(cls, iterable)
Raymond Hettinger02740f72008-01-05 01:35:43 +0000672 if len(result) != 2:
673 raise TypeError('Expected 2 arguments, got %d' % len(result))
674 return result
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000675 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000676 def __repr__(self):
677 return 'Point(x=%r, y=%r)' % self
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000678 <BLANKLINE>
Raymond Hettinger88a91642009-03-03 04:51:24 +0000679 def _asdict(self):
680 'Return a new OrderedDict which maps field names to their values'
681 return OrderedDict(zip(self._fields, self))
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000682 <BLANKLINE>
Raymond Hettinger42da8742007-12-14 02:49:47 +0000683 def _replace(self, **kwds):
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000684 'Return a new Point object replacing specified fields with new values'
Raymond Hettinger11668722008-01-06 09:02:24 +0000685 result = self._make(map(kwds.pop, ('x', 'y'), self))
Raymond Hettinger1b50fd72008-01-05 02:17:24 +0000686 if kwds:
687 raise ValueError('Got unexpected field names: %r' % kwds.keys())
688 return result
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000689 <BLANKLINE>
690 def __getnewargs__(self):
Raymond Hettingeree51cff2008-06-27 21:34:24 +0000691 return tuple(self)
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000692 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000693 x = property(itemgetter(0))
694 y = property(itemgetter(1))
Georg Brandl8ec7f652007-08-15 14:28:01 +0000695
Raymond Hettingercbab5942007-09-18 22:18:02 +0000696 >>> p = Point(11, y=22) # instantiate with positional or keyword arguments
Raymond Hettinger88880b22007-12-18 00:13:45 +0000697 >>> p[0] + p[1] # indexable like the plain tuple (11, 22)
Raymond Hettingercbab5942007-09-18 22:18:02 +0000698 33
699 >>> x, y = p # unpack like a regular tuple
700 >>> x, y
701 (11, 22)
Georg Brandl907a7202008-02-22 12:31:45 +0000702 >>> p.x + p.y # fields also accessible by name
Raymond Hettingercbab5942007-09-18 22:18:02 +0000703 33
704 >>> p # readable __repr__ with a name=value style
705 Point(x=11, y=22)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000706
Raymond Hettingercbab5942007-09-18 22:18:02 +0000707Named tuples are especially useful for assigning field names to result tuples returned
708by the :mod:`csv` or :mod:`sqlite3` modules::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000709
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000710 EmployeeRecord = namedtuple('EmployeeRecord', 'name, age, title, department, paygrade')
Raymond Hettingera48a2992007-10-08 21:26:58 +0000711
Raymond Hettingercbab5942007-09-18 22:18:02 +0000712 import csv
Raymond Hettinger02740f72008-01-05 01:35:43 +0000713 for emp in map(EmployeeRecord._make, csv.reader(open("employees.csv", "rb"))):
Raymond Hettingercbab5942007-09-18 22:18:02 +0000714 print emp.name, emp.title
Georg Brandl8ec7f652007-08-15 14:28:01 +0000715
Raymond Hettingera48a2992007-10-08 21:26:58 +0000716 import sqlite3
717 conn = sqlite3.connect('/companydata')
718 cursor = conn.cursor()
719 cursor.execute('SELECT name, age, title, department, paygrade FROM employees')
Raymond Hettinger02740f72008-01-05 01:35:43 +0000720 for emp in map(EmployeeRecord._make, cursor.fetchall()):
Raymond Hettingera48a2992007-10-08 21:26:58 +0000721 print emp.name, emp.title
722
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000723In addition to the methods inherited from tuples, named tuples support
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000724three additional methods and one attribute. To prevent conflicts with
725field names, the method and attribute names start with an underscore.
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000726
Georg Brandlb3255ed2008-01-07 16:43:47 +0000727.. method:: somenamedtuple._make(iterable)
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000728
Raymond Hettinger02740f72008-01-05 01:35:43 +0000729 Class method that makes a new instance from an existing sequence or iterable.
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000730
Raymond Hettinger2950bca2009-01-14 01:39:51 +0000731 .. doctest::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000732
Raymond Hettinger02740f72008-01-05 01:35:43 +0000733 >>> t = [11, 22]
734 >>> Point._make(t)
735 Point(x=11, y=22)
Raymond Hettinger2b03d452007-09-18 03:33:19 +0000736
Georg Brandlb3255ed2008-01-07 16:43:47 +0000737.. method:: somenamedtuple._asdict()
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000738
Raymond Hettinger88a91642009-03-03 04:51:24 +0000739 Return a new :class:`OrderedDict` which maps field names to their corresponding
740 values::
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000741
Raymond Hettinger42da8742007-12-14 02:49:47 +0000742 >>> p._asdict()
Raymond Hettinger88a91642009-03-03 04:51:24 +0000743 OrderedDict([('x', 11), ('y', 22)])
744
745 .. versionchanged 3.1
746 Returns an :class:`OrderedDict` instead of a regular :class:`dict`.
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000747
Georg Brandlb3255ed2008-01-07 16:43:47 +0000748.. method:: somenamedtuple._replace(kwargs)
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000749
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000750 Return a new instance of the named tuple replacing specified fields with new
Raymond Hettinger2950bca2009-01-14 01:39:51 +0000751 values::
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000752
Raymond Hettingercbab5942007-09-18 22:18:02 +0000753 >>> p = Point(x=11, y=22)
Raymond Hettinger42da8742007-12-14 02:49:47 +0000754 >>> p._replace(x=33)
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000755 Point(x=33, y=22)
756
Raymond Hettinger7c3738e2007-11-15 03:16:09 +0000757 >>> for partnum, record in inventory.items():
Raymond Hettingere11230e2008-01-09 03:02:23 +0000758 ... inventory[partnum] = record._replace(price=newprices[partnum], timestamp=time.now())
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000759
Georg Brandlb3255ed2008-01-07 16:43:47 +0000760.. attribute:: somenamedtuple._fields
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000761
Raymond Hettingerf6b769b2008-01-07 21:33:51 +0000762 Tuple of strings listing the field names. Useful for introspection
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000763 and for creating new named tuple types from existing named tuples.
Raymond Hettinger7268e9d2007-09-20 03:03:43 +0000764
Raymond Hettinger2950bca2009-01-14 01:39:51 +0000765 .. doctest::
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000766
Raymond Hettinger42da8742007-12-14 02:49:47 +0000767 >>> p._fields # view the field names
Raymond Hettingercbab5942007-09-18 22:18:02 +0000768 ('x', 'y')
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000769
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000770 >>> Color = namedtuple('Color', 'red green blue')
Raymond Hettinger42da8742007-12-14 02:49:47 +0000771 >>> Pixel = namedtuple('Pixel', Point._fields + Color._fields)
Raymond Hettingercbab5942007-09-18 22:18:02 +0000772 >>> Pixel(11, 22, 128, 255, 0)
Raymond Hettingerdc1854d2008-01-09 03:13:20 +0000773 Pixel(x=11, y=22, red=128, green=255, blue=0)
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000774
Raymond Hettingere846f382007-12-14 21:51:50 +0000775To retrieve a field whose name is stored in a string, use the :func:`getattr`
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000776function:
Raymond Hettingere846f382007-12-14 21:51:50 +0000777
778 >>> getattr(p, 'x')
779 11
780
Raymond Hettingere4ae63c2009-02-11 00:06:17 +0000781To convert a dictionary to a named tuple, use the double-star-operator
782(as described in :ref:`tut-unpacking-arguments`):
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000783
784 >>> d = {'x': 11, 'y': 22}
785 >>> Point(**d)
786 Point(x=11, y=22)
787
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000788Since a named tuple is a regular Python class, it is easy to add or change
Raymond Hettingerb8e00722008-01-07 04:24:49 +0000789functionality with a subclass. Here is how to add a calculated field and
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000790a fixed-width print format:
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000791
Raymond Hettingerb8e00722008-01-07 04:24:49 +0000792 >>> class Point(namedtuple('Point', 'x y')):
Raymond Hettingere1655082008-01-10 19:15:10 +0000793 ... __slots__ = ()
Raymond Hettingere11230e2008-01-09 03:02:23 +0000794 ... @property
795 ... def hypot(self):
796 ... return (self.x ** 2 + self.y ** 2) ** 0.5
797 ... def __str__(self):
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000798 ... return 'Point: x=%6.3f y=%6.3f hypot=%6.3f' % (self.x, self.y, self.hypot)
Raymond Hettingerb8e00722008-01-07 04:24:49 +0000799
Raymond Hettingere1655082008-01-10 19:15:10 +0000800 >>> for p in Point(3, 4), Point(14, 5/7.):
Raymond Hettingere11230e2008-01-09 03:02:23 +0000801 ... print p
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000802 Point: x= 3.000 y= 4.000 hypot= 5.000
803 Point: x=14.000 y= 0.714 hypot=14.018
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000804
Raymond Hettinger9bba7b72008-01-27 10:47:55 +0000805The subclass shown above sets ``__slots__`` to an empty tuple. This keeps
Raymond Hettinger171f3912008-01-16 23:38:16 +0000806keep memory requirements low by preventing the creation of instance dictionaries.
Raymond Hettingerf59e9622008-01-15 20:52:42 +0000807
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000808Subclassing is not useful for adding new, stored fields. Instead, simply
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000809create a new named tuple type from the :attr:`_fields` attribute:
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000810
Raymond Hettingere850c462008-01-10 20:37:12 +0000811 >>> Point3D = namedtuple('Point3D', Point._fields + ('z',))
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000812
Raymond Hettingerfb3ced62008-01-07 20:17:35 +0000813Default values can be implemented by using :meth:`_replace` to
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000814customize a prototype instance:
Raymond Hettingerbc693492007-11-15 22:39:34 +0000815
816 >>> Account = namedtuple('Account', 'owner balance transaction_count')
Raymond Hettinger0fe6ca42008-01-18 21:14:58 +0000817 >>> default_account = Account('<owner name>', 0.0, 0)
818 >>> johns_account = default_account._replace(owner='John')
Raymond Hettingerbc693492007-11-15 22:39:34 +0000819
Raymond Hettinger5a9fed72008-05-08 07:23:30 +0000820Enumerated constants can be implemented with named tuples, but it is simpler
821and more efficient to use a simple class declaration:
822
823 >>> Status = namedtuple('Status', 'open pending closed')._make(range(3))
824 >>> Status.open, Status.pending, Status.closed
825 (0, 1, 2)
826 >>> class Status:
827 ... open, pending, closed = range(3)
828
Raymond Hettingere4ae63c2009-02-11 00:06:17 +0000829.. seealso::
Mark Summerfield7f626f42007-08-30 15:03:03 +0000830
Raymond Hettingere4ae63c2009-02-11 00:06:17 +0000831 `Named tuple recipe <http://code.activestate.com/recipes/500261/>`_
832 adapted for Python 2.4.
Raymond Hettingerbc512d32009-03-03 04:45:34 +0000833
834
835:class:`OrderedDict` objects
836----------------------------
837
838Ordered dictionaries are just like regular dictionaries but they remember the
839order that items were inserted. When iterating over an ordered dictionary,
840the items are returned in the order their keys were first added.
841
842.. class:: OrderedDict([items])
843
844 Return an instance of a dict subclass, supporting the usual :class:`dict`
845 methods. An *OrderedDict* is a dict that remembers the order that keys
846 were first inserted. If a new entry overwrites an existing entry, the
847 original insertion position is left unchanged. Deleting an entry and
848 reinserting it will move it to the end.
849
850 .. versionadded:: 2.7
851
852The :meth:`popitem` method for ordered dictionaries returns and removes the
853last added entry. The key/value pairs are returned in LIFO order.
854
855Equality tests between :class:`OrderedDict` objects are order-sensitive
856and are implemented as ``list(od1.items())==list(od2.items())``.
857Equality tests between :class:`OrderedDict` objects and other
858:class:`Mapping` objects are order-insensitive like regular dictionaries.
859This allows :class:`OrderedDict` objects to be substituted anywhere a
860regular dictionary is used.