blob: 2f7785e81dbaafe1f8cdc55ca302d55e0d3753ef [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001
2:mod:`collections` --- High-performance container datatypes
3===========================================================
4
5.. module:: collections
6 :synopsis: High-performance datatypes
7.. moduleauthor:: Raymond Hettinger <python@rcn.com>
8.. sectionauthor:: Raymond Hettinger <python@rcn.com>
9
Georg Brandl8ec7f652007-08-15 14:28:01 +000010.. versionadded:: 2.4
11
Georg Brandl4c8bbe62008-03-22 21:06:20 +000012.. testsetup:: *
13
14 from collections import *
15 import itertools
16 __name__ = '<doctest>'
17
Georg Brandl8ec7f652007-08-15 14:28:01 +000018This module implements high-performance container datatypes. Currently,
Raymond Hettingerf746a1f2009-02-17 08:33:01 +000019there are three datatypes, :class:`Counter`, :class:`deque` and
20:class:`defaultdict`, and one datatype factory function, :func:`namedtuple`.
Georg Brandl8ec7f652007-08-15 14:28:01 +000021
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000022The specialized containers provided in this module provide alternatives
Georg Brandl4c8bbe62008-03-22 21:06:20 +000023to Python's general purpose built-in containers, :class:`dict`,
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000024:class:`list`, :class:`set`, and :class:`tuple`.
25
Raymond Hettingerf746a1f2009-02-17 08:33:01 +000026.. versionchanged:: 2.4
27 Added :class:`deque`.
28
29.. versionchanged:: 2.5
30 Added :class:`defaultdict`.
31
32.. versionchanged:: 2.6
33 Added :func:`namedtuple` and added abstract base classes.
34
35.. versionchanged:: 2.7
36 Added :class:`Counter`.
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000037
38In addition to containers, the collections module provides some ABCs
Georg Brandl4c8bbe62008-03-22 21:06:20 +000039(abstract base classes) that can be used to test whether a class
Raymond Hettingerf746a1f2009-02-17 08:33:01 +000040provides a particular interface, for example, whether it is hashable or
Georg Brandl4c8bbe62008-03-22 21:06:20 +000041a mapping.
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000042
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000043
44ABCs - abstract base classes
45----------------------------
46
47The collections module offers the following ABCs:
48
Georg Brandldbc59872008-07-08 07:05:23 +000049========================= ===================== ====================== ====================================================
50ABC Inherits Abstract Methods Mixin Methods
51========================= ===================== ====================== ====================================================
52:class:`Container` ``__contains__``
53:class:`Hashable` ``__hash__``
54:class:`Iterable` ``__iter__``
55:class:`Iterator` :class:`Iterable` ``__next__`` ``__iter__``
Georg Brandl7044b112009-01-03 21:04:55 +000056:class:`Sized` ``__len__``
Georg Brandldbc59872008-07-08 07:05:23 +000057:class:`Callable` ``__call__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000058
Georg Brandldbc59872008-07-08 07:05:23 +000059:class:`Sequence` :class:`Sized`, ``__getitem__`` ``__contains__``. ``__iter__``, ``__reversed__``.
Raymond Hettinger1712baa2009-01-28 23:58:16 +000060 :class:`Iterable`, ``index``, and ``count``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000061 :class:`Container`
62
Raymond Hettinger1712baa2009-01-28 23:58:16 +000063:class:`MutableSequence` :class:`Sequence` ``__setitem__`` Inherited Sequence methods and
Georg Brandldbc59872008-07-08 07:05:23 +000064 ``__delitem__``, ``append``, ``reverse``, ``extend``, ``pop``,
Raymond Hettinger1712baa2009-01-28 23:58:16 +000065 and ``insert`` ``remove``, and ``__iadd__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000066
Raymond Hettinger1712baa2009-01-28 23:58:16 +000067:class:`Set` :class:`Sized`, ``__le__``, ``__lt__``, ``__eq__``, ``__ne__``,
68 :class:`Iterable`, ``__gt__``, ``__ge__``, ``__and__``, ``__or__``
69 :class:`Container` ``__sub__``, ``__xor__``, and ``isdisjoint``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000070
Georg Brandldbc59872008-07-08 07:05:23 +000071:class:`MutableSet` :class:`Set` ``add`` and Inherited Set methods and
72 ``discard`` ``clear``, ``pop``, ``remove``, ``__ior__``,
73 ``__iand__``, ``__ixor__``, and ``__isub__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000074
Raymond Hettinger1712baa2009-01-28 23:58:16 +000075:class:`Mapping` :class:`Sized`, ``__getitem__`` ``__contains__``, ``keys``, ``items``, ``values``,
76 :class:`Iterable`, ``get``, ``__eq__``, and ``__ne__``
77 :class:`Container`
Georg Brandlc62ef8b2009-01-03 20:55:06 +000078
Raymond Hettinger1712baa2009-01-28 23:58:16 +000079:class:`MutableMapping` :class:`Mapping` ``__setitem__`` and Inherited Mapping methods and
80 ``__delitem__`` ``pop``, ``popitem``, ``clear``, ``update``,
81 and ``setdefault``
82
Georg Brandlc62ef8b2009-01-03 20:55:06 +000083
Georg Brandldbc59872008-07-08 07:05:23 +000084:class:`MappingView` :class:`Sized` ``__len__``
85:class:`KeysView` :class:`MappingView`, ``__contains__``,
86 :class:`Set` ``__iter__``
87:class:`ItemsView` :class:`MappingView`, ``__contains__``,
88 :class:`Set` ``__iter__``
89:class:`ValuesView` :class:`MappingView` ``__contains__``, ``__iter__``
90========================= ===================== ====================== ====================================================
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000091
92These ABCs allow us to ask classes or instances if they provide
93particular functionality, for example::
94
95 size = None
96 if isinstance(myvar, collections.Sized):
Georg Brandl7044b112009-01-03 21:04:55 +000097 size = len(myvar)
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000098
99Several of the ABCs are also useful as mixins that make it easier to develop
100classes supporting container APIs. For example, to write a class supporting
101the full :class:`Set` API, it only necessary to supply the three underlying
102abstract methods: :meth:`__contains__`, :meth:`__iter__`, and :meth:`__len__`.
103The ABC supplies the remaining methods such as :meth:`__and__` and
104:meth:`isdisjoint` ::
105
106 class ListBasedSet(collections.Set):
107 ''' Alternate set implementation favoring space over speed
108 and not requiring the set elements to be hashable. '''
109 def __init__(self, iterable):
110 self.elements = lst = []
111 for value in iterable:
112 if value not in lst:
113 lst.append(value)
114 def __iter__(self):
115 return iter(self.elements)
116 def __contains__(self, value):
117 return value in self.elements
118 def __len__(self):
119 return len(self.elements)
120
121 s1 = ListBasedSet('abcdef')
122 s2 = ListBasedSet('defghi')
123 overlap = s1 & s2 # The __and__() method is supported automatically
124
125Notes on using :class:`Set` and :class:`MutableSet` as a mixin:
126
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000127(1)
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000128 Since some set operations create new sets, the default mixin methods need
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000129 a way to create new instances from an iterable. The class constructor is
130 assumed to have a signature in the form ``ClassName(iterable)``.
Raymond Hettinger96b42402008-05-23 17:34:34 +0000131 That assumption is factored-out to an internal classmethod called
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000132 :meth:`_from_iterable` which calls ``cls(iterable)`` to produce a new set.
133 If the :class:`Set` mixin is being used in a class with a different
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000134 constructor signature, you will need to override :meth:`from_iterable`
135 with a classmethod that can construct new instances from
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000136 an iterable argument.
137
138(2)
139 To override the comparisons (presumably for speed, as the
140 semantics are fixed), redefine :meth:`__le__` and
141 then the other operations will automatically follow suit.
142
143(3)
144 The :class:`Set` mixin provides a :meth:`_hash` method to compute a hash value
145 for the set; however, :meth:`__hash__` is not defined because not all sets
146 are hashable or immutable. To add set hashabilty using mixins,
147 inherit from both :meth:`Set` and :meth:`Hashable`, then define
148 ``__hash__ = Set._hash``.
149
150(For more about ABCs, see the :mod:`abc` module and :pep:`3119`.)
151
152
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000153:class:`Counter` objects
154------------------------
155
156A counter tool is provided to support convenient and rapid tallies.
157For example::
158
Raymond Hettinger939a3cc2009-02-04 11:31:30 +0000159 >>> # Tally occurrences of words in a list
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000160 >>> cnt = Counter()
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000161 >>> for word in ['red', 'blue', 'red', 'green', 'blue', 'blue']:
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000162 ... cnt[word] += 1
163 >>> cnt
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000164 Counter({'blue': 3, 'red': 2, 'green': 1})
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000165
Raymond Hettinger939a3cc2009-02-04 11:31:30 +0000166 >>> # Find the ten most common words in Hamlet
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000167 >>> import re
168 >>> words = re.findall('\w+', open('hamlet.txt').read().lower())
Raymond Hettinger196a0f72009-01-20 12:59:36 +0000169 >>> Counter(words).most_common(10)
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000170 [('the', 1143), ('and', 966), ('to', 762), ('of', 669), ('i', 631),
171 ('you', 554), ('a', 546), ('my', 514), ('hamlet', 471), ('in', 451)]
172
Raymond Hettinger82783852009-01-13 03:49:43 +0000173.. class:: Counter([iterable-or-mapping])
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000174
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000175 A :class:`Counter` is a :class:`dict` subclass for counting hashable objects.
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000176 It is an unordered collection where elements are stored as dictionary keys
177 and their counts are stored as dictionary values. Counts are allowed to be
178 any integer value including zero or negative counts. The :class:`Counter`
179 class is similar to bags or multisets in other languages.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000180
Raymond Hettinger82783852009-01-13 03:49:43 +0000181 Elements are counted from an *iterable* or initialized from another
182 *mapping* (or counter)::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000183
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000184 >>> c = Counter() # a new, empty counter
185 >>> c = Counter('gallahad') # a new counter from an iterable
186 >>> c = Counter({'red': 4, 'blue': 2}) # a new counter from a mapping
187 >>> c = Counter(cats=4, dogs=8) # a new counter from keyword args
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000188
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000189 Counter objects have a dictionary interface except that they return a zero
190 count for missing items instead of raising a :exc:`KeyError`::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000191
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000192 >>> c = Counter(['eggs', 'ham'])
Raymond Hettinger59894122009-01-14 00:15:21 +0000193 >>> c['bacon'] # count of a missing element is zero
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000194 0
195
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000196 Setting a count to zero does not remove an element from a counter.
197 Use ``del`` to remove it entirely:
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000198
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000199 >>> c['sausage'] = 0 # counter entry with a zero count
200 >>> del c['sausage'] # del actually removes the entry
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000201
202 .. versionadded:: 2.7
203
204
205 Counter objects support two methods beyond those available for all
206 dictionaries:
207
208 .. method:: elements()
209
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000210 Return an iterator over elements repeating each as many times as its
211 count. Elements are returned in arbitrary order. If an element's count
212 is less than one, :meth:`elements` will ignore it.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000213
Raymond Hettinger196a0f72009-01-20 12:59:36 +0000214 >>> c = Counter(a=4, b=2, c=0, d=-2)
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000215 >>> list(c.elements())
216 ['a', 'a', 'a', 'a', 'b', 'b']
217
218 .. method:: most_common([n])
219
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000220 Return a list of the *n* most common elements and their counts from the
Raymond Hettingerd507afd2009-02-04 10:52:32 +0000221 most common to the least. If *n* is not specified, :func:`most_common`
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000222 returns *all* elements in the counter. Elements with equal counts are
223 ordered arbitrarily::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000224
225 >>> Counter('abracadabra').most_common(3)
226 [('a', 5), ('r', 2), ('b', 2)]
227
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000228 The usual dictionary methods are available for :class:`Counter` objects
229 except for two which work differently for counters.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000230
231 .. method:: fromkeys(iterable)
232
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000233 This class method is not implemented for :class:`Counter` objects.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000234
Raymond Hettinger82783852009-01-13 03:49:43 +0000235 .. method:: update([iterable-or-mapping])
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000236
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000237 Elements are counted from an *iterable* or added-in from another
238 *mapping* (or counter). Like :meth:`dict.update` but adds counts
239 instead of replacing them. Also, the *iterable* is expected to be a
240 sequence of elements, not a sequence of ``(key, value)`` pairs.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000241
Raymond Hettingerfbcf7492009-01-13 08:38:14 +0000242Common patterns for working with :class:`Counter` objects::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000243
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000244 sum(c.values()) # total of all counts
245 c.clear() # reset all counts
246 list(c) # list unique elements
247 set(c) # convert to a set
248 dict(c) # convert to a regular dictionary
249 c.items() # convert to a list of (elem, cnt) pairs
250 Counter(dict(list_of_pairs)) # convert from a list of (elem, cnt) pairs
251 c.most_common()[:-n:-1] # n least common elements
252 c += Counter() # remove zero and negative counts
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000253
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000254Several multiset mathematical operations are provided for combining
Raymond Hettingereb7cbb92009-02-25 00:39:47 +0000255:class:`Counter` objects. Multisets are counters with the restriction
256that all counts are at least one. They are like regular sets but are
257allowed to contain repeated elements. Addition and subtraction combine
258counters by adding or subtracting the counts of corresponding elements.
259Intersection and union return the minimum and maximum of corresponding
260counts. Each operation can accept inputs with signed counts,
Raymond Hettinger939a3cc2009-02-04 11:31:30 +0000261but the output excludes results with counts less than one.
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000262
Raymond Hettinger4571f342009-01-21 20:31:50 +0000263 >>> c = Counter(a=3, b=1)
264 >>> d = Counter(a=1, b=2)
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000265 >>> c + d # add two counters together: c[x] + d[x]
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000266 Counter({'a': 4, 'b': 3})
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000267 >>> c - d # subtract (keeping only positive counts)
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000268 Counter({'a': 2})
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000269 >>> c & d # intersection: min(c[x], d[x])
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000270 Counter({'a': 1, 'b': 1})
Raymond Hettinger22bfa9e2009-01-27 02:36:33 +0000271 >>> c | d # union: max(c[x], d[x])
Raymond Hettingerbad1eb22009-01-20 01:19:26 +0000272 Counter({'a': 3, 'b': 2})
273
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000274.. seealso::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000275
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000276 * `Counter class <http://code.activestate.com/recipes/576611/>`_
277 adapted for Python 2.5 and an early `Bag recipe
278 <http://code.activestate.com/recipes/259174/>`_ for Python 2.4.
279
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000280 * `Bag class <http://www.gnu.org/software/smalltalk/manual-base/html_node/Bag.html>`_
281 in Smalltalk.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000282
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000283 * Wikipedia entry for `Multisets <http://en.wikipedia.org/wiki/Multiset>`_\.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000284
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000285 * `C++ multisets <http://www.demo2s.com/Tutorial/Cpp/0380__set-multiset/Catalog0380__set-multiset.htm>`_
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000286 tutorial with examples.
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000287
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000288 * For mathematical operations on multisets and their use cases, see
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000289 *Knuth, Donald. The Art of Computer Programming Volume II,
290 Section 4.6.3, Exercise 19*\.
291
Raymond Hettinger0a1f7b82009-01-21 23:12:51 +0000292 * To enumerate all distinct multisets of a given size over a given set of
Raymond Hettingerd081abc2009-01-27 02:58:49 +0000293 elements, see :func:`itertools.combinations_with_replacement`.
Raymond Hettingeracdc84a2009-01-20 23:42:54 +0000294
Raymond Hettinger7bdca052009-01-22 05:20:47 +0000295 map(Counter, combinations_with_replacement('ABC', 2)) --> AA AB AC BB BC CC
Raymond Hettingerfbcf7492009-01-13 08:38:14 +0000296
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000297
Georg Brandl8ec7f652007-08-15 14:28:01 +0000298:class:`deque` objects
299----------------------
300
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000301.. class:: deque([iterable[, maxlen]])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000302
303 Returns a new deque object initialized left-to-right (using :meth:`append`) with
304 data from *iterable*. If *iterable* is not specified, the new deque is empty.
305
306 Deques are a generalization of stacks and queues (the name is pronounced "deck"
307 and is short for "double-ended queue"). Deques support thread-safe, memory
308 efficient appends and pops from either side of the deque with approximately the
309 same O(1) performance in either direction.
310
311 Though :class:`list` objects support similar operations, they are optimized for
312 fast fixed-length operations and incur O(n) memory movement costs for
313 ``pop(0)`` and ``insert(0, v)`` operations which change both the size and
314 position of the underlying data representation.
315
316 .. versionadded:: 2.4
317
Raymond Hettinger68995862007-10-10 00:26:46 +0000318 If *maxlen* is not specified or is *None*, deques may grow to an
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000319 arbitrary length. Otherwise, the deque is bounded to the specified maximum
320 length. Once a bounded length deque is full, when new items are added, a
321 corresponding number of items are discarded from the opposite end. Bounded
322 length deques provide functionality similar to the ``tail`` filter in
323 Unix. They are also useful for tracking transactions and other pools of data
324 where only the most recent activity is of interest.
325
326 .. versionchanged:: 2.6
Georg Brandlb19be572007-12-29 10:57:00 +0000327 Added *maxlen* parameter.
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000328
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000329 Deque objects support the following methods:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000330
331
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000332 .. method:: append(x)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000333
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000334 Add *x* to the right side of the deque.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000335
336
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000337 .. method:: appendleft(x)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000338
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000339 Add *x* to the left side of the deque.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000340
341
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000342 .. method:: clear()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000343
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000344 Remove all elements from the deque leaving it with length 0.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000345
346
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000347 .. method:: extend(iterable)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000348
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000349 Extend the right side of the deque by appending elements from the iterable
350 argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000351
352
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000353 .. method:: extendleft(iterable)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000354
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000355 Extend the left side of the deque by appending elements from *iterable*.
356 Note, the series of left appends results in reversing the order of
357 elements in the iterable argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000358
359
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000360 .. method:: pop()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000361
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000362 Remove and return an element from the right side of the deque. If no
363 elements are present, raises an :exc:`IndexError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000364
365
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000366 .. method:: popleft()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000367
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000368 Remove and return an element from the left side of the deque. If no
369 elements are present, raises an :exc:`IndexError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000370
371
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000372 .. method:: remove(value)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000373
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000374 Removed the first occurrence of *value*. If not found, raises a
375 :exc:`ValueError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000376
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000377 .. versionadded:: 2.5
Georg Brandl8ec7f652007-08-15 14:28:01 +0000378
379
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000380 .. method:: rotate(n)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000381
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000382 Rotate the deque *n* steps to the right. If *n* is negative, rotate to
383 the left. Rotating one step to the right is equivalent to:
384 ``d.appendleft(d.pop())``.
385
Georg Brandl8ec7f652007-08-15 14:28:01 +0000386
387In addition to the above, deques support iteration, pickling, ``len(d)``,
388``reversed(d)``, ``copy.copy(d)``, ``copy.deepcopy(d)``, membership testing with
Benjamin Peterson5c4e0062008-10-16 18:52:14 +0000389the :keyword:`in` operator, and subscript references such as ``d[-1]``. Indexed
390access is O(1) at both ends but slows to O(n) in the middle. For fast random
391access, use lists instead.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000392
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000393Example:
394
395.. doctest::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000396
397 >>> from collections import deque
398 >>> d = deque('ghi') # make a new deque with three items
399 >>> for elem in d: # iterate over the deque's elements
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000400 ... print elem.upper()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000401 G
402 H
403 I
404
405 >>> d.append('j') # add a new entry to the right side
406 >>> d.appendleft('f') # add a new entry to the left side
407 >>> d # show the representation of the deque
408 deque(['f', 'g', 'h', 'i', 'j'])
409
410 >>> d.pop() # return and remove the rightmost item
411 'j'
412 >>> d.popleft() # return and remove the leftmost item
413 'f'
414 >>> list(d) # list the contents of the deque
415 ['g', 'h', 'i']
416 >>> d[0] # peek at leftmost item
417 'g'
418 >>> d[-1] # peek at rightmost item
419 'i'
420
421 >>> list(reversed(d)) # list the contents of a deque in reverse
422 ['i', 'h', 'g']
423 >>> 'h' in d # search the deque
424 True
425 >>> d.extend('jkl') # add multiple elements at once
426 >>> d
427 deque(['g', 'h', 'i', 'j', 'k', 'l'])
428 >>> d.rotate(1) # right rotation
429 >>> d
430 deque(['l', 'g', 'h', 'i', 'j', 'k'])
431 >>> d.rotate(-1) # left rotation
432 >>> d
433 deque(['g', 'h', 'i', 'j', 'k', 'l'])
434
435 >>> deque(reversed(d)) # make a new deque in reverse order
436 deque(['l', 'k', 'j', 'i', 'h', 'g'])
437 >>> d.clear() # empty the deque
438 >>> d.pop() # cannot pop from an empty deque
439 Traceback (most recent call last):
440 File "<pyshell#6>", line 1, in -toplevel-
441 d.pop()
442 IndexError: pop from an empty deque
443
444 >>> d.extendleft('abc') # extendleft() reverses the input order
445 >>> d
446 deque(['c', 'b', 'a'])
447
448
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000449:class:`deque` Recipes
450^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000451
452This section shows various approaches to working with deques.
453
454The :meth:`rotate` method provides a way to implement :class:`deque` slicing and
455deletion. For example, a pure python implementation of ``del d[n]`` relies on
456the :meth:`rotate` method to position elements to be popped::
457
458 def delete_nth(d, n):
459 d.rotate(-n)
460 d.popleft()
461 d.rotate(n)
462
463To implement :class:`deque` slicing, use a similar approach applying
464:meth:`rotate` to bring a target element to the left side of the deque. Remove
465old entries with :meth:`popleft`, add new entries with :meth:`extend`, and then
466reverse the rotation.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000467With minor variations on that approach, it is easy to implement Forth style
468stack manipulations such as ``dup``, ``drop``, ``swap``, ``over``, ``pick``,
469``rot``, and ``roll``.
470
Georg Brandl8ec7f652007-08-15 14:28:01 +0000471Multi-pass data reduction algorithms can be succinctly expressed and efficiently
472coded by extracting elements with multiple calls to :meth:`popleft`, applying
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000473a reduction function, and calling :meth:`append` to add the result back to the
474deque.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000475
476For example, building a balanced binary tree of nested lists entails reducing
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000477two adjacent nodes into one by grouping them in a list:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000478
479 >>> def maketree(iterable):
480 ... d = deque(iterable)
481 ... while len(d) > 1:
482 ... pair = [d.popleft(), d.popleft()]
483 ... d.append(pair)
484 ... return list(d)
485 ...
486 >>> print maketree('abcdefgh')
487 [[[['a', 'b'], ['c', 'd']], [['e', 'f'], ['g', 'h']]]]
488
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000489Bounded length deques provide functionality similar to the ``tail`` filter
490in Unix::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000491
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000492 def tail(filename, n=10):
493 'Return the last n lines of a file'
494 return deque(open(filename), n)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000495
Georg Brandl8ec7f652007-08-15 14:28:01 +0000496
497:class:`defaultdict` objects
498----------------------------
499
Georg Brandl8ec7f652007-08-15 14:28:01 +0000500.. class:: defaultdict([default_factory[, ...]])
501
502 Returns a new dictionary-like object. :class:`defaultdict` is a subclass of the
503 builtin :class:`dict` class. It overrides one method and adds one writable
504 instance variable. The remaining functionality is the same as for the
505 :class:`dict` class and is not documented here.
506
507 The first argument provides the initial value for the :attr:`default_factory`
508 attribute; it defaults to ``None``. All remaining arguments are treated the same
509 as if they were passed to the :class:`dict` constructor, including keyword
510 arguments.
511
512 .. versionadded:: 2.5
513
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000514 :class:`defaultdict` objects support the following method in addition to the
515 standard :class:`dict` operations:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000516
517
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000518 .. method:: defaultdict.__missing__(key)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000519
Skip Montanarob40890d2008-09-17 11:50:36 +0000520 If the :attr:`default_factory` attribute is ``None``, this raises a
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000521 :exc:`KeyError` exception with the *key* as argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000522
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000523 If :attr:`default_factory` is not ``None``, it is called without arguments
524 to provide a default value for the given *key*, this value is inserted in
525 the dictionary for the *key*, and returned.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000526
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000527 If calling :attr:`default_factory` raises an exception this exception is
528 propagated unchanged.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000529
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000530 This method is called by the :meth:`__getitem__` method of the
531 :class:`dict` class when the requested key is not found; whatever it
532 returns or raises is then returned or raised by :meth:`__getitem__`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000533
534
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000535 :class:`defaultdict` objects support the following instance variable:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000536
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000537
538 .. attribute:: defaultdict.default_factory
539
540 This attribute is used by the :meth:`__missing__` method; it is
541 initialized from the first argument to the constructor, if present, or to
542 ``None``, if absent.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000543
544
Georg Brandl8ec7f652007-08-15 14:28:01 +0000545:class:`defaultdict` Examples
546^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
547
548Using :class:`list` as the :attr:`default_factory`, it is easy to group a
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000549sequence of key-value pairs into a dictionary of lists:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000550
551 >>> s = [('yellow', 1), ('blue', 2), ('yellow', 3), ('blue', 4), ('red', 1)]
552 >>> d = defaultdict(list)
553 >>> for k, v in s:
554 ... d[k].append(v)
555 ...
556 >>> d.items()
557 [('blue', [2, 4]), ('red', [1]), ('yellow', [1, 3])]
558
559When each key is encountered for the first time, it is not already in the
560mapping; so an entry is automatically created using the :attr:`default_factory`
561function which returns an empty :class:`list`. The :meth:`list.append`
562operation then attaches the value to the new list. When keys are encountered
563again, the look-up proceeds normally (returning the list for that key) and the
564:meth:`list.append` operation adds another value to the list. This technique is
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000565simpler and faster than an equivalent technique using :meth:`dict.setdefault`:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000566
567 >>> d = {}
568 >>> for k, v in s:
569 ... d.setdefault(k, []).append(v)
570 ...
571 >>> d.items()
572 [('blue', [2, 4]), ('red', [1]), ('yellow', [1, 3])]
573
574Setting the :attr:`default_factory` to :class:`int` makes the
575:class:`defaultdict` useful for counting (like a bag or multiset in other
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000576languages):
Georg Brandl8ec7f652007-08-15 14:28:01 +0000577
578 >>> s = 'mississippi'
579 >>> d = defaultdict(int)
580 >>> for k in s:
581 ... d[k] += 1
582 ...
583 >>> d.items()
584 [('i', 4), ('p', 2), ('s', 4), ('m', 1)]
585
586When a letter is first encountered, it is missing from the mapping, so the
587:attr:`default_factory` function calls :func:`int` to supply a default count of
588zero. The increment operation then builds up the count for each letter.
589
590The function :func:`int` which always returns zero is just a special case of
591constant functions. A faster and more flexible way to create constant functions
592is to use :func:`itertools.repeat` which can supply any constant value (not just
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000593zero):
Georg Brandl8ec7f652007-08-15 14:28:01 +0000594
595 >>> def constant_factory(value):
596 ... return itertools.repeat(value).next
597 >>> d = defaultdict(constant_factory('<missing>'))
598 >>> d.update(name='John', action='ran')
599 >>> '%(name)s %(action)s to %(object)s' % d
600 'John ran to <missing>'
601
602Setting the :attr:`default_factory` to :class:`set` makes the
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000603:class:`defaultdict` useful for building a dictionary of sets:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000604
605 >>> s = [('red', 1), ('blue', 2), ('red', 3), ('blue', 4), ('red', 1), ('blue', 4)]
606 >>> d = defaultdict(set)
607 >>> for k, v in s:
608 ... d[k].add(v)
609 ...
610 >>> d.items()
611 [('blue', set([2, 4])), ('red', set([1, 3]))]
612
613
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000614:func:`namedtuple` Factory Function for Tuples with Named Fields
Georg Brandlb3255ed2008-01-07 16:43:47 +0000615----------------------------------------------------------------
Georg Brandl8ec7f652007-08-15 14:28:01 +0000616
Raymond Hettingercbab5942007-09-18 22:18:02 +0000617Named tuples assign meaning to each position in a tuple and allow for more readable,
618self-documenting code. They can be used wherever regular tuples are used, and
619they add the ability to access fields by name instead of position index.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000620
Raymond Hettinger322daea2009-02-10 01:24:05 +0000621.. function:: namedtuple(typename, field_names, [verbose], [rename])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000622
623 Returns a new tuple subclass named *typename*. The new subclass is used to
Georg Brandl907a7202008-02-22 12:31:45 +0000624 create tuple-like objects that have fields accessible by attribute lookup as
Georg Brandl8ec7f652007-08-15 14:28:01 +0000625 well as being indexable and iterable. Instances of the subclass also have a
Georg Brandl061d2e22008-11-23 19:17:25 +0000626 helpful docstring (with typename and field_names) and a helpful :meth:`__repr__`
Georg Brandl8ec7f652007-08-15 14:28:01 +0000627 method which lists the tuple contents in a ``name=value`` format.
628
Georg Brandl061d2e22008-11-23 19:17:25 +0000629 The *field_names* are a single string with each fieldname separated by whitespace
630 and/or commas, for example ``'x y'`` or ``'x, y'``. Alternatively, *field_names*
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000631 can be a sequence of strings such as ``['x', 'y']``.
Raymond Hettingerabfd8df2007-10-16 21:28:32 +0000632
633 Any valid Python identifier may be used for a fieldname except for names
Raymond Hettinger42da8742007-12-14 02:49:47 +0000634 starting with an underscore. Valid identifiers consist of letters, digits,
635 and underscores but do not start with a digit or underscore and cannot be
Raymond Hettingerabfd8df2007-10-16 21:28:32 +0000636 a :mod:`keyword` such as *class*, *for*, *return*, *global*, *pass*, *print*,
637 or *raise*.
Raymond Hettingercbab5942007-09-18 22:18:02 +0000638
Raymond Hettinger322daea2009-02-10 01:24:05 +0000639 If *rename* is true, invalid fieldnames are automatically replaced
640 with positional names. For example, ``['abc', 'def', 'ghi', 'abc']`` is
641 converted to ``['abc', '_2', 'ghi', '_4']``, eliminating the keyword
642 ``def`` and the duplicate fieldname ``abc``.
643
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000644 If *verbose* is true, the class definition is printed just before being built.
Raymond Hettingercbab5942007-09-18 22:18:02 +0000645
Raymond Hettingera48a2992007-10-08 21:26:58 +0000646 Named tuple instances do not have per-instance dictionaries, so they are
Raymond Hettinger7268e9d2007-09-20 03:03:43 +0000647 lightweight and require no more memory than regular tuples.
Raymond Hettingercbab5942007-09-18 22:18:02 +0000648
Georg Brandl8ec7f652007-08-15 14:28:01 +0000649 .. versionadded:: 2.6
650
Raymond Hettinger322daea2009-02-10 01:24:05 +0000651 .. versionchanged:: 2.7
652 added support for *rename*.
653
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000654Example:
655
656.. doctest::
657 :options: +NORMALIZE_WHITESPACE
Georg Brandl8ec7f652007-08-15 14:28:01 +0000658
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000659 >>> Point = namedtuple('Point', 'x y', verbose=True)
Raymond Hettingercbab5942007-09-18 22:18:02 +0000660 class Point(tuple):
661 'Point(x, y)'
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000662 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000663 __slots__ = ()
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000664 <BLANKLINE>
Raymond Hettingere0734e72008-01-04 03:22:53 +0000665 _fields = ('x', 'y')
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000666 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000667 def __new__(cls, x, y):
668 return tuple.__new__(cls, (x, y))
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000669 <BLANKLINE>
Raymond Hettinger02740f72008-01-05 01:35:43 +0000670 @classmethod
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000671 def _make(cls, iterable, new=tuple.__new__, len=len):
Raymond Hettinger02740f72008-01-05 01:35:43 +0000672 'Make a new Point object from a sequence or iterable'
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000673 result = new(cls, iterable)
Raymond Hettinger02740f72008-01-05 01:35:43 +0000674 if len(result) != 2:
675 raise TypeError('Expected 2 arguments, got %d' % len(result))
676 return result
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000677 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000678 def __repr__(self):
679 return 'Point(x=%r, y=%r)' % self
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000680 <BLANKLINE>
Raymond Hettinger8777bca2007-12-18 22:21:27 +0000681 def _asdict(t):
Raymond Hettinger48eca672007-12-14 18:08:20 +0000682 'Return a new dict which maps field names to their values'
Raymond Hettinger8777bca2007-12-18 22:21:27 +0000683 return {'x': t[0], 'y': t[1]}
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000684 <BLANKLINE>
Raymond Hettinger42da8742007-12-14 02:49:47 +0000685 def _replace(self, **kwds):
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000686 'Return a new Point object replacing specified fields with new values'
Raymond Hettinger11668722008-01-06 09:02:24 +0000687 result = self._make(map(kwds.pop, ('x', 'y'), self))
Raymond Hettinger1b50fd72008-01-05 02:17:24 +0000688 if kwds:
689 raise ValueError('Got unexpected field names: %r' % kwds.keys())
690 return result
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000691 <BLANKLINE>
692 def __getnewargs__(self):
Raymond Hettingeree51cff2008-06-27 21:34:24 +0000693 return tuple(self)
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000694 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000695 x = property(itemgetter(0))
696 y = property(itemgetter(1))
Georg Brandl8ec7f652007-08-15 14:28:01 +0000697
Raymond Hettingercbab5942007-09-18 22:18:02 +0000698 >>> p = Point(11, y=22) # instantiate with positional or keyword arguments
Raymond Hettinger88880b22007-12-18 00:13:45 +0000699 >>> p[0] + p[1] # indexable like the plain tuple (11, 22)
Raymond Hettingercbab5942007-09-18 22:18:02 +0000700 33
701 >>> x, y = p # unpack like a regular tuple
702 >>> x, y
703 (11, 22)
Georg Brandl907a7202008-02-22 12:31:45 +0000704 >>> p.x + p.y # fields also accessible by name
Raymond Hettingercbab5942007-09-18 22:18:02 +0000705 33
706 >>> p # readable __repr__ with a name=value style
707 Point(x=11, y=22)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000708
Raymond Hettingercbab5942007-09-18 22:18:02 +0000709Named tuples are especially useful for assigning field names to result tuples returned
710by the :mod:`csv` or :mod:`sqlite3` modules::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000711
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000712 EmployeeRecord = namedtuple('EmployeeRecord', 'name, age, title, department, paygrade')
Raymond Hettingera48a2992007-10-08 21:26:58 +0000713
Raymond Hettingercbab5942007-09-18 22:18:02 +0000714 import csv
Raymond Hettinger02740f72008-01-05 01:35:43 +0000715 for emp in map(EmployeeRecord._make, csv.reader(open("employees.csv", "rb"))):
Raymond Hettingercbab5942007-09-18 22:18:02 +0000716 print emp.name, emp.title
Georg Brandl8ec7f652007-08-15 14:28:01 +0000717
Raymond Hettingera48a2992007-10-08 21:26:58 +0000718 import sqlite3
719 conn = sqlite3.connect('/companydata')
720 cursor = conn.cursor()
721 cursor.execute('SELECT name, age, title, department, paygrade FROM employees')
Raymond Hettinger02740f72008-01-05 01:35:43 +0000722 for emp in map(EmployeeRecord._make, cursor.fetchall()):
Raymond Hettingera48a2992007-10-08 21:26:58 +0000723 print emp.name, emp.title
724
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000725In addition to the methods inherited from tuples, named tuples support
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000726three additional methods and one attribute. To prevent conflicts with
727field names, the method and attribute names start with an underscore.
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000728
Georg Brandlb3255ed2008-01-07 16:43:47 +0000729.. method:: somenamedtuple._make(iterable)
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000730
Raymond Hettinger02740f72008-01-05 01:35:43 +0000731 Class method that makes a new instance from an existing sequence or iterable.
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000732
Raymond Hettinger2950bca2009-01-14 01:39:51 +0000733 .. doctest::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000734
Raymond Hettinger02740f72008-01-05 01:35:43 +0000735 >>> t = [11, 22]
736 >>> Point._make(t)
737 Point(x=11, y=22)
Raymond Hettinger2b03d452007-09-18 03:33:19 +0000738
Georg Brandlb3255ed2008-01-07 16:43:47 +0000739.. method:: somenamedtuple._asdict()
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000740
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000741 Return a new dict which maps field names to their corresponding values::
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000742
Raymond Hettinger42da8742007-12-14 02:49:47 +0000743 >>> p._asdict()
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000744 {'x': 11, 'y': 22}
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000745
Georg Brandlb3255ed2008-01-07 16:43:47 +0000746.. method:: somenamedtuple._replace(kwargs)
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000747
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000748 Return a new instance of the named tuple replacing specified fields with new
Raymond Hettinger2950bca2009-01-14 01:39:51 +0000749 values::
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000750
Raymond Hettingercbab5942007-09-18 22:18:02 +0000751 >>> p = Point(x=11, y=22)
Raymond Hettinger42da8742007-12-14 02:49:47 +0000752 >>> p._replace(x=33)
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000753 Point(x=33, y=22)
754
Raymond Hettinger7c3738e2007-11-15 03:16:09 +0000755 >>> for partnum, record in inventory.items():
Raymond Hettingere11230e2008-01-09 03:02:23 +0000756 ... inventory[partnum] = record._replace(price=newprices[partnum], timestamp=time.now())
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000757
Georg Brandlb3255ed2008-01-07 16:43:47 +0000758.. attribute:: somenamedtuple._fields
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000759
Raymond Hettingerf6b769b2008-01-07 21:33:51 +0000760 Tuple of strings listing the field names. Useful for introspection
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000761 and for creating new named tuple types from existing named tuples.
Raymond Hettinger7268e9d2007-09-20 03:03:43 +0000762
Raymond Hettinger2950bca2009-01-14 01:39:51 +0000763 .. doctest::
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000764
Raymond Hettinger42da8742007-12-14 02:49:47 +0000765 >>> p._fields # view the field names
Raymond Hettingercbab5942007-09-18 22:18:02 +0000766 ('x', 'y')
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000767
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000768 >>> Color = namedtuple('Color', 'red green blue')
Raymond Hettinger42da8742007-12-14 02:49:47 +0000769 >>> Pixel = namedtuple('Pixel', Point._fields + Color._fields)
Raymond Hettingercbab5942007-09-18 22:18:02 +0000770 >>> Pixel(11, 22, 128, 255, 0)
Raymond Hettingerdc1854d2008-01-09 03:13:20 +0000771 Pixel(x=11, y=22, red=128, green=255, blue=0)
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000772
Raymond Hettingere846f382007-12-14 21:51:50 +0000773To retrieve a field whose name is stored in a string, use the :func:`getattr`
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000774function:
Raymond Hettingere846f382007-12-14 21:51:50 +0000775
776 >>> getattr(p, 'x')
777 11
778
Raymond Hettingere4ae63c2009-02-11 00:06:17 +0000779To convert a dictionary to a named tuple, use the double-star-operator
780(as described in :ref:`tut-unpacking-arguments`):
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000781
782 >>> d = {'x': 11, 'y': 22}
783 >>> Point(**d)
784 Point(x=11, y=22)
785
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000786Since a named tuple is a regular Python class, it is easy to add or change
Raymond Hettingerb8e00722008-01-07 04:24:49 +0000787functionality with a subclass. Here is how to add a calculated field and
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000788a fixed-width print format:
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000789
Raymond Hettingerb8e00722008-01-07 04:24:49 +0000790 >>> class Point(namedtuple('Point', 'x y')):
Raymond Hettingere1655082008-01-10 19:15:10 +0000791 ... __slots__ = ()
Raymond Hettingere11230e2008-01-09 03:02:23 +0000792 ... @property
793 ... def hypot(self):
794 ... return (self.x ** 2 + self.y ** 2) ** 0.5
795 ... def __str__(self):
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000796 ... return 'Point: x=%6.3f y=%6.3f hypot=%6.3f' % (self.x, self.y, self.hypot)
Raymond Hettingerb8e00722008-01-07 04:24:49 +0000797
Raymond Hettingere1655082008-01-10 19:15:10 +0000798 >>> for p in Point(3, 4), Point(14, 5/7.):
Raymond Hettingere11230e2008-01-09 03:02:23 +0000799 ... print p
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000800 Point: x= 3.000 y= 4.000 hypot= 5.000
801 Point: x=14.000 y= 0.714 hypot=14.018
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000802
Raymond Hettinger9bba7b72008-01-27 10:47:55 +0000803The subclass shown above sets ``__slots__`` to an empty tuple. This keeps
Raymond Hettinger171f3912008-01-16 23:38:16 +0000804keep memory requirements low by preventing the creation of instance dictionaries.
Raymond Hettingerf59e9622008-01-15 20:52:42 +0000805
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000806Subclassing is not useful for adding new, stored fields. Instead, simply
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000807create a new named tuple type from the :attr:`_fields` attribute:
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000808
Raymond Hettingere850c462008-01-10 20:37:12 +0000809 >>> Point3D = namedtuple('Point3D', Point._fields + ('z',))
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000810
Raymond Hettingerfb3ced62008-01-07 20:17:35 +0000811Default values can be implemented by using :meth:`_replace` to
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000812customize a prototype instance:
Raymond Hettingerbc693492007-11-15 22:39:34 +0000813
814 >>> Account = namedtuple('Account', 'owner balance transaction_count')
Raymond Hettinger0fe6ca42008-01-18 21:14:58 +0000815 >>> default_account = Account('<owner name>', 0.0, 0)
816 >>> johns_account = default_account._replace(owner='John')
Raymond Hettingerbc693492007-11-15 22:39:34 +0000817
Raymond Hettinger5a9fed72008-05-08 07:23:30 +0000818Enumerated constants can be implemented with named tuples, but it is simpler
819and more efficient to use a simple class declaration:
820
821 >>> Status = namedtuple('Status', 'open pending closed')._make(range(3))
822 >>> Status.open, Status.pending, Status.closed
823 (0, 1, 2)
824 >>> class Status:
825 ... open, pending, closed = range(3)
826
Raymond Hettingere4ae63c2009-02-11 00:06:17 +0000827.. seealso::
Mark Summerfield7f626f42007-08-30 15:03:03 +0000828
Raymond Hettingere4ae63c2009-02-11 00:06:17 +0000829 `Named tuple recipe <http://code.activestate.com/recipes/500261/>`_
830 adapted for Python 2.4.