blob: 0ed51bf4cc0a7f19018a9d420f51c504ed4ebeeb [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001
2:mod:`collections` --- High-performance container datatypes
3===========================================================
4
5.. module:: collections
6 :synopsis: High-performance datatypes
7.. moduleauthor:: Raymond Hettinger <python@rcn.com>
8.. sectionauthor:: Raymond Hettinger <python@rcn.com>
9
Georg Brandl8ec7f652007-08-15 14:28:01 +000010.. versionadded:: 2.4
11
Georg Brandl4c8bbe62008-03-22 21:06:20 +000012.. testsetup:: *
13
14 from collections import *
15 import itertools
16 __name__ = '<doctest>'
17
Georg Brandl8ec7f652007-08-15 14:28:01 +000018This module implements high-performance container datatypes. Currently,
19there are two datatypes, :class:`deque` and :class:`defaultdict`, and
Georg Brandl4c8bbe62008-03-22 21:06:20 +000020one datatype factory function, :func:`namedtuple`.
Georg Brandl8ec7f652007-08-15 14:28:01 +000021
22.. versionchanged:: 2.5
23 Added :class:`defaultdict`.
24
25.. versionchanged:: 2.6
Raymond Hettingereeeb9c42007-11-15 02:44:53 +000026 Added :func:`namedtuple`.
Georg Brandl8ec7f652007-08-15 14:28:01 +000027
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000028The specialized containers provided in this module provide alternatives
Georg Brandl4c8bbe62008-03-22 21:06:20 +000029to Python's general purpose built-in containers, :class:`dict`,
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000030:class:`list`, :class:`set`, and :class:`tuple`.
31
32Besides the containers provided here, the optional :mod:`bsddb`
Georg Brandl4c8bbe62008-03-22 21:06:20 +000033module offers the ability to create in-memory or file based ordered
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000034dictionaries with string keys using the :meth:`bsddb.btopen` method.
35
36In addition to containers, the collections module provides some ABCs
Georg Brandl4c8bbe62008-03-22 21:06:20 +000037(abstract base classes) that can be used to test whether a class
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000038provides a particular interface, for example, is it hashable or
Georg Brandl4c8bbe62008-03-22 21:06:20 +000039a mapping.
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000040
41.. versionchanged:: 2.6
42 Added abstract base classes.
43
44ABCs - abstract base classes
45----------------------------
46
47The collections module offers the following ABCs:
48
Georg Brandldbc59872008-07-08 07:05:23 +000049========================= ===================== ====================== ====================================================
50ABC Inherits Abstract Methods Mixin Methods
51========================= ===================== ====================== ====================================================
52:class:`Container` ``__contains__``
53:class:`Hashable` ``__hash__``
54:class:`Iterable` ``__iter__``
55:class:`Iterator` :class:`Iterable` ``__next__`` ``__iter__``
Georg Brandl7044b112009-01-03 21:04:55 +000056:class:`Sized` ``__len__``
Georg Brandldbc59872008-07-08 07:05:23 +000057:class:`Callable` ``__call__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000058
Georg Brandldbc59872008-07-08 07:05:23 +000059:class:`Sequence` :class:`Sized`, ``__getitem__`` ``__contains__``. ``__iter__``, ``__reversed__``.
60 :class:`Iterable`, and ``__len__`` ``index``, and ``count``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000061 :class:`Container`
62
Georg Brandldf9bcf12008-11-24 16:16:07 +000063:class:`MutableSequence` :class:`Sequence` ``__getitem__`` Inherited Sequence methods and
Georg Brandldbc59872008-07-08 07:05:23 +000064 ``__delitem__``, ``append``, ``reverse``, ``extend``, ``pop``,
65 ``insert``, ``remove``, and ``__iadd__``
66 and ``__len__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000067
Georg Brandldbc59872008-07-08 07:05:23 +000068:class:`Set` :class:`Sized`, ``__len__``, ``__le__``, ``__lt__``, ``__eq__``, ``__ne__``,
69 :class:`Iterable`, ``__iter__``, and ``__gt__``, ``__ge__``, ``__and__``, ``__or__``
70 :class:`Container` ``__contains__`` ``__sub__``, ``__xor__``, and ``isdisjoint``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000071
Georg Brandldbc59872008-07-08 07:05:23 +000072:class:`MutableSet` :class:`Set` ``add`` and Inherited Set methods and
73 ``discard`` ``clear``, ``pop``, ``remove``, ``__ior__``,
74 ``__iand__``, ``__ixor__``, and ``__isub__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000075
Georg Brandldbc59872008-07-08 07:05:23 +000076:class:`Mapping` :class:`Sized`, ``__getitem__``, ``__contains__``, ``keys``, ``items``, ``values``,
77 :class:`Iterable`, ``__len__``. and ``get``, ``__eq__``, and ``__ne__``
78 :class:`Container` ``__iter__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000079
Georg Brandldbc59872008-07-08 07:05:23 +000080:class:`MutableMapping` :class:`Mapping` ``__getitem__`` Inherited Mapping methods and
81 ``__setitem__``, ``pop``, ``popitem``, ``clear``, ``update``,
82 ``__delitem__``, and ``setdefault``
Georg Brandl7044b112009-01-03 21:04:55 +000083 ``__iter__``, and
Georg Brandldbc59872008-07-08 07:05:23 +000084 ``__len__``
Georg Brandlc62ef8b2009-01-03 20:55:06 +000085
Georg Brandldbc59872008-07-08 07:05:23 +000086:class:`MappingView` :class:`Sized` ``__len__``
87:class:`KeysView` :class:`MappingView`, ``__contains__``,
88 :class:`Set` ``__iter__``
89:class:`ItemsView` :class:`MappingView`, ``__contains__``,
90 :class:`Set` ``__iter__``
91:class:`ValuesView` :class:`MappingView` ``__contains__``, ``__iter__``
92========================= ===================== ====================== ====================================================
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +000093
94These ABCs allow us to ask classes or instances if they provide
95particular functionality, for example::
96
97 size = None
98 if isinstance(myvar, collections.Sized):
Georg Brandl7044b112009-01-03 21:04:55 +000099 size = len(myvar)
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000100
101Several of the ABCs are also useful as mixins that make it easier to develop
102classes supporting container APIs. For example, to write a class supporting
103the full :class:`Set` API, it only necessary to supply the three underlying
104abstract methods: :meth:`__contains__`, :meth:`__iter__`, and :meth:`__len__`.
105The ABC supplies the remaining methods such as :meth:`__and__` and
106:meth:`isdisjoint` ::
107
108 class ListBasedSet(collections.Set):
109 ''' Alternate set implementation favoring space over speed
110 and not requiring the set elements to be hashable. '''
111 def __init__(self, iterable):
112 self.elements = lst = []
113 for value in iterable:
114 if value not in lst:
115 lst.append(value)
116 def __iter__(self):
117 return iter(self.elements)
118 def __contains__(self, value):
119 return value in self.elements
120 def __len__(self):
121 return len(self.elements)
122
123 s1 = ListBasedSet('abcdef')
124 s2 = ListBasedSet('defghi')
125 overlap = s1 & s2 # The __and__() method is supported automatically
126
127Notes on using :class:`Set` and :class:`MutableSet` as a mixin:
128
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000129(1)
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000130 Since some set operations create new sets, the default mixin methods need
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000131 a way to create new instances from an iterable. The class constructor is
132 assumed to have a signature in the form ``ClassName(iterable)``.
Raymond Hettinger96b42402008-05-23 17:34:34 +0000133 That assumption is factored-out to an internal classmethod called
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000134 :meth:`_from_iterable` which calls ``cls(iterable)`` to produce a new set.
135 If the :class:`Set` mixin is being used in a class with a different
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000136 constructor signature, you will need to override :meth:`from_iterable`
137 with a classmethod that can construct new instances from
Raymond Hettingerbc4ffc12008-02-11 23:38:00 +0000138 an iterable argument.
139
140(2)
141 To override the comparisons (presumably for speed, as the
142 semantics are fixed), redefine :meth:`__le__` and
143 then the other operations will automatically follow suit.
144
145(3)
146 The :class:`Set` mixin provides a :meth:`_hash` method to compute a hash value
147 for the set; however, :meth:`__hash__` is not defined because not all sets
148 are hashable or immutable. To add set hashabilty using mixins,
149 inherit from both :meth:`Set` and :meth:`Hashable`, then define
150 ``__hash__ = Set._hash``.
151
152(For more about ABCs, see the :mod:`abc` module and :pep:`3119`.)
153
154
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000155.. _counter-objects:
156
157:class:`Counter` objects
158------------------------
159
160A counter tool is provided to support convenient and rapid tallies.
161For example::
162
163 # Tally repeated words in a list
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000164 >>> words = ['red', 'blue', 'red', 'green', 'blue', 'blue']
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000165 >>> cnt = Counter()
166 >>> for word in words:
167 ... cnt[word] += 1
168 >>> cnt
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000169 Counter({'blue': 3, 'red': 2, 'green': 1})
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000170
171 # Find the ten most common words in Hamlet
172 >>> import re
173 >>> words = re.findall('\w+', open('hamlet.txt').read().lower())
174 >>> Counter(hamlet_words).most_common(10)
175 [('the', 1143), ('and', 966), ('to', 762), ('of', 669), ('i', 631),
176 ('you', 554), ('a', 546), ('my', 514), ('hamlet', 471), ('in', 451)]
177
Raymond Hettinger82783852009-01-13 03:49:43 +0000178.. class:: Counter([iterable-or-mapping])
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000179
180 A :class:`Counter` is a :class:`dict` subclass for counting hashable items.
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000181 It is an unordered collection where elements are stored as dictionary keys
182 and their counts are stored as dictionary values. Counts are allowed to be
183 any integer value including zero or negative counts. The :class:`Counter`
184 class is similar to bags or multisets in other languages.
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000185
Raymond Hettinger82783852009-01-13 03:49:43 +0000186 Elements are counted from an *iterable* or initialized from another
187 *mapping* (or counter)::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000188
189 >>> c = Counter() # a new, empty counter
190 >>> c = Counter('gallahad') # a new counter from an iterable
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000191 >>> c = Counter({'a': 4, 'b': 2}) # a new counter from a mapping
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000192
193 The returned object has a dictionary style interface except that it returns
194 a zero count for missing items (instead of raising a :exc:`KeyError` like a
195 dictionary would)::
196
197 >>> c = Counter(['if', 'your', 'peril', 'be'])
198 >>> c['questions'] # count of a missing element is zero
199 0
200
201 Assigning a count of zero or reducing the count to zero leaves the
202 element in the dictionary. Use ``del`` to remove the entry entirely:
203
204 >>> c = Counter(['arthur', 'gwain'])
205 >>> c['arthur'] = 0 # set the count of "arthur" to zero
206 >>> 'arthur' in c # but "arthur" is still in the counter
207 True
208 >>> del c['arthur'] # del will completely remove the entry
209 >>> 'arthur' in c
210 False
211
212 .. versionadded:: 2.7
213
214
215 Counter objects support two methods beyond those available for all
216 dictionaries:
217
218 .. method:: elements()
219
220 Return an iterator over elements repeating each as many times as its count.
221 Elements are returned in arbitrary order. If an element's count has been
222 set to zero or a negative number, :meth:`elements` will ignore it.
223
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000224 >>> c = Counter({'a': 4, 'b': 2, 'd': 0, 'e': -2})
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000225 >>> list(c.elements())
226 ['a', 'a', 'a', 'a', 'b', 'b']
227
228 .. method:: most_common([n])
229
230 Return a list of the *n* most common elements and their counts from
231 the most common to the least. If *n* is not specified or is ``None``,
232 return a list of all element counts in decreasing order of frequency.
233 Elements with equal counts are ordered arbitrarily::
234
235 >>> Counter('abracadabra').most_common(3)
236 [('a', 5), ('r', 2), ('b', 2)]
237
238 The usual dictionary methods are available for :class:`Counter` objects.
239 All of those work the same as they do for dictionaries except for two
240 which work differently for counters.
241
242 .. method:: fromkeys(iterable)
243
244 There is no equivalent class method for :class:`Counter` objects.
245 Raises a :exc:`NotImplementedError` when called.
246
Raymond Hettinger82783852009-01-13 03:49:43 +0000247 .. method:: update([iterable-or-mapping])
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000248
249 Like :meth:`dict.update` but adds-in counts instead of replacing them.
Raymond Hettingeraaa6e632009-01-13 01:05:03 +0000250
Raymond Hettinger82783852009-01-13 03:49:43 +0000251 Elements are counted from an *iterable* or added-in from another
252 *mapping* (or counter)::
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000253
Raymond Hettinger82783852009-01-13 03:49:43 +0000254 >>> c = Counter('which')
255 >>> c.update('witch') # add elements from another iterable
256 >>> d = Counter('watch')
257 >>> c.update(d) # add elements from another counter
258 >>> c['h'] # four 'h' in which, witch, and watch
Raymond Hettingerf94d7fa2009-01-12 22:58:41 +0000259 4
260
261
262.. seealso::
263
264 `Multisets <http://en.wikipedia.org/wiki/Multiset>`_
265 in the Wikipedia
266
267 `Bag <http://www.gnu.org/software/smalltalk/manual-base/html_node/Bag.html>`_
268 a Smalltalk class
269
270 `C++ multisets <http://www.demo2s.com/Tutorial/Cpp/0380__set-multiset/Catalog0380__set-multiset.htm>`_
271 a tutorial with standalone examples
272
273 `Bag class <http://code.activestate.com/recipes/259174/>`_
274 an early Python recipe
275
276 Use cases for multisets and mathematical operations on multisets.
277 Knuth, Donald. The Art of Computer Programming Volume II,
278 Section 4.6.3, Exercise 19.
279
Georg Brandl8ec7f652007-08-15 14:28:01 +0000280
281.. _deque-objects:
282
283:class:`deque` objects
284----------------------
285
286
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000287.. class:: deque([iterable[, maxlen]])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000288
289 Returns a new deque object initialized left-to-right (using :meth:`append`) with
290 data from *iterable*. If *iterable* is not specified, the new deque is empty.
291
292 Deques are a generalization of stacks and queues (the name is pronounced "deck"
293 and is short for "double-ended queue"). Deques support thread-safe, memory
294 efficient appends and pops from either side of the deque with approximately the
295 same O(1) performance in either direction.
296
297 Though :class:`list` objects support similar operations, they are optimized for
298 fast fixed-length operations and incur O(n) memory movement costs for
299 ``pop(0)`` and ``insert(0, v)`` operations which change both the size and
300 position of the underlying data representation.
301
302 .. versionadded:: 2.4
303
Raymond Hettinger68995862007-10-10 00:26:46 +0000304 If *maxlen* is not specified or is *None*, deques may grow to an
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000305 arbitrary length. Otherwise, the deque is bounded to the specified maximum
306 length. Once a bounded length deque is full, when new items are added, a
307 corresponding number of items are discarded from the opposite end. Bounded
308 length deques provide functionality similar to the ``tail`` filter in
309 Unix. They are also useful for tracking transactions and other pools of data
310 where only the most recent activity is of interest.
311
312 .. versionchanged:: 2.6
Georg Brandlb19be572007-12-29 10:57:00 +0000313 Added *maxlen* parameter.
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000314
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000315 Deque objects support the following methods:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000316
317
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000318 .. method:: append(x)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000319
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000320 Add *x* to the right side of the deque.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000321
322
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000323 .. method:: appendleft(x)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000324
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000325 Add *x* to the left side of the deque.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000326
327
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000328 .. method:: clear()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000329
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000330 Remove all elements from the deque leaving it with length 0.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000331
332
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000333 .. method:: extend(iterable)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000334
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000335 Extend the right side of the deque by appending elements from the iterable
336 argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000337
338
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000339 .. method:: extendleft(iterable)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000340
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000341 Extend the left side of the deque by appending elements from *iterable*.
342 Note, the series of left appends results in reversing the order of
343 elements in the iterable argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000344
345
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000346 .. method:: pop()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000347
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000348 Remove and return an element from the right side of the deque. If no
349 elements are present, raises an :exc:`IndexError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000350
351
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000352 .. method:: popleft()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000353
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000354 Remove and return an element from the left side of the deque. If no
355 elements are present, raises an :exc:`IndexError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000356
357
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000358 .. method:: remove(value)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000359
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000360 Removed the first occurrence of *value*. If not found, raises a
361 :exc:`ValueError`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000362
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000363 .. versionadded:: 2.5
Georg Brandl8ec7f652007-08-15 14:28:01 +0000364
365
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000366 .. method:: rotate(n)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000367
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000368 Rotate the deque *n* steps to the right. If *n* is negative, rotate to
369 the left. Rotating one step to the right is equivalent to:
370 ``d.appendleft(d.pop())``.
371
Georg Brandl8ec7f652007-08-15 14:28:01 +0000372
373In addition to the above, deques support iteration, pickling, ``len(d)``,
374``reversed(d)``, ``copy.copy(d)``, ``copy.deepcopy(d)``, membership testing with
Benjamin Peterson5c4e0062008-10-16 18:52:14 +0000375the :keyword:`in` operator, and subscript references such as ``d[-1]``. Indexed
376access is O(1) at both ends but slows to O(n) in the middle. For fast random
377access, use lists instead.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000378
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000379Example:
380
381.. doctest::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000382
383 >>> from collections import deque
384 >>> d = deque('ghi') # make a new deque with three items
385 >>> for elem in d: # iterate over the deque's elements
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000386 ... print elem.upper()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000387 G
388 H
389 I
390
391 >>> d.append('j') # add a new entry to the right side
392 >>> d.appendleft('f') # add a new entry to the left side
393 >>> d # show the representation of the deque
394 deque(['f', 'g', 'h', 'i', 'j'])
395
396 >>> d.pop() # return and remove the rightmost item
397 'j'
398 >>> d.popleft() # return and remove the leftmost item
399 'f'
400 >>> list(d) # list the contents of the deque
401 ['g', 'h', 'i']
402 >>> d[0] # peek at leftmost item
403 'g'
404 >>> d[-1] # peek at rightmost item
405 'i'
406
407 >>> list(reversed(d)) # list the contents of a deque in reverse
408 ['i', 'h', 'g']
409 >>> 'h' in d # search the deque
410 True
411 >>> d.extend('jkl') # add multiple elements at once
412 >>> d
413 deque(['g', 'h', 'i', 'j', 'k', 'l'])
414 >>> d.rotate(1) # right rotation
415 >>> d
416 deque(['l', 'g', 'h', 'i', 'j', 'k'])
417 >>> d.rotate(-1) # left rotation
418 >>> d
419 deque(['g', 'h', 'i', 'j', 'k', 'l'])
420
421 >>> deque(reversed(d)) # make a new deque in reverse order
422 deque(['l', 'k', 'j', 'i', 'h', 'g'])
423 >>> d.clear() # empty the deque
424 >>> d.pop() # cannot pop from an empty deque
425 Traceback (most recent call last):
426 File "<pyshell#6>", line 1, in -toplevel-
427 d.pop()
428 IndexError: pop from an empty deque
429
430 >>> d.extendleft('abc') # extendleft() reverses the input order
431 >>> d
432 deque(['c', 'b', 'a'])
433
434
435.. _deque-recipes:
436
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000437:class:`deque` Recipes
438^^^^^^^^^^^^^^^^^^^^^^
Georg Brandl8ec7f652007-08-15 14:28:01 +0000439
440This section shows various approaches to working with deques.
441
442The :meth:`rotate` method provides a way to implement :class:`deque` slicing and
443deletion. For example, a pure python implementation of ``del d[n]`` relies on
444the :meth:`rotate` method to position elements to be popped::
445
446 def delete_nth(d, n):
447 d.rotate(-n)
448 d.popleft()
449 d.rotate(n)
450
451To implement :class:`deque` slicing, use a similar approach applying
452:meth:`rotate` to bring a target element to the left side of the deque. Remove
453old entries with :meth:`popleft`, add new entries with :meth:`extend`, and then
454reverse the rotation.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000455With minor variations on that approach, it is easy to implement Forth style
456stack manipulations such as ``dup``, ``drop``, ``swap``, ``over``, ``pick``,
457``rot``, and ``roll``.
458
Georg Brandl8ec7f652007-08-15 14:28:01 +0000459Multi-pass data reduction algorithms can be succinctly expressed and efficiently
460coded by extracting elements with multiple calls to :meth:`popleft`, applying
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000461a reduction function, and calling :meth:`append` to add the result back to the
462deque.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000463
464For example, building a balanced binary tree of nested lists entails reducing
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000465two adjacent nodes into one by grouping them in a list:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000466
467 >>> def maketree(iterable):
468 ... d = deque(iterable)
469 ... while len(d) > 1:
470 ... pair = [d.popleft(), d.popleft()]
471 ... d.append(pair)
472 ... return list(d)
473 ...
474 >>> print maketree('abcdefgh')
475 [[[['a', 'b'], ['c', 'd']], [['e', 'f'], ['g', 'h']]]]
476
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000477Bounded length deques provide functionality similar to the ``tail`` filter
478in Unix::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000479
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000480 def tail(filename, n=10):
481 'Return the last n lines of a file'
482 return deque(open(filename), n)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000483
484.. _defaultdict-objects:
485
486:class:`defaultdict` objects
487----------------------------
488
489
490.. class:: defaultdict([default_factory[, ...]])
491
492 Returns a new dictionary-like object. :class:`defaultdict` is a subclass of the
493 builtin :class:`dict` class. It overrides one method and adds one writable
494 instance variable. The remaining functionality is the same as for the
495 :class:`dict` class and is not documented here.
496
497 The first argument provides the initial value for the :attr:`default_factory`
498 attribute; it defaults to ``None``. All remaining arguments are treated the same
499 as if they were passed to the :class:`dict` constructor, including keyword
500 arguments.
501
502 .. versionadded:: 2.5
503
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000504 :class:`defaultdict` objects support the following method in addition to the
505 standard :class:`dict` operations:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000506
507
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000508 .. method:: defaultdict.__missing__(key)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000509
Skip Montanarob40890d2008-09-17 11:50:36 +0000510 If the :attr:`default_factory` attribute is ``None``, this raises a
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000511 :exc:`KeyError` exception with the *key* as argument.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000512
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000513 If :attr:`default_factory` is not ``None``, it is called without arguments
514 to provide a default value for the given *key*, this value is inserted in
515 the dictionary for the *key*, and returned.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000516
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000517 If calling :attr:`default_factory` raises an exception this exception is
518 propagated unchanged.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000519
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000520 This method is called by the :meth:`__getitem__` method of the
521 :class:`dict` class when the requested key is not found; whatever it
522 returns or raises is then returned or raised by :meth:`__getitem__`.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000523
524
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000525 :class:`defaultdict` objects support the following instance variable:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000526
Benjamin Petersonc7b05922008-04-25 01:29:10 +0000527
528 .. attribute:: defaultdict.default_factory
529
530 This attribute is used by the :meth:`__missing__` method; it is
531 initialized from the first argument to the constructor, if present, or to
532 ``None``, if absent.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000533
534
535.. _defaultdict-examples:
536
537:class:`defaultdict` Examples
538^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
539
540Using :class:`list` as the :attr:`default_factory`, it is easy to group a
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000541sequence of key-value pairs into a dictionary of lists:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000542
543 >>> s = [('yellow', 1), ('blue', 2), ('yellow', 3), ('blue', 4), ('red', 1)]
544 >>> d = defaultdict(list)
545 >>> for k, v in s:
546 ... d[k].append(v)
547 ...
548 >>> d.items()
549 [('blue', [2, 4]), ('red', [1]), ('yellow', [1, 3])]
550
551When each key is encountered for the first time, it is not already in the
552mapping; so an entry is automatically created using the :attr:`default_factory`
553function which returns an empty :class:`list`. The :meth:`list.append`
554operation then attaches the value to the new list. When keys are encountered
555again, the look-up proceeds normally (returning the list for that key) and the
556:meth:`list.append` operation adds another value to the list. This technique is
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000557simpler and faster than an equivalent technique using :meth:`dict.setdefault`:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000558
559 >>> d = {}
560 >>> for k, v in s:
561 ... d.setdefault(k, []).append(v)
562 ...
563 >>> d.items()
564 [('blue', [2, 4]), ('red', [1]), ('yellow', [1, 3])]
565
566Setting the :attr:`default_factory` to :class:`int` makes the
567:class:`defaultdict` useful for counting (like a bag or multiset in other
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000568languages):
Georg Brandl8ec7f652007-08-15 14:28:01 +0000569
570 >>> s = 'mississippi'
571 >>> d = defaultdict(int)
572 >>> for k in s:
573 ... d[k] += 1
574 ...
575 >>> d.items()
576 [('i', 4), ('p', 2), ('s', 4), ('m', 1)]
577
578When a letter is first encountered, it is missing from the mapping, so the
579:attr:`default_factory` function calls :func:`int` to supply a default count of
580zero. The increment operation then builds up the count for each letter.
581
582The function :func:`int` which always returns zero is just a special case of
583constant functions. A faster and more flexible way to create constant functions
584is to use :func:`itertools.repeat` which can supply any constant value (not just
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000585zero):
Georg Brandl8ec7f652007-08-15 14:28:01 +0000586
587 >>> def constant_factory(value):
588 ... return itertools.repeat(value).next
589 >>> d = defaultdict(constant_factory('<missing>'))
590 >>> d.update(name='John', action='ran')
591 >>> '%(name)s %(action)s to %(object)s' % d
592 'John ran to <missing>'
593
594Setting the :attr:`default_factory` to :class:`set` makes the
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000595:class:`defaultdict` useful for building a dictionary of sets:
Georg Brandl8ec7f652007-08-15 14:28:01 +0000596
597 >>> s = [('red', 1), ('blue', 2), ('red', 3), ('blue', 4), ('red', 1), ('blue', 4)]
598 >>> d = defaultdict(set)
599 >>> for k, v in s:
600 ... d[k].add(v)
601 ...
602 >>> d.items()
603 [('blue', set([2, 4])), ('red', set([1, 3]))]
604
605
606.. _named-tuple-factory:
607
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000608:func:`namedtuple` Factory Function for Tuples with Named Fields
Georg Brandlb3255ed2008-01-07 16:43:47 +0000609----------------------------------------------------------------
Georg Brandl8ec7f652007-08-15 14:28:01 +0000610
Raymond Hettingercbab5942007-09-18 22:18:02 +0000611Named tuples assign meaning to each position in a tuple and allow for more readable,
612self-documenting code. They can be used wherever regular tuples are used, and
613they add the ability to access fields by name instead of position index.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000614
Georg Brandl061d2e22008-11-23 19:17:25 +0000615.. function:: namedtuple(typename, field_names, [verbose])
Georg Brandl8ec7f652007-08-15 14:28:01 +0000616
617 Returns a new tuple subclass named *typename*. The new subclass is used to
Georg Brandl907a7202008-02-22 12:31:45 +0000618 create tuple-like objects that have fields accessible by attribute lookup as
Georg Brandl8ec7f652007-08-15 14:28:01 +0000619 well as being indexable and iterable. Instances of the subclass also have a
Georg Brandl061d2e22008-11-23 19:17:25 +0000620 helpful docstring (with typename and field_names) and a helpful :meth:`__repr__`
Georg Brandl8ec7f652007-08-15 14:28:01 +0000621 method which lists the tuple contents in a ``name=value`` format.
622
Georg Brandl061d2e22008-11-23 19:17:25 +0000623 The *field_names* are a single string with each fieldname separated by whitespace
624 and/or commas, for example ``'x y'`` or ``'x, y'``. Alternatively, *field_names*
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000625 can be a sequence of strings such as ``['x', 'y']``.
Raymond Hettingerabfd8df2007-10-16 21:28:32 +0000626
627 Any valid Python identifier may be used for a fieldname except for names
Raymond Hettinger42da8742007-12-14 02:49:47 +0000628 starting with an underscore. Valid identifiers consist of letters, digits,
629 and underscores but do not start with a digit or underscore and cannot be
Raymond Hettingerabfd8df2007-10-16 21:28:32 +0000630 a :mod:`keyword` such as *class*, *for*, *return*, *global*, *pass*, *print*,
631 or *raise*.
Raymond Hettingercbab5942007-09-18 22:18:02 +0000632
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000633 If *verbose* is true, the class definition is printed just before being built.
Raymond Hettingercbab5942007-09-18 22:18:02 +0000634
Raymond Hettingera48a2992007-10-08 21:26:58 +0000635 Named tuple instances do not have per-instance dictionaries, so they are
Raymond Hettinger7268e9d2007-09-20 03:03:43 +0000636 lightweight and require no more memory than regular tuples.
Raymond Hettingercbab5942007-09-18 22:18:02 +0000637
Georg Brandl8ec7f652007-08-15 14:28:01 +0000638 .. versionadded:: 2.6
639
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000640Example:
641
642.. doctest::
643 :options: +NORMALIZE_WHITESPACE
Georg Brandl8ec7f652007-08-15 14:28:01 +0000644
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000645 >>> Point = namedtuple('Point', 'x y', verbose=True)
Raymond Hettingercbab5942007-09-18 22:18:02 +0000646 class Point(tuple):
647 'Point(x, y)'
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000648 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000649 __slots__ = ()
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000650 <BLANKLINE>
Raymond Hettingere0734e72008-01-04 03:22:53 +0000651 _fields = ('x', 'y')
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000652 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000653 def __new__(cls, x, y):
654 return tuple.__new__(cls, (x, y))
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000655 <BLANKLINE>
Raymond Hettinger02740f72008-01-05 01:35:43 +0000656 @classmethod
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000657 def _make(cls, iterable, new=tuple.__new__, len=len):
Raymond Hettinger02740f72008-01-05 01:35:43 +0000658 'Make a new Point object from a sequence or iterable'
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000659 result = new(cls, iterable)
Raymond Hettinger02740f72008-01-05 01:35:43 +0000660 if len(result) != 2:
661 raise TypeError('Expected 2 arguments, got %d' % len(result))
662 return result
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000663 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000664 def __repr__(self):
665 return 'Point(x=%r, y=%r)' % self
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000666 <BLANKLINE>
Raymond Hettinger8777bca2007-12-18 22:21:27 +0000667 def _asdict(t):
Raymond Hettinger48eca672007-12-14 18:08:20 +0000668 'Return a new dict which maps field names to their values'
Raymond Hettinger8777bca2007-12-18 22:21:27 +0000669 return {'x': t[0], 'y': t[1]}
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000670 <BLANKLINE>
Raymond Hettinger42da8742007-12-14 02:49:47 +0000671 def _replace(self, **kwds):
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000672 'Return a new Point object replacing specified fields with new values'
Raymond Hettinger11668722008-01-06 09:02:24 +0000673 result = self._make(map(kwds.pop, ('x', 'y'), self))
Raymond Hettinger1b50fd72008-01-05 02:17:24 +0000674 if kwds:
675 raise ValueError('Got unexpected field names: %r' % kwds.keys())
676 return result
Georg Brandlc62ef8b2009-01-03 20:55:06 +0000677 <BLANKLINE>
678 def __getnewargs__(self):
Raymond Hettingeree51cff2008-06-27 21:34:24 +0000679 return tuple(self)
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000680 <BLANKLINE>
Raymond Hettingercbab5942007-09-18 22:18:02 +0000681 x = property(itemgetter(0))
682 y = property(itemgetter(1))
Georg Brandl8ec7f652007-08-15 14:28:01 +0000683
Raymond Hettingercbab5942007-09-18 22:18:02 +0000684 >>> p = Point(11, y=22) # instantiate with positional or keyword arguments
Raymond Hettinger88880b22007-12-18 00:13:45 +0000685 >>> p[0] + p[1] # indexable like the plain tuple (11, 22)
Raymond Hettingercbab5942007-09-18 22:18:02 +0000686 33
687 >>> x, y = p # unpack like a regular tuple
688 >>> x, y
689 (11, 22)
Georg Brandl907a7202008-02-22 12:31:45 +0000690 >>> p.x + p.y # fields also accessible by name
Raymond Hettingercbab5942007-09-18 22:18:02 +0000691 33
692 >>> p # readable __repr__ with a name=value style
693 Point(x=11, y=22)
Georg Brandl8ec7f652007-08-15 14:28:01 +0000694
Raymond Hettingercbab5942007-09-18 22:18:02 +0000695Named tuples are especially useful for assigning field names to result tuples returned
696by the :mod:`csv` or :mod:`sqlite3` modules::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000697
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000698 EmployeeRecord = namedtuple('EmployeeRecord', 'name, age, title, department, paygrade')
Raymond Hettingera48a2992007-10-08 21:26:58 +0000699
Raymond Hettingercbab5942007-09-18 22:18:02 +0000700 import csv
Raymond Hettinger02740f72008-01-05 01:35:43 +0000701 for emp in map(EmployeeRecord._make, csv.reader(open("employees.csv", "rb"))):
Raymond Hettingercbab5942007-09-18 22:18:02 +0000702 print emp.name, emp.title
Georg Brandl8ec7f652007-08-15 14:28:01 +0000703
Raymond Hettingera48a2992007-10-08 21:26:58 +0000704 import sqlite3
705 conn = sqlite3.connect('/companydata')
706 cursor = conn.cursor()
707 cursor.execute('SELECT name, age, title, department, paygrade FROM employees')
Raymond Hettinger02740f72008-01-05 01:35:43 +0000708 for emp in map(EmployeeRecord._make, cursor.fetchall()):
Raymond Hettingera48a2992007-10-08 21:26:58 +0000709 print emp.name, emp.title
710
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000711In addition to the methods inherited from tuples, named tuples support
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000712three additional methods and one attribute. To prevent conflicts with
713field names, the method and attribute names start with an underscore.
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000714
Georg Brandlb3255ed2008-01-07 16:43:47 +0000715.. method:: somenamedtuple._make(iterable)
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000716
Raymond Hettinger02740f72008-01-05 01:35:43 +0000717 Class method that makes a new instance from an existing sequence or iterable.
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000718
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000719.. doctest::
Georg Brandl8ec7f652007-08-15 14:28:01 +0000720
Raymond Hettinger02740f72008-01-05 01:35:43 +0000721 >>> t = [11, 22]
722 >>> Point._make(t)
723 Point(x=11, y=22)
Raymond Hettinger2b03d452007-09-18 03:33:19 +0000724
Georg Brandlb3255ed2008-01-07 16:43:47 +0000725.. method:: somenamedtuple._asdict()
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000726
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000727 Return a new dict which maps field names to their corresponding values::
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000728
Raymond Hettinger42da8742007-12-14 02:49:47 +0000729 >>> p._asdict()
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000730 {'x': 11, 'y': 22}
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000731
Georg Brandlb3255ed2008-01-07 16:43:47 +0000732.. method:: somenamedtuple._replace(kwargs)
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000733
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000734 Return a new instance of the named tuple replacing specified fields with new
735 values:
Raymond Hettinger7268e9d2007-09-20 03:03:43 +0000736
737::
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000738
Raymond Hettingercbab5942007-09-18 22:18:02 +0000739 >>> p = Point(x=11, y=22)
Raymond Hettinger42da8742007-12-14 02:49:47 +0000740 >>> p._replace(x=33)
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000741 Point(x=33, y=22)
742
Raymond Hettinger7c3738e2007-11-15 03:16:09 +0000743 >>> for partnum, record in inventory.items():
Raymond Hettingere11230e2008-01-09 03:02:23 +0000744 ... inventory[partnum] = record._replace(price=newprices[partnum], timestamp=time.now())
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000745
Georg Brandlb3255ed2008-01-07 16:43:47 +0000746.. attribute:: somenamedtuple._fields
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000747
Raymond Hettingerf6b769b2008-01-07 21:33:51 +0000748 Tuple of strings listing the field names. Useful for introspection
Raymond Hettingera7fc4b12007-10-05 02:47:07 +0000749 and for creating new named tuple types from existing named tuples.
Raymond Hettinger7268e9d2007-09-20 03:03:43 +0000750
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000751.. doctest::
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000752
Raymond Hettinger42da8742007-12-14 02:49:47 +0000753 >>> p._fields # view the field names
Raymond Hettingercbab5942007-09-18 22:18:02 +0000754 ('x', 'y')
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000755
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000756 >>> Color = namedtuple('Color', 'red green blue')
Raymond Hettinger42da8742007-12-14 02:49:47 +0000757 >>> Pixel = namedtuple('Pixel', Point._fields + Color._fields)
Raymond Hettingercbab5942007-09-18 22:18:02 +0000758 >>> Pixel(11, 22, 128, 255, 0)
Raymond Hettingerdc1854d2008-01-09 03:13:20 +0000759 Pixel(x=11, y=22, red=128, green=255, blue=0)
Raymond Hettingerd36a60e2007-09-17 00:55:00 +0000760
Raymond Hettingere846f382007-12-14 21:51:50 +0000761To retrieve a field whose name is stored in a string, use the :func:`getattr`
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000762function:
Raymond Hettingere846f382007-12-14 21:51:50 +0000763
764 >>> getattr(p, 'x')
765 11
766
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000767To convert a dictionary to a named tuple, use the double-star-operator [#]_:
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000768
769 >>> d = {'x': 11, 'y': 22}
770 >>> Point(**d)
771 Point(x=11, y=22)
772
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000773Since a named tuple is a regular Python class, it is easy to add or change
Raymond Hettingerb8e00722008-01-07 04:24:49 +0000774functionality with a subclass. Here is how to add a calculated field and
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000775a fixed-width print format:
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000776
Raymond Hettingerb8e00722008-01-07 04:24:49 +0000777 >>> class Point(namedtuple('Point', 'x y')):
Raymond Hettingere1655082008-01-10 19:15:10 +0000778 ... __slots__ = ()
Raymond Hettingere11230e2008-01-09 03:02:23 +0000779 ... @property
780 ... def hypot(self):
781 ... return (self.x ** 2 + self.y ** 2) ** 0.5
782 ... def __str__(self):
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000783 ... return 'Point: x=%6.3f y=%6.3f hypot=%6.3f' % (self.x, self.y, self.hypot)
Raymond Hettingerb8e00722008-01-07 04:24:49 +0000784
Raymond Hettingere1655082008-01-10 19:15:10 +0000785 >>> for p in Point(3, 4), Point(14, 5/7.):
Raymond Hettingere11230e2008-01-09 03:02:23 +0000786 ... print p
Raymond Hettinger15b5e552008-01-10 23:00:01 +0000787 Point: x= 3.000 y= 4.000 hypot= 5.000
788 Point: x=14.000 y= 0.714 hypot=14.018
Raymond Hettingereeeb9c42007-11-15 02:44:53 +0000789
Raymond Hettinger9bba7b72008-01-27 10:47:55 +0000790The subclass shown above sets ``__slots__`` to an empty tuple. This keeps
Raymond Hettinger171f3912008-01-16 23:38:16 +0000791keep memory requirements low by preventing the creation of instance dictionaries.
Raymond Hettingerf59e9622008-01-15 20:52:42 +0000792
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000793Subclassing is not useful for adding new, stored fields. Instead, simply
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000794create a new named tuple type from the :attr:`_fields` attribute:
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000795
Raymond Hettingere850c462008-01-10 20:37:12 +0000796 >>> Point3D = namedtuple('Point3D', Point._fields + ('z',))
Raymond Hettingerac5742e2008-01-08 02:24:15 +0000797
Raymond Hettingerfb3ced62008-01-07 20:17:35 +0000798Default values can be implemented by using :meth:`_replace` to
Georg Brandl4c8bbe62008-03-22 21:06:20 +0000799customize a prototype instance:
Raymond Hettingerbc693492007-11-15 22:39:34 +0000800
801 >>> Account = namedtuple('Account', 'owner balance transaction_count')
Raymond Hettinger0fe6ca42008-01-18 21:14:58 +0000802 >>> default_account = Account('<owner name>', 0.0, 0)
803 >>> johns_account = default_account._replace(owner='John')
Raymond Hettingerbc693492007-11-15 22:39:34 +0000804
Raymond Hettinger5a9fed72008-05-08 07:23:30 +0000805Enumerated constants can be implemented with named tuples, but it is simpler
806and more efficient to use a simple class declaration:
807
808 >>> Status = namedtuple('Status', 'open pending closed')._make(range(3))
809 >>> Status.open, Status.pending, Status.closed
810 (0, 1, 2)
811 >>> class Status:
812 ... open, pending, closed = range(3)
813
Mark Summerfield7f626f42007-08-30 15:03:03 +0000814.. rubric:: Footnotes
815
Raymond Hettinger85dfcf32007-12-18 23:51:15 +0000816.. [#] For information on the double-star-operator see
Mark Summerfield7f626f42007-08-30 15:03:03 +0000817 :ref:`tut-unpacking-arguments` and :ref:`calls`.