blob: c5239a4f2c953e398bc4ca7ba2dff5ff82ab9880 [file] [log] [blame]
Raymond Hettinger584cb192002-08-23 15:18:38 +00001\section{\module{sets} ---
2 Unordered collections of unique elements}
3
4\declaremodule{standard}{sets}
5\modulesynopsis{Implementation of sets of unique elements.}
6\moduleauthor{Greg V. Wilson}{gvwilson@nevex.com}
7\moduleauthor{Alex Martelli}{aleax@aleax.it}
8\moduleauthor{Guido van Rossum}{guido@python.org}
9\sectionauthor{Raymond D. Hettinger}{python@rcn.com}
10
11\versionadded{2.3}
12
13The \module{sets} module provides classes for constructing and manipulating
14unordered collections of unique elements. Common uses include membership
15testing, removing duplicates from a sequence, and computing standard math
16operations on sets such as intersection, union, difference, and symmetric
17difference.
18
Fred Draked10c6c92002-08-23 17:22:36 +000019Like other collections, sets support \code{\var{x} in \var{set}},
20\code{len(\var{set})}, and \code{for \var{x} in \var{set}}. Being an
21unordered collection, sets do not record element position or order of
22insertion. Accordingly, sets do not support indexing, slicing, or
23other sequence-like behavior.
Raymond Hettinger584cb192002-08-23 15:18:38 +000024
25Most set applications use the \class{Set} class which provides every set
26method except for \method{__hash__()}. For advanced applications requiring
27a hash method, the \class{ImmutableSet} class adds a \method{__hash__()}
28method but omits methods which alter the contents of the set. Both
29\class{Set} and \class{ImmutableSet} derive from \class{BaseSet}, an
30abstract class useful for determining whether something is a set:
Fred Draked10c6c92002-08-23 17:22:36 +000031\code{isinstance(\var{obj}, BaseSet)}.
Raymond Hettinger584cb192002-08-23 15:18:38 +000032
Fred Draked10c6c92002-08-23 17:22:36 +000033The set classes are implemented using dictionaries. As a result, sets
34cannot contain mutable elements such as lists or dictionaries.
35However, they can contain immutable collections such as tuples or
Raymond Hettingerfa8dd5f2002-08-23 18:10:54 +000036instances of \class{ImmutableSet}. For convenience in implementing
Fred Draked10c6c92002-08-23 17:22:36 +000037sets of sets, inner sets are automatically converted to immutable
38form, for example, \code{Set([Set(['dog'])])} is transformed to
Raymond Hettinger584cb192002-08-23 15:18:38 +000039\code{Set([ImmutableSet(['dog'])])}.
40
41\begin{classdesc}{Set}{\optional{iterable}}
42Constructs a new empty \class{Set} object. If the optional \var{iterable}
43parameter is supplied, updates the set with elements obtained from iteration.
44All of the elements in \var{iterable} should be immutable or be transformable
Fred Draked10c6c92002-08-23 17:22:36 +000045to an immutable using the protocol described in
46section~\ref{immutable-transforms}.
Raymond Hettinger584cb192002-08-23 15:18:38 +000047\end{classdesc}
48
49\begin{classdesc}{ImmutableSet}{\optional{iterable}}
50Constructs a new empty \class{ImmutableSet} object. If the optional
51\var{iterable} parameter is supplied, updates the set with elements obtained
52from iteration. All of the elements in \var{iterable} should be immutable or
Fred Draked10c6c92002-08-23 17:22:36 +000053be transformable to an immutable using the protocol described in
54section~\ref{immutable-transforms}.
Raymond Hettinger584cb192002-08-23 15:18:38 +000055
56Because \class{ImmutableSet} objects provide a \method{__hash__()} method,
57they can be used as set elements or as dictionary keys. \class{ImmutableSet}
58objects do not have methods for adding or removing elements, so all of the
59elements must be known when the constructor is called.
60\end{classdesc}
61
62
Fred Draked10c6c92002-08-23 17:22:36 +000063\subsection{Set Objects}
Raymond Hettinger584cb192002-08-23 15:18:38 +000064
65Instances of \class{Set} and \class{ImmutableSet} both provide
66the following operations:
67
Fred Draked10c6c92002-08-23 17:22:36 +000068\begin{tableii}{c|l}{code}{Operation}{Result}
69 \lineii{len(\var{s})}{cardinality of set \var{s}}
Raymond Hettinger584cb192002-08-23 15:18:38 +000070
71 \hline
Fred Draked10c6c92002-08-23 17:22:36 +000072 \lineii{\var{x} in \var{s}}
73 {test \var{x} for membership in \var{s}}
74 \lineii{\var{x} not in \var{s}}
75 {test \var{x} for non-membership in \var{s}}
76 \lineii{\var{s}.issubset(\var{t})}
Tim Petersea76c982002-08-25 18:43:10 +000077 {test whether every element in \var{s} is in \var{t};
78 \code{\var{s} <= \var{t}} is equivalent}
Fred Draked10c6c92002-08-23 17:22:36 +000079 \lineii{\var{s}.issuperset(\var{t})}
Tim Petersea76c982002-08-25 18:43:10 +000080 {test whether every element in \var{t} is in \var{s};
81 \code{\var{s} >= \var{t}} is equivalent}
Raymond Hettinger584cb192002-08-23 15:18:38 +000082
83 \hline
Fred Draked10c6c92002-08-23 17:22:36 +000084 \lineii{\var{s} | \var{t}}
85 {new set with elements from both \var{s} and \var{t}}
86 \lineii{\var{s}.union(\var{t})}
87 {new set with elements from both \var{s} and \var{t}}
88 \lineii{\var{s} \&\ \var{t}}
89 {new set with elements common to \var{s} and \var{t}}
90 \lineii{\var{s}.intersection(\var{t})}
91 {new set with elements common to \var{s} and \var{t}}
92 \lineii{\var{s} - \var{t}}
93 {new set with elements in \var{s} but not in \var{t}}
94 \lineii{\var{s}.difference(\var{t})}
95 {new set with elements in \var{s} but not in \var{t}}
96 \lineii{\var{s} \textasciicircum\ \var{t}}
97 {new set with elements in either \var{s} or \var{t} but not both}
98 \lineii{\var{s}.symmetric_difference(\var{t})}
99 {new set with elements in either \var{s} or \var{t} but not both}
100 \lineii{\var{s}.copy()}
101 {new set with a shallow copy of \var{s}}
102\end{tableii}
Raymond Hettinger584cb192002-08-23 15:18:38 +0000103
Tim Petersea76c982002-08-25 18:43:10 +0000104In addition, both \class{Set} and \class{ImmutableSet}
105support set to set comparisons. Two sets are equal if and only if
106every element of each set is contained in the other (each is a subset
107of the other).
108A set is less than another set if and only if the first set is a proper
109subset of the second set (is a subset, but is not equal).
110A set is greater than another set if and only if the first set is a proper
111superset of the second set (is a superset, but is not equal).
Raymond Hettinger584cb192002-08-23 15:18:38 +0000112
113The following table lists operations available in \class{ImmutableSet}
114but not found in \class{Set}:
115
Fred Draked10c6c92002-08-23 17:22:36 +0000116\begin{tableii}{c|l|c}{code}{Operation}{Result}
117 \lineii{hash(\var{s})}{returns a hash value for \var{s}}
118\end{tableii}
Raymond Hettinger584cb192002-08-23 15:18:38 +0000119
120The following table lists operations available in \class{Set}
121but not found in \class{ImmutableSet}:
122
Fred Draked10c6c92002-08-23 17:22:36 +0000123\begin{tableii}{c|l}{code}{Operation}{Result}
124 \lineii{\var{s} |= \var{t}}
125 {return set \var{s} with elements added from \var{t}}
126 \lineii{\var{s}.union_update(\var{t})}
127 {return set \var{s} with elements added from \var{t}}
128 \lineii{\var{s} \&= \var{t}}
129 {return set \var{s} keeping only elements also found in \var{t}}
130 \lineii{\var{s}.intersection_update(\var{t})}
131 {return set \var{s} keeping only elements also found in \var{t}}
132 \lineii{\var{s} -= \var{t}}
133 {return set \var{s} after removing elements found in \var{t}}
134 \lineii{\var{s}.difference_update(\var{t})}
135 {return set \var{s} after removing elements found in \var{t}}
136 \lineii{\var{s} \textasciicircum= \var{t}}
137 {return set \var{s} with elements from \var{s} or \var{t}
138 but not both}
139 \lineii{\var{s}.symmetric_difference_update(\var{t})}
140 {return set \var{s} with elements from \var{s} or \var{t}
141 but not both}
Raymond Hettinger584cb192002-08-23 15:18:38 +0000142
143 \hline
Fred Draked10c6c92002-08-23 17:22:36 +0000144 \lineii{\var{s}.add(\var{x})}
145 {Add element \var{x} to set \var{s}}
146 \lineii{\var{s}.remove(\var{x})}
147 {Remove element \var{x} from set \var{s}}
148 \lineii{\var{s}.discard(\var{x})}
Raymond Hettingerfa8dd5f2002-08-23 18:10:54 +0000149 {Removes element \var{x} from set \var{s}. Like \var{s}.remove(\var{x})
150 but does not raise KeyError if \var{x} is not in \var{s}}
Fred Draked10c6c92002-08-23 17:22:36 +0000151 \lineii{\var{s}.pop()}
Tim Peters54fd3e62002-08-23 17:45:43 +0000152 {Remove and return an element from \var{s}; no guarantee is
153 made about which element is removed}
Fred Draked10c6c92002-08-23 17:22:36 +0000154 \lineii{\var{s}.update(\var{t})}
155 {Add elements from \var{t} to set \var{s}}
156 \lineii{\var{s}.clear()}
157 {Remove all elements from set \var{s}}
158\end{tableii}
Raymond Hettinger584cb192002-08-23 15:18:38 +0000159
160
161\subsection{Example}
162
163\begin{verbatim}
164>>> from sets import Set
165>>> engineers = Set(['John', 'Jane', 'Jack', 'Janice'])
166>>> programmers = Set(['Jack', 'Sam', 'Susan', 'Janice'])
167>>> management = Set(['Jane', 'Jack', 'Susan', 'Zack'])
168>>> employees = engineers | programmers | management # union
169>>> engineering_management = engineers & programmers # intersection
170>>> fulltime_management = management - engineers - programmers # difference
171>>> engineers.add('Marvin') # add element
172>>> print engineers
173Set(['Jane', 'Marvin', 'Janice', 'John', 'Jack'])
174>>> employees.issuperset(engineers) # superset test
175False
176>>> employees.update(engineers) # update from another set
177>>> employees.issuperset(engineers)
178True
179>>> for group in [engineers, programmers, management, employees]:
180 group.discard('Susan') # unconditionally remove element
181 print group
182
183Set(['Jane', 'Marvin', 'Janice', 'John', 'Jack'])
184Set(['Janice', 'Jack', 'Sam'])
185Set(['Jane', 'Zack', 'Jack'])
186Set(['Jack', 'Sam', 'Jane', 'Marvin', 'Janice', 'John', 'Zack'])
187\end{verbatim}
188
189
190\subsection{Protocol for automatic conversion to immutable
191 \label{immutable-transforms}}
192
193Sets can only contain immutable elements. For convenience, mutable
194\class{Set} objects are automatically copied to an \class{ImmutableSet}
195before being added as a set element.
196
Fred Draked10c6c92002-08-23 17:22:36 +0000197The mechanism is to always add a hashable element, or if it is not
198hashable, the element is checked to see if it has an
199\method{_as_immutable()} method which returns an immutable equivalent.
Raymond Hettinger584cb192002-08-23 15:18:38 +0000200
201Since \class{Set} objects have a \method{_as_immutable()} method
202returning an instance of \class{ImmutableSet}, it is possible to
203construct sets of sets.
204
205A similar mechanism is needed by the \method{__contains__()} and
206\method{remove()} methods which need to hash an element to check
207for membership in a set. Those methods check an element for hashability
Tim Petersb81b2522002-08-23 17:48:23 +0000208and, if not, check for a \method{_as_temporarily_immutable()} method
Raymond Hettinger584cb192002-08-23 15:18:38 +0000209which returns the element wrapped by a class that provides temporary
210methods for \method{__hash__()}, \method{__eq__()}, and \method{__ne__()}.
211
212The alternate mechanism spares the need to build a separate copy of
213the original mutable object.
214
Tim Petersb81b2522002-08-23 17:48:23 +0000215\class{Set} objects implement the \method{_as_temporarily_immutable()}
Fred Draked10c6c92002-08-23 17:22:36 +0000216method which returns the \class{Set} object wrapped by a new class
Raymond Hettinger584cb192002-08-23 15:18:38 +0000217\class{_TemporarilyImmutableSet}.
218
219The two mechanisms for adding hashability are normally invisible to the
220user; however, a conflict can arise in a multi-threaded environment
Raymond Hettingerfa8dd5f2002-08-23 18:10:54 +0000221where one thread is updating a set while another has temporarily wrapped it
Raymond Hettinger584cb192002-08-23 15:18:38 +0000222in \class{_TemporarilyImmutableSet}. In other words, sets of mutable sets
223are not thread-safe.