blob: aa188140c4830b95e955b6c8aea33bccfb6a40f6 [file] [log] [blame]
Fred Drake295da241998-08-10 19:42:37 +00001\section{\module{re} ---
Fred Drake062ea2e2000-10-06 19:59:22 +00002 Regular expression operations}
Fred Drake66da9d61998-08-07 18:57:18 +00003\declaremodule{standard}{re}
Andrew M. Kuchlingaf5b7662000-06-27 03:16:04 +00004\moduleauthor{Andrew M. Kuchling}{amk1@bigfoot.com}
Fred Drake062ea2e2000-10-06 19:59:22 +00005\moduleauthor{Fredrik Lundh}{effbot@telia.com}
Andrew M. Kuchlingaf5b7662000-06-27 03:16:04 +00006\sectionauthor{Andrew M. Kuchling}{amk1@bigfoot.com}
Guido van Rossum1acceb01997-08-14 23:12:18 +00007
Fred Drakeb91e9341998-07-23 17:59:49 +00008
Fred Drake062ea2e2000-10-06 19:59:22 +00009\modulesynopsis{Regular expression search and match operations with a
10 Perl-style expression syntax.}
Fred Drakeb91e9341998-07-23 17:59:49 +000011
Guido van Rossum1acceb01997-08-14 23:12:18 +000012
Guido van Rossum1acceb01997-08-14 23:12:18 +000013This module provides regular expression matching operations similar to
Fred Drake062ea2e2000-10-06 19:59:22 +000014those found in Perl. Regular expression pattern strings may not
15contain null bytes, but can specify the null byte using the
16\code{\e\var{number}} notation. Both patterns and strings to be
17searched can be Unicode strings as well as 8-bit strings. The
18\module{re} module is always available.
Guido van Rossum1acceb01997-08-14 23:12:18 +000019
Andrew M. Kuchling25332811998-04-09 14:56:04 +000020Regular expressions use the backslash character (\character{\e}) to
Guido van Rossum1acceb01997-08-14 23:12:18 +000021indicate special forms or to allow special characters to be used
22without invoking their special meaning. This collides with Python's
23usage of the same character for the same purpose in string literals;
24for example, to match a literal backslash, one might have to write
Andrew M. Kuchling25332811998-04-09 14:56:04 +000025\code{'\e\e\e\e'} as the pattern string, because the regular expression
Fred Drake20e01961998-02-19 15:09:35 +000026must be \samp{\e\e}, and each backslash must be expressed as
27\samp{\e\e} inside a regular Python string literal.
Guido van Rossum1acceb01997-08-14 23:12:18 +000028
29The solution is to use Python's raw string notation for regular
30expression patterns; backslashes are not handled in any special way in
Andrew M. Kuchling25332811998-04-09 14:56:04 +000031a string literal prefixed with \character{r}. So \code{r"\e n"} is a
32two-character string containing \character{\e} and \character{n},
33while \code{"\e n"} is a one-character string containing a newline.
34Usually patterns will be expressed in Python code using this raw
35string notation.
Guido van Rossum1acceb01997-08-14 23:12:18 +000036
Fred Drake062ea2e2000-10-06 19:59:22 +000037\strong{Implementation note:}
38The \module{re}\refstmodindex{pre} module has two distinct
39implementations: \module{sre} is the default implementation and
40includes Unicode support, but may run into stack limitations for some
41patterns. Though this will be fixed for a future release of Python,
42the older implementation (without Unicode support) is still available
43as the \module{pre}\refstmodindex{pre} module.
44
45
Fred Drakee20bd192001-04-12 16:47:17 +000046\begin{seealso}
47 \seetitle{Mastering Regular Expressions}{Book on regular expressions
48 by Jeffrey Friedl, published by O'Reilly. The Python
49 material in this book dates from before the \refmodule{re}
50 module, but it covers writing good regular expression
51 patterns in great detail.}
52\end{seealso}
53
54
Fred Draked16d4981998-09-10 20:21:00 +000055\subsection{Regular Expression Syntax \label{re-syntax}}
Guido van Rossum1acceb01997-08-14 23:12:18 +000056
57A regular expression (or RE) specifies a set of strings that matches
58it; the functions in this module let you check if a particular string
59matches a given regular expression (or if a given regular expression
60matches a particular string, which comes down to the same thing).
61
62Regular expressions can be concatenated to form new regular
63expressions; if \emph{A} and \emph{B} are both regular expressions,
Fred Drake51629c22001-08-02 20:52:00 +000064then \emph{AB} is also a regular expression. If a string \emph{p}
Guido van Rossum1acceb01997-08-14 23:12:18 +000065matches A and another string \emph{q} matches B, the string \emph{pq}
Fred Drake51629c22001-08-02 20:52:00 +000066will match AB if \emph{A} and \emph{B} do no specify boundary
67conditions that are no longer satisfied by \emph{pq}. Thus, complex
68expressions can easily be constructed from simpler primitive
69expressions like the ones described here. For details of the theory
70and implementation of regular expressions, consult the Friedl book
71referenced below, or almost any textbook about compiler construction.
Guido van Rossum1acceb01997-08-14 23:12:18 +000072
Andrew M. Kuchlingc1cea201998-10-28 15:44:14 +000073A brief explanation of the format of regular expressions follows. For
74further information and a gentler presentation, consult the Regular
75Expression HOWTO, accessible from \url{http://www.python.org/doc/howto/}.
Guido van Rossum1acceb01997-08-14 23:12:18 +000076
77Regular expressions can contain both special and ordinary characters.
Fred Drakef4bdb572001-07-12 14:13:43 +000078Most ordinary characters, like \character{A}, \character{a}, or
79\character{0}, are the simplest regular expressions; they simply match
80themselves. You can concatenate ordinary characters, so \regexp{last}
81matches the string \code{'last'}. (In the rest of this section, we'll
82write RE's in \regexp{this special style}, usually without quotes, and
83strings to be matched \code{'in single quotes'}.)
Guido van Rossum1acceb01997-08-14 23:12:18 +000084
Fred Drakef4bdb572001-07-12 14:13:43 +000085Some characters, like \character{|} or \character{(}, are special.
86Special characters either stand for classes of ordinary characters, or
87affect how the regular expressions around them are interpreted.
Guido van Rossum1acceb01997-08-14 23:12:18 +000088
89The special characters are:
Fred Draked16d4981998-09-10 20:21:00 +000090
Fred Drake1e270f01998-11-30 22:58:12 +000091\begin{list}{}{\leftmargin 0.7in \labelwidth 0.65in}
Fred Draked16d4981998-09-10 20:21:00 +000092
Andrew M. Kuchling25332811998-04-09 14:56:04 +000093\item[\character{.}] (Dot.) In the default mode, this matches any
Fred Drake20e01961998-02-19 15:09:35 +000094character except a newline. If the \constant{DOTALL} flag has been
Guido van Rossum1acceb01997-08-14 23:12:18 +000095specified, this matches any character including a newline.
Fred Draked16d4981998-09-10 20:21:00 +000096
Andrew M. Kuchling25332811998-04-09 14:56:04 +000097\item[\character{\^}] (Caret.) Matches the start of the string, and in
98\constant{MULTILINE} mode also matches immediately after each newline.
Fred Draked16d4981998-09-10 20:21:00 +000099
Fred Drakec547b462001-07-23 21:14:59 +0000100\item[\character{\$}] Matches the end of the string or just before the
101newline at the end of the string, and in \constant{MULTILINE} mode
102also matches before a newline. \regexp{foo} matches both 'foo' and
103'foobar', while the regular expression \regexp{foo\$} matches only
104'foo'. More interestingly, searching for \regexp{foo\e d} in
105'foo1\textbackslash nfoo2\textbackslash n' matches 'foo2' normally,
106but 'foo1' in \constant{MULTILINE} mode.
Fred Draked16d4981998-09-10 20:21:00 +0000107
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000108\item[\character{*}] Causes the resulting RE to
Guido van Rossum1acceb01997-08-14 23:12:18 +0000109match 0 or more repetitions of the preceding RE, as many repetitions
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000110as are possible. \regexp{ab*} will
Guido van Rossum1acceb01997-08-14 23:12:18 +0000111match 'a', 'ab', or 'a' followed by any number of 'b's.
Fred Draked16d4981998-09-10 20:21:00 +0000112
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000113\item[\character{+}] Causes the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000114resulting RE to match 1 or more repetitions of the preceding RE.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000115\regexp{ab+} will match 'a' followed by any non-zero number of 'b's; it
Guido van Rossum1acceb01997-08-14 23:12:18 +0000116will not match just 'a'.
Fred Draked16d4981998-09-10 20:21:00 +0000117
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000118\item[\character{?}] Causes the resulting RE to
119match 0 or 1 repetitions of the preceding RE. \regexp{ab?} will
Guido van Rossum1acceb01997-08-14 23:12:18 +0000120match either 'a' or 'ab'.
Fred Drakef4bdb572001-07-12 14:13:43 +0000121
122\item[\code{*?}, \code{+?}, \code{??}] The \character{*},
123\character{+}, and \character{?} qualifiers are all \dfn{greedy}; they
124match as much text as possible. Sometimes this behaviour isn't
125desired; if the RE \regexp{<.*>} is matched against
126\code{'<H1>title</H1>'}, it will match the entire string, and not just
127\code{'<H1>'}. Adding \character{?} after the qualifier makes it
128perform the match in \dfn{non-greedy} or \dfn{minimal} fashion; as
129\emph{few} characters as possible will be matched. Using \regexp{.*?}
130in the previous expression will match only \code{'<H1>'}.
Fred Draked16d4981998-09-10 20:21:00 +0000131
Fred Drakee74f8de2001-08-01 16:56:51 +0000132\item[\code{\{\var{m}\}}]
133Specifies that exactly \var{m} copies of the previous RE should be
134matched; fewer matches cause the entire RE not to match. For example,
135\regexp{a\{6\}} will match exactly six \character{a} characters, but
136not five.
137
Guido van Rossum0148bbf1997-12-22 22:41:40 +0000138\item[\code{\{\var{m},\var{n}\}}] Causes the resulting RE to match from
139\var{m} to \var{n} repetitions of the preceding RE, attempting to
Andrew M. Kuchlingc1cea201998-10-28 15:44:14 +0000140match as many repetitions as possible. For example, \regexp{a\{3,5\}}
141will match from 3 to 5 \character{a} characters. Omitting \var{n}
Fred Drake51629c22001-08-02 20:52:00 +0000142specifies an infinite upper bound; you can't omit \var{m}. As an
143example, \regexp{a\{4,\}b} will match \code{aaaab}, a thousand
144\character{a} characters followed by a \code{b}, but not \code{aaab}.
145The comma may not be omitted or the modifier would be confused with
146the previously described form.
Fred Draked16d4981998-09-10 20:21:00 +0000147
Guido van Rossum0148bbf1997-12-22 22:41:40 +0000148\item[\code{\{\var{m},\var{n}\}?}] Causes the resulting RE to
149match from \var{m} to \var{n} repetitions of the preceding RE,
150attempting to match as \emph{few} repetitions as possible. This is
151the non-greedy version of the previous qualifier. For example, on the
Fred Draked16d4981998-09-10 20:21:00 +00001526-character string \code{'aaaaaa'}, \regexp{a\{3,5\}} will match 5
153\character{a} characters, while \regexp{a\{3,5\}?} will only match 3
154characters.
155
156\item[\character{\e}] Either escapes special characters (permitting
157you to match characters like \character{*}, \character{?}, and so
158forth), or signals a special sequence; special sequences are discussed
159below.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000160
161If you're not using a raw string to
162express the pattern, remember that Python also uses the
163backslash as an escape sequence in string literals; if the escape
164sequence isn't recognized by Python's parser, the backslash and
165subsequent character are included in the resulting string. However,
166if Python would recognize the resulting sequence, the backslash should
Fred Drake023f87f1998-01-12 19:16:24 +0000167be repeated twice. This is complicated and hard to understand, so
168it's highly recommended that you use raw strings for all but the
169simplest expressions.
Fred Draked16d4981998-09-10 20:21:00 +0000170
Guido van Rossum1acceb01997-08-14 23:12:18 +0000171\item[\code{[]}] Used to indicate a set of characters. Characters can
Guido van Rossum48d04371997-12-11 20:19:08 +0000172be listed individually, or a range of characters can be indicated by
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000173giving two characters and separating them by a \character{-}. Special
174characters are not active inside sets. For example, \regexp{[akm\$]}
Fred Drake76547c51998-04-03 05:59:05 +0000175will match any of the characters \character{a}, \character{k},
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000176\character{m}, or \character{\$}; \regexp{[a-z]}
177will match any lowercase letter, and \code{[a-zA-Z0-9]} matches any
Fred Drake1e270f01998-11-30 22:58:12 +0000178letter or digit. Character classes such as \code{\e w} or \code{\e S}
179(defined below) are also acceptable inside a range. If you want to
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000180include a \character{]} or a \character{-} inside a set, precede it with a
181backslash, or place it as the first character. The
182pattern \regexp{[]]} will match \code{']'}, for example.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000183
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000184You can match the characters not within a range by \dfn{complementing}
Fred Drakef4bdb572001-07-12 14:13:43 +0000185the set. This is indicated by including a \character{\^} as the first
186character of the set; \character{\^} elsewhere will simply match the
187\character{\^} character. For example, \regexp{[{\^}5]} will match
188any character except \character{5}.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000189
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000190\item[\character{|}]\code{A|B}, where A and B can be arbitrary REs,
Fred Drake062ea2e2000-10-06 19:59:22 +0000191creates a regular expression that will match either A or B. An
192arbitrary number of REs can be separated by the \character{|} in this
193way. This can be used inside groups (see below) as well. REs
194separated by \character{|} are tried from left to right, and the first
195one that allows the complete pattern to match is considered the
196accepted branch. This means that if \code{A} matches, \code{B} will
197never be tested, even if it would produce a longer overall match. In
198other words, the \character{|} operator is never greedy. To match a
199literal \character{|}, use \regexp{\e|}, or enclose it inside a
200character class, as in \regexp{[|]}.
Fred Draked16d4981998-09-10 20:21:00 +0000201
Guido van Rossum48d04371997-12-11 20:19:08 +0000202\item[\code{(...)}] Matches whatever regular expression is inside the
203parentheses, and indicates the start and end of a group; the contents
204of a group can be retrieved after a match has been performed, and can
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000205be matched later in the string with the \regexp{\e \var{number}} special
Fred Draked16d4981998-09-10 20:21:00 +0000206sequence, described below. To match the literals \character{(} or
Fred Drake2c4f5542000-10-10 22:00:03 +0000207\character{)}, use \regexp{\e(} or \regexp{\e)}, or enclose them
Fred Draked16d4981998-09-10 20:21:00 +0000208inside a character class: \regexp{[(] [)]}.
209
210\item[\code{(?...)}] This is an extension notation (a \character{?}
211following a \character{(} is not meaningful otherwise). The first
212character after the \character{?}
Guido van Rossum0b334101997-12-08 17:33:40 +0000213determines what the meaning and further syntax of the construct is.
Guido van Rossume9625e81998-04-02 01:32:24 +0000214Extensions usually do not create a new group;
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000215\regexp{(?P<\var{name}>...)} is the only exception to this rule.
Guido van Rossum0b334101997-12-08 17:33:40 +0000216Following are the currently supported extensions.
Fred Draked16d4981998-09-10 20:21:00 +0000217
Fred Drakee53793b2000-09-25 17:52:40 +0000218\item[\code{(?iLmsux)}] (One or more letters from the set \character{i},
219\character{L}, \character{m}, \character{s}, \character{u},
220\character{x}.) The group matches the empty string; the letters set
221the corresponding flags (\constant{re.I}, \constant{re.L},
222\constant{re.M}, \constant{re.S}, \constant{re.U}, \constant{re.X})
223for the entire regular expression. This is useful if you wish to
224include the flags as part of the regular expression, instead of
225passing a \var{flag} argument to the \function{compile()} function.
Fred Draked16d4981998-09-10 20:21:00 +0000226
Fred Drake062ea2e2000-10-06 19:59:22 +0000227Note that the \regexp{(?x)} flag changes how the expression is parsed.
228It should be used first in the expression string, or after one or more
229whitespace characters. If there are non-whitespace characters before
230the flag, the results are undefined.
231
Guido van Rossum1acceb01997-08-14 23:12:18 +0000232\item[\code{(?:...)}] A non-grouping version of regular parentheses.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000233Matches whatever regular expression is inside the parentheses, but the
234substring matched by the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000235group \emph{cannot} be retrieved after performing a match or
236referenced later in the pattern.
Fred Draked16d4981998-09-10 20:21:00 +0000237
Guido van Rossum1acceb01997-08-14 23:12:18 +0000238\item[\code{(?P<\var{name}>...)}] Similar to regular parentheses, but
Guido van Rossume9625e81998-04-02 01:32:24 +0000239the substring matched by the group is accessible via the symbolic group
Guido van Rossum1acceb01997-08-14 23:12:18 +0000240name \var{name}. Group names must be valid Python identifiers. A
241symbolic group is also a numbered group, just as if the group were not
242named. So the group named 'id' in the example above can also be
243referenced as the numbered group 1.
244
Guido van Rossum48d04371997-12-11 20:19:08 +0000245For example, if the pattern is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000246\regexp{(?P<id>[a-zA-Z_]\e w*)}, the group can be referenced by its
Fred Drake907e76b2001-07-06 20:30:11 +0000247name in arguments to methods of match objects, such as
248\code{m.group('id')} or \code{m.end('id')}, and also by name in
249pattern text (for example, \regexp{(?P=id)}) and replacement text
250(such as \code{\e g<id>}).
Fred Draked16d4981998-09-10 20:21:00 +0000251
Fred Drake023f87f1998-01-12 19:16:24 +0000252\item[\code{(?P=\var{name})}] Matches whatever text was matched by the
253earlier group named \var{name}.
Fred Draked16d4981998-09-10 20:21:00 +0000254
Fred Drake023f87f1998-01-12 19:16:24 +0000255\item[\code{(?\#...)}] A comment; the contents of the parentheses are
256simply ignored.
Fred Draked16d4981998-09-10 20:21:00 +0000257
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000258\item[\code{(?=...)}] Matches if \regexp{...} matches next, but doesn't
Fred Drake023f87f1998-01-12 19:16:24 +0000259consume any of the string. This is called a lookahead assertion. For
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000260example, \regexp{Isaac (?=Asimov)} will match \code{'Isaac~'} only if it's
261followed by \code{'Asimov'}.
Fred Draked16d4981998-09-10 20:21:00 +0000262
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000263\item[\code{(?!...)}] Matches if \regexp{...} doesn't match next. This
Fred Drake023f87f1998-01-12 19:16:24 +0000264is a negative lookahead assertion. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000265\regexp{Isaac (?!Asimov)} will match \code{'Isaac~'} only if it's \emph{not}
266followed by \code{'Asimov'}.
Guido van Rossum0b334101997-12-08 17:33:40 +0000267
Andrew M. Kuchling9351dd22000-10-05 15:22:28 +0000268\item[\code{(?<=...)}] Matches if the current position in the string
269is preceded by a match for \regexp{...} that ends at the current
270position. This is called a positive lookbehind assertion.
271\regexp{(?<=abc)def} will match \samp{abcdef}, since the lookbehind
272will back up 3 characters and check if the contained pattern matches.
273The contained pattern must only match strings of some fixed length,
274meaning that \regexp{abc} or \regexp{a|b} are allowed, but \regexp{a*}
275isn't.
276
277\item[\code{(?<!...)}] Matches if the current position in the string
278is not preceded by a match for \regexp{...}. This
279is called a negative lookbehind assertion. Similar to positive lookbehind
280assertions, the contained pattern must only match strings of some
281fixed length.
282
Fred Drake2705e801998-02-16 21:21:13 +0000283\end{list}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000284
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000285The special sequences consist of \character{\e} and a character from the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000286list below. If the ordinary character is not on the list, then the
287resulting RE will match the second character. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000288\regexp{\e\$} matches the character \character{\$}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000289
Fred Drake1e270f01998-11-30 22:58:12 +0000290\begin{list}{}{\leftmargin 0.7in \labelwidth 0.65in}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000291
Guido van Rossum1acceb01997-08-14 23:12:18 +0000292\item[\code{\e \var{number}}] Matches the contents of the group of the
Guido van Rossum0b334101997-12-08 17:33:40 +0000293same number. Groups are numbered starting from 1. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000294\regexp{(.+) \e 1} matches \code{'the the'} or \code{'55 55'}, but not
295\code{'the end'} (note
Guido van Rossum0b334101997-12-08 17:33:40 +0000296the space after the group). This special sequence can only be used to
297match one of the first 99 groups. If the first digit of \var{number}
298is 0, or \var{number} is 3 octal digits long, it will not be interpreted
299as a group match, but as the character with octal value \var{number}.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000300Inside the \character{[} and \character{]} of a character class, all numeric
Guido van Rossume9625e81998-04-02 01:32:24 +0000301escapes are treated as characters.
Fred Drakee53793b2000-09-25 17:52:40 +0000302
Guido van Rossum1acceb01997-08-14 23:12:18 +0000303\item[\code{\e A}] Matches only at the start of the string.
Fred Drakee53793b2000-09-25 17:52:40 +0000304
Guido van Rossum1acceb01997-08-14 23:12:18 +0000305\item[\code{\e b}] Matches the empty string, but only at the
306beginning or end of a word. A word is defined as a sequence of
307alphanumeric characters, so the end of a word is indicated by
Guido van Rossum48d04371997-12-11 20:19:08 +0000308whitespace or a non-alphanumeric character. Inside a character range,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000309\regexp{\e b} represents the backspace character, for compatibility with
Guido van Rossum48d04371997-12-11 20:19:08 +0000310Python's string literals.
Fred Drakee53793b2000-09-25 17:52:40 +0000311
Guido van Rossum0b334101997-12-08 17:33:40 +0000312\item[\code{\e B}] Matches the empty string, but only when it is
313\emph{not} at the beginning or end of a word.
Fred Drakee53793b2000-09-25 17:52:40 +0000314
Guido van Rossum1acceb01997-08-14 23:12:18 +0000315\item[\code{\e d}]Matches any decimal digit; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000316equivalent to the set \regexp{[0-9]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000317
Guido van Rossum1acceb01997-08-14 23:12:18 +0000318\item[\code{\e D}]Matches any non-digit character; this is
Fred Drakecd058531998-12-28 19:03:24 +0000319equivalent to the set \regexp{[{\^}0-9]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000320
Guido van Rossum1acceb01997-08-14 23:12:18 +0000321\item[\code{\e s}]Matches any whitespace character; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000322equivalent to the set \regexp{[ \e t\e n\e r\e f\e v]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000323
Guido van Rossum1acceb01997-08-14 23:12:18 +0000324\item[\code{\e S}]Matches any non-whitespace character; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000325equivalent to the set \regexp{[\^\ \e t\e n\e r\e f\e v]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000326
327\item[\code{\e w}]When the \constant{LOCALE} and \constant{UNICODE}
328flags are not specified,
Fred Drake023f87f1998-01-12 19:16:24 +0000329matches any alphanumeric character; this is equivalent to the set
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000330\regexp{[a-zA-Z0-9_]}. With \constant{LOCALE}, it will match the set
Fred Drakee53793b2000-09-25 17:52:40 +0000331\regexp{[0-9_]} plus whatever characters are defined as letters for
332the current locale. If \constant{UNICODE} is set, this will match the
333characters \regexp{[0-9_]} plus whatever is classified as alphanumeric
334in the Unicode character properties database.
335
336\item[\code{\e W}]When the \constant{LOCALE} and \constant{UNICODE}
337flags are not specified, matches any non-alphanumeric character; this
338is equivalent to the set \regexp{[{\^}a-zA-Z0-9_]}. With
339\constant{LOCALE}, it will match any character not in the set
340\regexp{[0-9_]}, and not defined as a letter for the current locale.
341If \constant{UNICODE} is set, this will match anything other than
342\regexp{[0-9_]} and characters marked at alphanumeric in the Unicode
343character properties database.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000344
345\item[\code{\e Z}]Matches only at the end of the string.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000346
347\item[\code{\e \e}] Matches a literal backslash.
348
Fred Drake2705e801998-02-16 21:21:13 +0000349\end{list}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000350
Fred Drake42de1851998-04-20 16:28:44 +0000351
Fred Drake768ac6b1998-12-22 18:19:45 +0000352\subsection{Matching vs. Searching \label{matching-searching}}
353\sectionauthor{Fred L. Drake, Jr.}{fdrake@acm.org}
354
Fred Drake768ac6b1998-12-22 18:19:45 +0000355Python offers two different primitive operations based on regular
356expressions: match and search. If you are accustomed to Perl's
357semantics, the search operation is what you're looking for. See the
358\function{search()} function and corresponding method of compiled
359regular expression objects.
360
361Note that match may differ from search using a regular expression
Fred Drake3d0971e1999-06-29 21:21:19 +0000362beginning with \character{\^}: \character{\^} matches only at the
363start of the string, or in \constant{MULTILINE} mode also immediately
364following a newline. The ``match'' operation succeeds only if the
365pattern matches at the start of the string regardless of mode, or at
366the starting position given by the optional \var{pos} argument
367regardless of whether a newline precedes it.
Fred Drake768ac6b1998-12-22 18:19:45 +0000368
369% Examples from Tim Peters:
370\begin{verbatim}
371re.compile("a").match("ba", 1) # succeeds
372re.compile("^a").search("ba", 1) # fails; 'a' not at start
373re.compile("^a").search("\na", 1) # fails; 'a' not at start
374re.compile("^a", re.M).search("\na", 1) # succeeds
375re.compile("^a", re.M).search("ba", 1) # fails; no preceding \n
376\end{verbatim}
377
378
Guido van Rossum1acceb01997-08-14 23:12:18 +0000379\subsection{Module Contents}
Fred Drake78f8e981997-12-29 21:39:39 +0000380\nodename{Contents of Module re}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000381
382The module defines the following functions and constants, and an exception:
383
Guido van Rossum1acceb01997-08-14 23:12:18 +0000384
Fred Drake013ad981998-03-08 07:38:27 +0000385\begin{funcdesc}{compile}{pattern\optional{, flags}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000386 Compile a regular expression pattern into a regular expression
Fred Drake20e01961998-02-19 15:09:35 +0000387 object, which can be used for matching using its \function{match()} and
388 \function{search()} methods, described below.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000389
Guido van Rossum0b334101997-12-08 17:33:40 +0000390 The expression's behaviour can be modified by specifying a
391 \var{flags} value. Values can be any of the following variables,
392 combined using bitwise OR (the \code{|} operator).
393
Fred Drake76547c51998-04-03 05:59:05 +0000394The sequence
395
396\begin{verbatim}
397prog = re.compile(pat)
398result = prog.match(str)
399\end{verbatim}
400
401is equivalent to
402
403\begin{verbatim}
404result = re.match(pat, str)
405\end{verbatim}
406
407but the version using \function{compile()} is more efficient when the
408expression will be used several times in a single program.
409%(The compiled version of the last pattern passed to
Fred Drake895aa9d2001-04-18 17:26:20 +0000410%\function{re.match()} or \function{re.search()} is cached, so
Fred Drake76547c51998-04-03 05:59:05 +0000411%programs that use only a single regular expression at a time needn't
412%worry about compiling regular expressions.)
413\end{funcdesc}
414
Fred Drake013ad981998-03-08 07:38:27 +0000415\begin{datadesc}{I}
416\dataline{IGNORECASE}
Fred Drakef4bdb572001-07-12 14:13:43 +0000417Perform case-insensitive matching; expressions like \regexp{[A-Z]}
418will match lowercase letters, too. This is not affected by the
419current locale.
Fred Drake013ad981998-03-08 07:38:27 +0000420\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000421
Fred Drake013ad981998-03-08 07:38:27 +0000422\begin{datadesc}{L}
423\dataline{LOCALE}
Fred Drakee53793b2000-09-25 17:52:40 +0000424Make \regexp{\e w}, \regexp{\e W}, \regexp{\e b}, and
425\regexp{\e B} dependent on the current locale.
Fred Drake013ad981998-03-08 07:38:27 +0000426\end{datadesc}
Guido van Rossuma42c1781997-12-09 20:41:47 +0000427
Fred Drake013ad981998-03-08 07:38:27 +0000428\begin{datadesc}{M}
429\dataline{MULTILINE}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000430When specified, the pattern character \character{\^} matches at the
Fred Drake023f87f1998-01-12 19:16:24 +0000431beginning of the string and at the beginning of each line
432(immediately following each newline); and the pattern character
Fred Drakef4bdb572001-07-12 14:13:43 +0000433\character{\$} matches at the end of the string and at the end of each
434line (immediately preceding each newline). By default, \character{\^}
435matches only at the beginning of the string, and \character{\$} only
436at the end of the string and immediately before the newline (if any)
437at the end of the string.
Fred Drake013ad981998-03-08 07:38:27 +0000438\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000439
Fred Drake013ad981998-03-08 07:38:27 +0000440\begin{datadesc}{S}
441\dataline{DOTALL}
Fred Drakee53793b2000-09-25 17:52:40 +0000442Make the \character{.} special character match any character at all,
443including a newline; without this flag, \character{.} will match
444anything \emph{except} a newline.
445\end{datadesc}
446
447\begin{datadesc}{U}
448\dataline{UNICODE}
449Make \regexp{\e w}, \regexp{\e W}, \regexp{\e b}, and
450\regexp{\e B} dependent on the Unicode character properties database.
451\versionadded{2.0}
Fred Drake013ad981998-03-08 07:38:27 +0000452\end{datadesc}
Guido van Rossum48d04371997-12-11 20:19:08 +0000453
Fred Drake013ad981998-03-08 07:38:27 +0000454\begin{datadesc}{X}
455\dataline{VERBOSE}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000456This flag allows you to write regular expressions that look nicer.
457Whitespace within the pattern is ignored,
Guido van Rossum48d04371997-12-11 20:19:08 +0000458except when in a character class or preceded by an unescaped
Fred Drakef4bdb572001-07-12 14:13:43 +0000459backslash, and, when a line contains a \character{\#} neither in a
460character class or preceded by an unescaped backslash, all characters
461from the leftmost such \character{\#} through the end of the line are
462ignored.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000463% XXX should add an example here
Fred Drake013ad981998-03-08 07:38:27 +0000464\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000465
Guido van Rossum0b334101997-12-08 17:33:40 +0000466
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000467\begin{funcdesc}{search}{pattern, string\optional{, flags}}
468 Scan through \var{string} looking for a location where the regular
469 expression \var{pattern} produces a match, and return a
470 corresponding \class{MatchObject} instance.
471 Return \code{None} if no
472 position in the string matches the pattern; note that this is
473 different from finding a zero-length match at some point in the string.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000474\end{funcdesc}
475
Fred Drake013ad981998-03-08 07:38:27 +0000476\begin{funcdesc}{match}{pattern, string\optional{, flags}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000477 If zero or more characters at the beginning of \var{string} match
478 the regular expression \var{pattern}, return a corresponding
Fred Drake20e01961998-02-19 15:09:35 +0000479 \class{MatchObject} instance. Return \code{None} if the string does not
Guido van Rossum1acceb01997-08-14 23:12:18 +0000480 match the pattern; note that this is different from a zero-length
481 match.
Fred Drake768ac6b1998-12-22 18:19:45 +0000482
483 \strong{Note:} If you want to locate a match anywhere in
484 \var{string}, use \method{search()} instead.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000485\end{funcdesc}
486
Fred Drake77a6c9e2000-09-07 14:00:51 +0000487\begin{funcdesc}{split}{pattern, string\optional{, maxsplit\code{ = 0}}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000488 Split \var{string} by the occurrences of \var{pattern}. If
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000489 capturing parentheses are used in \var{pattern}, then the text of all
490 groups in the pattern are also returned as part of the resulting list.
Guido van Rossum97546391998-01-12 18:58:53 +0000491 If \var{maxsplit} is nonzero, at most \var{maxsplit} splits
492 occur, and the remainder of the string is returned as the final
493 element of the list. (Incompatibility note: in the original Python
494 1.5 release, \var{maxsplit} was ignored. This has been fixed in
495 later releases.)
Fred Drake768ac6b1998-12-22 18:19:45 +0000496
Fred Drake19479911998-02-13 06:58:54 +0000497\begin{verbatim}
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000498>>> re.split('\W+', 'Words, words, words.')
Guido van Rossum1acceb01997-08-14 23:12:18 +0000499['Words', 'words', 'words', '']
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000500>>> re.split('(\W+)', 'Words, words, words.')
Guido van Rossum1acceb01997-08-14 23:12:18 +0000501['Words', ', ', 'words', ', ', 'words', '.', '']
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000502>>> re.split('\W+', 'Words, words, words.', 1)
Guido van Rossum97546391998-01-12 18:58:53 +0000503['Words', 'words, words.']
Fred Drake19479911998-02-13 06:58:54 +0000504\end{verbatim}
Fred Drake768ac6b1998-12-22 18:19:45 +0000505
Guido van Rossum1acceb01997-08-14 23:12:18 +0000506 This function combines and extends the functionality of
Fred Drake20e01961998-02-19 15:09:35 +0000507 the old \function{regsub.split()} and \function{regsub.splitx()}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000508\end{funcdesc}
509
Guido van Rossum6c373f71998-06-29 22:48:01 +0000510\begin{funcdesc}{findall}{pattern, string}
Fred Drakee74f8de2001-08-01 16:56:51 +0000511 Return a list of all non-overlapping matches of \var{pattern} in
512 \var{string}. If one or more groups are present in the pattern,
513 return a list of groups; this will be a list of tuples if the
514 pattern has more than one group. Empty matches are included in the
515 result.
516 \versionadded{1.5.2}
Guido van Rossum6c373f71998-06-29 22:48:01 +0000517\end{funcdesc}
518
Fred Drakee74f8de2001-08-01 16:56:51 +0000519\begin{funcdesc}{sub}{pattern, repl, string\optional{, count}}
520 Return the string obtained by replacing the leftmost non-overlapping
521 occurrences of \var{pattern} in \var{string} by the replacement
522 \var{repl}. If the pattern isn't found, \var{string} is returned
523 unchanged. \var{repl} can be a string or a function; if it is a
524 string, any backslash escapes in it are processed. That is,
525 \samp{\e n} is converted to a single newline character, \samp{\e r}
526 is converted to a linefeed, and so forth. Unknown escapes such as
527 \samp{\e j} are left alone. Backreferences, such as \samp{\e6}, are
528 replaced with the substring matched by group 6 in the pattern. For
529 example:
530
531\begin{verbatim}
532>>> re.sub(r'def\s+([a-zA-Z_][a-zA-Z_0-9]*)\s*\(\s*\):',
533... r'static PyObject*\npy_\1(void)\n{',
534... 'def myfunc():')
535'static PyObject*\npy_myfunc(void)\n{'
536\end{verbatim}
537
538 If \var{repl} is a function, it is called for every non-overlapping
539 occurrence of \var{pattern}. The function takes a single match
540 object argument, and returns the replacement string. For example:
Fred Drake768ac6b1998-12-22 18:19:45 +0000541
Fred Drake19479911998-02-13 06:58:54 +0000542\begin{verbatim}
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000543>>> def dashrepl(matchobj):
Guido van Rossume9625e81998-04-02 01:32:24 +0000544.... if matchobj.group(0) == '-': return ' '
545.... else: return '-'
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000546>>> re.sub('-{1,2}', dashrepl, 'pro----gram-files')
547'pro--gram files'
Fred Drake19479911998-02-13 06:58:54 +0000548\end{verbatim}
Fred Drake768ac6b1998-12-22 18:19:45 +0000549
Fred Drakee74f8de2001-08-01 16:56:51 +0000550 The pattern may be a string or an RE object; if you need to specify
551 regular expression flags, you must use a RE object, or use embedded
552 modifiers in a pattern; for example, \samp{sub("(?i)b+", "x", "bbbb
553 BBBB")} returns \code{'x x'}.
Fred Drake023f87f1998-01-12 19:16:24 +0000554
Fred Drakee74f8de2001-08-01 16:56:51 +0000555 The optional argument \var{count} is the maximum number of pattern
556 occurrences to be replaced; \var{count} must be a non-negative
557 integer. If omitted or zero, all occurrences will be replaced.
558 Empty matches for the pattern are replaced only when not adjacent to
559 a previous match, so \samp{sub('x*', '-', 'abc')} returns
560 \code{'-a-b-c-'}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000561
Fred Drakee74f8de2001-08-01 16:56:51 +0000562 In addition to character escapes and backreferences as described
563 above, \samp{\e g<name>} will use the substring matched by the group
564 named \samp{name}, as defined by the \regexp{(?P<name>...)} syntax.
565 \samp{\e g<number>} uses the corresponding group number;
566 \samp{\e g<2>} is therefore equivalent to \samp{\e 2}, but isn't
567 ambiguous in a replacement such as \samp{\e g<2>0}. \samp{\e 20}
568 would be interpreted as a reference to group 20, not a reference to
569 group 2 followed by the literal character \character{0}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000570\end{funcdesc}
571
Fred Drakee74f8de2001-08-01 16:56:51 +0000572\begin{funcdesc}{subn}{pattern, repl, string\optional{, count}}
573 Perform the same operation as \function{sub()}, but return a tuple
574 \code{(\var{new_string}, \var{number_of_subs_made})}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000575\end{funcdesc}
576
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000577\begin{funcdesc}{escape}{string}
578 Return \var{string} with all non-alphanumerics backslashed; this is
579 useful if you want to match an arbitrary literal string that may have
580 regular expression metacharacters in it.
581\end{funcdesc}
582
Guido van Rossum1acceb01997-08-14 23:12:18 +0000583\begin{excdesc}{error}
584 Exception raised when a string passed to one of the functions here
Fred Drake907e76b2001-07-06 20:30:11 +0000585 is not a valid regular expression (for example, it might contain
586 unmatched parentheses) or when some other error occurs during
587 compilation or matching. It is never an error if a string contains
588 no match for a pattern.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000589\end{excdesc}
590
Fred Drake42de1851998-04-20 16:28:44 +0000591
Fred Draked16d4981998-09-10 20:21:00 +0000592\subsection{Regular Expression Objects \label{re-objects}}
Fred Drake42de1851998-04-20 16:28:44 +0000593
Guido van Rossum1acceb01997-08-14 23:12:18 +0000594Compiled regular expression objects support the following methods and
595attributes:
596
Fred Drake77a6c9e2000-09-07 14:00:51 +0000597\begin{methoddesc}[RegexObject]{search}{string\optional{, pos\optional{,
598 endpos}}}
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000599 Scan through \var{string} looking for a location where this regular
600 expression produces a match, and return a
601 corresponding \class{MatchObject} instance. Return \code{None} if no
602 position in the string matches the pattern; note that this is
603 different from finding a zero-length match at some point in the string.
604
605 The optional \var{pos} and \var{endpos} parameters have the same
606 meaning as for the \method{match()} method.
607\end{methoddesc}
608
Fred Drake77a6c9e2000-09-07 14:00:51 +0000609\begin{methoddesc}[RegexObject]{match}{string\optional{, pos\optional{,
610 endpos}}}
Guido van Rossumeb53ae41997-10-05 18:54:07 +0000611 If zero or more characters at the beginning of \var{string} match
612 this regular expression, return a corresponding
Fred Drake20e01961998-02-19 15:09:35 +0000613 \class{MatchObject} instance. Return \code{None} if the string does not
Guido van Rossumeb53ae41997-10-05 18:54:07 +0000614 match the pattern; note that this is different from a zero-length
615 match.
Fred Drake768ac6b1998-12-22 18:19:45 +0000616
617 \strong{Note:} If you want to locate a match anywhere in
618 \var{string}, use \method{search()} instead.
619
Guido van Rossum1acceb01997-08-14 23:12:18 +0000620 The optional second parameter \var{pos} gives an index in the string
Andrew M. Kuchling65b78631998-06-22 15:02:42 +0000621 where the search is to start; it defaults to \code{0}. This is not
622 completely equivalent to slicing the string; the \code{'\^'} pattern
623 character matches at the real beginning of the string and at positions
624 just after a newline, but not necessarily at the index where the search
625 is to start.
Guido van Rossum0b334101997-12-08 17:33:40 +0000626
627 The optional parameter \var{endpos} limits how far the string will
628 be searched; it will be as if the string is \var{endpos} characters
629 long, so only the characters from \var{pos} to \var{endpos} will be
630 searched for a match.
Fred Drake76547c51998-04-03 05:59:05 +0000631\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000632
Fred Drake77a6c9e2000-09-07 14:00:51 +0000633\begin{methoddesc}[RegexObject]{split}{string\optional{,
Fred Drake76547c51998-04-03 05:59:05 +0000634 maxsplit\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000635Identical to the \function{split()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000636\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000637
Guido van Rossum6c373f71998-06-29 22:48:01 +0000638\begin{methoddesc}[RegexObject]{findall}{string}
639Identical to the \function{findall()} function, using the compiled pattern.
640\end{methoddesc}
641
Fred Drake76547c51998-04-03 05:59:05 +0000642\begin{methoddesc}[RegexObject]{sub}{repl, string\optional{, count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000643Identical to the \function{sub()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000644\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000645
Fred Drake76547c51998-04-03 05:59:05 +0000646\begin{methoddesc}[RegexObject]{subn}{repl, string\optional{,
647 count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000648Identical to the \function{subn()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000649\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000650
Guido van Rossum1acceb01997-08-14 23:12:18 +0000651
Fred Drake76547c51998-04-03 05:59:05 +0000652\begin{memberdesc}[RegexObject]{flags}
Fred Drake895aa9d2001-04-18 17:26:20 +0000653The flags argument used when the RE object was compiled, or
Fred Drake013ad981998-03-08 07:38:27 +0000654\code{0} if no flags were provided.
Fred Drake76547c51998-04-03 05:59:05 +0000655\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000656
Fred Drake76547c51998-04-03 05:59:05 +0000657\begin{memberdesc}[RegexObject]{groupindex}
Fred Drake013ad981998-03-08 07:38:27 +0000658A dictionary mapping any symbolic group names defined by
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000659\regexp{(?P<\var{id}>)} to group numbers. The dictionary is empty if no
Guido van Rossum1acceb01997-08-14 23:12:18 +0000660symbolic groups were used in the pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000661\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000662
Fred Drake76547c51998-04-03 05:59:05 +0000663\begin{memberdesc}[RegexObject]{pattern}
Fred Drake895aa9d2001-04-18 17:26:20 +0000664The pattern string from which the RE object was compiled.
Fred Drake76547c51998-04-03 05:59:05 +0000665\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000666
Fred Drake42de1851998-04-20 16:28:44 +0000667
Fred Draked16d4981998-09-10 20:21:00 +0000668\subsection{Match Objects \label{match-objects}}
Fred Drake023f87f1998-01-12 19:16:24 +0000669
Fred Drakef4bdb572001-07-12 14:13:43 +0000670\class{MatchObject} instances support the following methods and
671attributes:
Guido van Rossum1acceb01997-08-14 23:12:18 +0000672
Andrew M. Kuchling7a90db62000-10-05 12:35:29 +0000673\begin{methoddesc}[MatchObject]{expand}{template}
674 Return the string obtained by doing backslash substitution on the
675template string \var{template}, as done by the \method{sub()} method.
676Escapes such as \samp{\e n} are converted to the appropriate
Fred Drakef4bdb572001-07-12 14:13:43 +0000677characters, and numeric backreferences (\samp{\e 1}, \samp{\e 2}) and
678named backreferences (\samp{\e g<1>}, \samp{\e g<name>}) are replaced
679by the contents of the corresponding group.
Andrew M. Kuchling7a90db62000-10-05 12:35:29 +0000680\end{methoddesc}
681
Fred Drake77a6c9e2000-09-07 14:00:51 +0000682\begin{methoddesc}[MatchObject]{group}{\optional{group1, \moreargs}}
Guido van Rossum46503921998-01-19 23:14:17 +0000683Returns one or more subgroups of the match. If there is a single
684argument, the result is a single string; if there are
Guido van Rossum48d04371997-12-11 20:19:08 +0000685multiple arguments, the result is a tuple with one item per argument.
Fred Drake907e76b2001-07-06 20:30:11 +0000686Without arguments, \var{group1} defaults to zero (the whole match
Guido van Rossum46503921998-01-19 23:14:17 +0000687is returned).
688If a \var{groupN} argument is zero, the corresponding return value is the
Guido van Rossum48d04371997-12-11 20:19:08 +0000689entire matching string; if it is in the inclusive range [1..99], it is
Guido van Rossum791468f1998-04-03 20:07:37 +0000690the string matching the the corresponding parenthesized group. If a
691group number is negative or larger than the number of groups defined
692in the pattern, an \exception{IndexError} exception is raised.
693If a group is contained in a part of the pattern that did not match,
Fred Drakef4bdb572001-07-12 14:13:43 +0000694the corresponding result is \code{None}. If a group is contained in a
Guido van Rossum791468f1998-04-03 20:07:37 +0000695part of the pattern that matched multiple times, the last match is
696returned.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000697
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000698If the regular expression uses the \regexp{(?P<\var{name}>...)} syntax,
Guido van Rossum46503921998-01-19 23:14:17 +0000699the \var{groupN} arguments may also be strings identifying groups by
Guido van Rossum791468f1998-04-03 20:07:37 +0000700their group name. If a string argument is not used as a group name in
701the pattern, an \exception{IndexError} exception is raised.
Guido van Rossume4eb2231997-12-17 00:23:39 +0000702
703A moderately complicated example:
Fred Drake023f87f1998-01-12 19:16:24 +0000704
705\begin{verbatim}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000706m = re.match(r"(?P<int>\d+)\.(\d*)", '3.14')
Fred Drake023f87f1998-01-12 19:16:24 +0000707\end{verbatim}
708
709After performing this match, \code{m.group(1)} is \code{'3'}, as is
Guido van Rossum46503921998-01-19 23:14:17 +0000710\code{m.group('int')}, and \code{m.group(2)} is \code{'14'}.
Fred Drake76547c51998-04-03 05:59:05 +0000711\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000712
Guido van Rossum6c373f71998-06-29 22:48:01 +0000713\begin{methoddesc}[MatchObject]{groups}{\optional{default}}
Guido van Rossum48d04371997-12-11 20:19:08 +0000714Return a tuple containing all the subgroups of the match, from 1 up to
Guido van Rossum6c373f71998-06-29 22:48:01 +0000715however many groups are in the pattern. The \var{default} argument is
716used for groups that did not participate in the match; it defaults to
717\code{None}. (Incompatibility note: in the original Python 1.5
718release, if the tuple was one element long, a string would be returned
719instead. In later versions (from 1.5.1 on), a singleton tuple is
720returned in such cases.)
721\end{methoddesc}
722
723\begin{methoddesc}[MatchObject]{groupdict}{\optional{default}}
724Return a dictionary containing all the \emph{named} subgroups of the
725match, keyed by the subgroup name. The \var{default} argument is
726used for groups that did not participate in the match; it defaults to
727\code{None}.
Fred Drake76547c51998-04-03 05:59:05 +0000728\end{methoddesc}
Guido van Rossum48d04371997-12-11 20:19:08 +0000729
Fred Drake76547c51998-04-03 05:59:05 +0000730\begin{methoddesc}[MatchObject]{start}{\optional{group}}
Fred Drake013ad981998-03-08 07:38:27 +0000731\funcline{end}{\optional{group}}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000732Return the indices of the start and end of the substring
Guido van Rossum46503921998-01-19 23:14:17 +0000733matched by \var{group}; \var{group} defaults to zero (meaning the whole
734matched substring).
Fred Drake77a6c9e2000-09-07 14:00:51 +0000735Return \code{-1} if \var{group} exists but
Guido van Rossume4eb2231997-12-17 00:23:39 +0000736did not contribute to the match. For a match object
Fred Drake023f87f1998-01-12 19:16:24 +0000737\var{m}, and a group \var{g} that did contribute to the match, the
738substring matched by group \var{g} (equivalent to
739\code{\var{m}.group(\var{g})}) is
740
741\begin{verbatim}
742m.string[m.start(g):m.end(g)]
743\end{verbatim}
744
Guido van Rossume4eb2231997-12-17 00:23:39 +0000745Note that
746\code{m.start(\var{group})} will equal \code{m.end(\var{group})} if
Fred Drake023f87f1998-01-12 19:16:24 +0000747\var{group} matched a null string. For example, after \code{\var{m} =
748re.search('b(c?)', 'cba')}, \code{\var{m}.start(0)} is 1,
749\code{\var{m}.end(0)} is 2, \code{\var{m}.start(1)} and
750\code{\var{m}.end(1)} are both 2, and \code{\var{m}.start(2)} raises
Fred Drake20e01961998-02-19 15:09:35 +0000751an \exception{IndexError} exception.
Fred Drake76547c51998-04-03 05:59:05 +0000752\end{methoddesc}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000753
Fred Drake76547c51998-04-03 05:59:05 +0000754\begin{methoddesc}[MatchObject]{span}{\optional{group}}
Fred Drake20e01961998-02-19 15:09:35 +0000755For \class{MatchObject} \var{m}, return the 2-tuple
Fred Drake023f87f1998-01-12 19:16:24 +0000756\code{(\var{m}.start(\var{group}), \var{m}.end(\var{group}))}.
Guido van Rossume4eb2231997-12-17 00:23:39 +0000757Note that if \var{group} did not contribute to the match, this is
Fred Drake77a6c9e2000-09-07 14:00:51 +0000758\code{(-1, -1)}. Again, \var{group} defaults to zero.
Fred Drake76547c51998-04-03 05:59:05 +0000759\end{methoddesc}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000760
Fred Drake76547c51998-04-03 05:59:05 +0000761\begin{memberdesc}[MatchObject]{pos}
Guido van Rossum0b334101997-12-08 17:33:40 +0000762The value of \var{pos} which was passed to the
Fred Drake895aa9d2001-04-18 17:26:20 +0000763\function{search()} or \function{match()} function. This is the index
764into the string at which the RE engine started looking for a match.
Fred Drake76547c51998-04-03 05:59:05 +0000765\end{memberdesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000766
Fred Drake76547c51998-04-03 05:59:05 +0000767\begin{memberdesc}[MatchObject]{endpos}
Guido van Rossum0b334101997-12-08 17:33:40 +0000768The value of \var{endpos} which was passed to the
Fred Drake895aa9d2001-04-18 17:26:20 +0000769\function{search()} or \function{match()} function. This is the index
770into the string beyond which the RE engine will not go.
Fred Drake76547c51998-04-03 05:59:05 +0000771\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000772
Andrew M. Kuchling75afc0b2000-10-18 23:08:13 +0000773\begin{memberdesc}[MatchObject]{lastgroup}
774The name of the last matched capturing group, or \code{None} if the
775group didn't have a name, or if no group was matched at all.
776\end{memberdesc}
777
778\begin{memberdesc}[MatchObject]{lastindex}
779The integer index of the last matched capturing group, or \code{None}
780if no group was matched at all.
781\end{memberdesc}
782
Fred Drake76547c51998-04-03 05:59:05 +0000783\begin{memberdesc}[MatchObject]{re}
Fred Drake20e01961998-02-19 15:09:35 +0000784The regular expression object whose \method{match()} or
785\method{search()} method produced this \class{MatchObject} instance.
Fred Drake76547c51998-04-03 05:59:05 +0000786\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000787
Fred Drake76547c51998-04-03 05:59:05 +0000788\begin{memberdesc}[MatchObject]{string}
Fred Drake20e01961998-02-19 15:09:35 +0000789The string passed to \function{match()} or \function{search()}.
Fred Drake76547c51998-04-03 05:59:05 +0000790\end{memberdesc}