blob: 37b4ee816e51cdb14d48fd0cb640dbb34a03e691 [file] [log] [blame]
Fred Drake295da241998-08-10 19:42:37 +00001\section{\module{re} ---
Fred Drake062ea2e2000-10-06 19:59:22 +00002 Regular expression operations}
Fred Drake66da9d61998-08-07 18:57:18 +00003\declaremodule{standard}{re}
Andrew M. Kuchlingaf5b7662000-06-27 03:16:04 +00004\moduleauthor{Andrew M. Kuchling}{amk1@bigfoot.com}
Fred Drake062ea2e2000-10-06 19:59:22 +00005\moduleauthor{Fredrik Lundh}{effbot@telia.com}
Andrew M. Kuchlingaf5b7662000-06-27 03:16:04 +00006\sectionauthor{Andrew M. Kuchling}{amk1@bigfoot.com}
Guido van Rossum1acceb01997-08-14 23:12:18 +00007
Fred Drakeb91e9341998-07-23 17:59:49 +00008
Fred Drake062ea2e2000-10-06 19:59:22 +00009\modulesynopsis{Regular expression search and match operations with a
10 Perl-style expression syntax.}
Fred Drakeb91e9341998-07-23 17:59:49 +000011
Guido van Rossum1acceb01997-08-14 23:12:18 +000012
Guido van Rossum1acceb01997-08-14 23:12:18 +000013This module provides regular expression matching operations similar to
Fred Drake062ea2e2000-10-06 19:59:22 +000014those found in Perl. Regular expression pattern strings may not
15contain null bytes, but can specify the null byte using the
16\code{\e\var{number}} notation. Both patterns and strings to be
17searched can be Unicode strings as well as 8-bit strings. The
18\module{re} module is always available.
Guido van Rossum1acceb01997-08-14 23:12:18 +000019
Andrew M. Kuchling25332811998-04-09 14:56:04 +000020Regular expressions use the backslash character (\character{\e}) to
Guido van Rossum1acceb01997-08-14 23:12:18 +000021indicate special forms or to allow special characters to be used
22without invoking their special meaning. This collides with Python's
23usage of the same character for the same purpose in string literals;
24for example, to match a literal backslash, one might have to write
Andrew M. Kuchling25332811998-04-09 14:56:04 +000025\code{'\e\e\e\e'} as the pattern string, because the regular expression
Fred Drake20e01961998-02-19 15:09:35 +000026must be \samp{\e\e}, and each backslash must be expressed as
27\samp{\e\e} inside a regular Python string literal.
Guido van Rossum1acceb01997-08-14 23:12:18 +000028
29The solution is to use Python's raw string notation for regular
30expression patterns; backslashes are not handled in any special way in
Andrew M. Kuchling25332811998-04-09 14:56:04 +000031a string literal prefixed with \character{r}. So \code{r"\e n"} is a
32two-character string containing \character{\e} and \character{n},
33while \code{"\e n"} is a one-character string containing a newline.
34Usually patterns will be expressed in Python code using this raw
35string notation.
Guido van Rossum1acceb01997-08-14 23:12:18 +000036
Fred Drake062ea2e2000-10-06 19:59:22 +000037\strong{Implementation note:}
38The \module{re}\refstmodindex{pre} module has two distinct
39implementations: \module{sre} is the default implementation and
40includes Unicode support, but may run into stack limitations for some
41patterns. Though this will be fixed for a future release of Python,
42the older implementation (without Unicode support) is still available
43as the \module{pre}\refstmodindex{pre} module.
44
45
Fred Draked16d4981998-09-10 20:21:00 +000046\subsection{Regular Expression Syntax \label{re-syntax}}
Guido van Rossum1acceb01997-08-14 23:12:18 +000047
48A regular expression (or RE) specifies a set of strings that matches
49it; the functions in this module let you check if a particular string
50matches a given regular expression (or if a given regular expression
51matches a particular string, which comes down to the same thing).
52
53Regular expressions can be concatenated to form new regular
54expressions; if \emph{A} and \emph{B} are both regular expressions,
55then \emph{AB} is also an regular expression. If a string \emph{p}
56matches A and another string \emph{q} matches B, the string \emph{pq}
57will match AB. Thus, complex expressions can easily be constructed
58from simpler primitive expressions like the ones described here. For
59details of the theory and implementation of regular expressions,
60consult the Friedl book referenced below, or almost any textbook about
61compiler construction.
62
Andrew M. Kuchlingc1cea201998-10-28 15:44:14 +000063A brief explanation of the format of regular expressions follows. For
64further information and a gentler presentation, consult the Regular
65Expression HOWTO, accessible from \url{http://www.python.org/doc/howto/}.
Guido van Rossum1acceb01997-08-14 23:12:18 +000066
67Regular expressions can contain both special and ordinary characters.
Andrew M. Kuchling25332811998-04-09 14:56:04 +000068Most ordinary characters, like \character{A}, \character{a}, or \character{0},
Guido van Rossum1acceb01997-08-14 23:12:18 +000069are the simplest regular expressions; they simply match themselves.
Andrew M. Kuchling25332811998-04-09 14:56:04 +000070You can concatenate ordinary characters, so \regexp{last} matches the
71string \code{'last'}. (In the rest of this section, we'll write RE's in
72\regexp{this special style}, usually without quotes, and strings to be
73matched \code{'in single quotes'}.)
Guido van Rossum1acceb01997-08-14 23:12:18 +000074
Andrew M. Kuchling25332811998-04-09 14:56:04 +000075Some characters, like \character{|} or \character{(}, are special. Special
Guido van Rossum1acceb01997-08-14 23:12:18 +000076characters either stand for classes of ordinary characters, or affect
77how the regular expressions around them are interpreted.
78
79The special characters are:
Fred Draked16d4981998-09-10 20:21:00 +000080
Fred Drake1e270f01998-11-30 22:58:12 +000081\begin{list}{}{\leftmargin 0.7in \labelwidth 0.65in}
Fred Draked16d4981998-09-10 20:21:00 +000082
Andrew M. Kuchling25332811998-04-09 14:56:04 +000083\item[\character{.}] (Dot.) In the default mode, this matches any
Fred Drake20e01961998-02-19 15:09:35 +000084character except a newline. If the \constant{DOTALL} flag has been
Guido van Rossum1acceb01997-08-14 23:12:18 +000085specified, this matches any character including a newline.
Fred Draked16d4981998-09-10 20:21:00 +000086
Andrew M. Kuchling25332811998-04-09 14:56:04 +000087\item[\character{\^}] (Caret.) Matches the start of the string, and in
88\constant{MULTILINE} mode also matches immediately after each newline.
Fred Draked16d4981998-09-10 20:21:00 +000089
Andrew M. Kuchling25332811998-04-09 14:56:04 +000090\item[\character{\$}] Matches the end of the string, and in
Fred Drake20e01961998-02-19 15:09:35 +000091\constant{MULTILINE} mode also matches before a newline.
Andrew M. Kuchling25332811998-04-09 14:56:04 +000092\regexp{foo} matches both 'foo' and 'foobar', while the regular
93expression \regexp{foo\$} matches only 'foo'.
Fred Draked16d4981998-09-10 20:21:00 +000094
Andrew M. Kuchling25332811998-04-09 14:56:04 +000095\item[\character{*}] Causes the resulting RE to
Guido van Rossum1acceb01997-08-14 23:12:18 +000096match 0 or more repetitions of the preceding RE, as many repetitions
Andrew M. Kuchling25332811998-04-09 14:56:04 +000097as are possible. \regexp{ab*} will
Guido van Rossum1acceb01997-08-14 23:12:18 +000098match 'a', 'ab', or 'a' followed by any number of 'b's.
Fred Draked16d4981998-09-10 20:21:00 +000099
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000100\item[\character{+}] Causes the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000101resulting RE to match 1 or more repetitions of the preceding RE.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000102\regexp{ab+} will match 'a' followed by any non-zero number of 'b's; it
Guido van Rossum1acceb01997-08-14 23:12:18 +0000103will not match just 'a'.
Fred Draked16d4981998-09-10 20:21:00 +0000104
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000105\item[\character{?}] Causes the resulting RE to
106match 0 or 1 repetitions of the preceding RE. \regexp{ab?} will
Guido van Rossum1acceb01997-08-14 23:12:18 +0000107match either 'a' or 'ab'.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000108\item[\code{*?}, \code{+?}, \code{??}] The \character{*}, \character{+}, and
109\character{?} qualifiers are all \dfn{greedy}; they match as much text as
Guido van Rossum1acceb01997-08-14 23:12:18 +0000110possible. Sometimes this behaviour isn't desired; if the RE
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000111\regexp{<.*>} is matched against \code{'<H1>title</H1>'}, it will match the
112entire string, and not just \code{'<H1>'}.
113Adding \character{?} after the qualifier makes it perform the match in
114\dfn{non-greedy} or \dfn{minimal} fashion; as \emph{few} characters as
115possible will be matched. Using \regexp{.*?} in the previous
116expression will match only \code{'<H1>'}.
Fred Draked16d4981998-09-10 20:21:00 +0000117
Guido van Rossum0148bbf1997-12-22 22:41:40 +0000118\item[\code{\{\var{m},\var{n}\}}] Causes the resulting RE to match from
119\var{m} to \var{n} repetitions of the preceding RE, attempting to
Andrew M. Kuchlingc1cea201998-10-28 15:44:14 +0000120match as many repetitions as possible. For example, \regexp{a\{3,5\}}
121will match from 3 to 5 \character{a} characters. Omitting \var{n}
122specifies an infinite upper bound; you can't omit \var{m}.
Fred Draked16d4981998-09-10 20:21:00 +0000123
Guido van Rossum0148bbf1997-12-22 22:41:40 +0000124\item[\code{\{\var{m},\var{n}\}?}] Causes the resulting RE to
125match from \var{m} to \var{n} repetitions of the preceding RE,
126attempting to match as \emph{few} repetitions as possible. This is
127the non-greedy version of the previous qualifier. For example, on the
Fred Draked16d4981998-09-10 20:21:00 +00001286-character string \code{'aaaaaa'}, \regexp{a\{3,5\}} will match 5
129\character{a} characters, while \regexp{a\{3,5\}?} will only match 3
130characters.
131
132\item[\character{\e}] Either escapes special characters (permitting
133you to match characters like \character{*}, \character{?}, and so
134forth), or signals a special sequence; special sequences are discussed
135below.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000136
137If you're not using a raw string to
138express the pattern, remember that Python also uses the
139backslash as an escape sequence in string literals; if the escape
140sequence isn't recognized by Python's parser, the backslash and
141subsequent character are included in the resulting string. However,
142if Python would recognize the resulting sequence, the backslash should
Fred Drake023f87f1998-01-12 19:16:24 +0000143be repeated twice. This is complicated and hard to understand, so
144it's highly recommended that you use raw strings for all but the
145simplest expressions.
Fred Draked16d4981998-09-10 20:21:00 +0000146
Guido van Rossum1acceb01997-08-14 23:12:18 +0000147\item[\code{[]}] Used to indicate a set of characters. Characters can
Guido van Rossum48d04371997-12-11 20:19:08 +0000148be listed individually, or a range of characters can be indicated by
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000149giving two characters and separating them by a \character{-}. Special
150characters are not active inside sets. For example, \regexp{[akm\$]}
Fred Drake76547c51998-04-03 05:59:05 +0000151will match any of the characters \character{a}, \character{k},
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000152\character{m}, or \character{\$}; \regexp{[a-z]}
153will match any lowercase letter, and \code{[a-zA-Z0-9]} matches any
Fred Drake1e270f01998-11-30 22:58:12 +0000154letter or digit. Character classes such as \code{\e w} or \code{\e S}
155(defined below) are also acceptable inside a range. If you want to
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000156include a \character{]} or a \character{-} inside a set, precede it with a
157backslash, or place it as the first character. The
158pattern \regexp{[]]} will match \code{']'}, for example.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000159
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000160You can match the characters not within a range by \dfn{complementing}
161the set. This is indicated by including a
162\character{\^} as the first character of the set; \character{\^} elsewhere will
Fred Drakecd058531998-12-28 19:03:24 +0000163simply match the \character{\^} character. For example, \regexp{[{\^}5]}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000164will match any character except \character{5}.
165
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000166\item[\character{|}]\code{A|B}, where A and B can be arbitrary REs,
Fred Drake062ea2e2000-10-06 19:59:22 +0000167creates a regular expression that will match either A or B. An
168arbitrary number of REs can be separated by the \character{|} in this
169way. This can be used inside groups (see below) as well. REs
170separated by \character{|} are tried from left to right, and the first
171one that allows the complete pattern to match is considered the
172accepted branch. This means that if \code{A} matches, \code{B} will
173never be tested, even if it would produce a longer overall match. In
174other words, the \character{|} operator is never greedy. To match a
175literal \character{|}, use \regexp{\e|}, or enclose it inside a
176character class, as in \regexp{[|]}.
Fred Draked16d4981998-09-10 20:21:00 +0000177
Guido van Rossum48d04371997-12-11 20:19:08 +0000178\item[\code{(...)}] Matches whatever regular expression is inside the
179parentheses, and indicates the start and end of a group; the contents
180of a group can be retrieved after a match has been performed, and can
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000181be matched later in the string with the \regexp{\e \var{number}} special
Fred Draked16d4981998-09-10 20:21:00 +0000182sequence, described below. To match the literals \character{(} or
183\character{')}, use \regexp{\e(} or \regexp{\e)}, or enclose them
184inside a character class: \regexp{[(] [)]}.
185
186\item[\code{(?...)}] This is an extension notation (a \character{?}
187following a \character{(} is not meaningful otherwise). The first
188character after the \character{?}
Guido van Rossum0b334101997-12-08 17:33:40 +0000189determines what the meaning and further syntax of the construct is.
Guido van Rossume9625e81998-04-02 01:32:24 +0000190Extensions usually do not create a new group;
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000191\regexp{(?P<\var{name}>...)} is the only exception to this rule.
Guido van Rossum0b334101997-12-08 17:33:40 +0000192Following are the currently supported extensions.
Fred Draked16d4981998-09-10 20:21:00 +0000193
Fred Drakee53793b2000-09-25 17:52:40 +0000194\item[\code{(?iLmsux)}] (One or more letters from the set \character{i},
195\character{L}, \character{m}, \character{s}, \character{u},
196\character{x}.) The group matches the empty string; the letters set
197the corresponding flags (\constant{re.I}, \constant{re.L},
198\constant{re.M}, \constant{re.S}, \constant{re.U}, \constant{re.X})
199for the entire regular expression. This is useful if you wish to
200include the flags as part of the regular expression, instead of
201passing a \var{flag} argument to the \function{compile()} function.
Fred Draked16d4981998-09-10 20:21:00 +0000202
Fred Drake062ea2e2000-10-06 19:59:22 +0000203Note that the \regexp{(?x)} flag changes how the expression is parsed.
204It should be used first in the expression string, or after one or more
205whitespace characters. If there are non-whitespace characters before
206the flag, the results are undefined.
207
Guido van Rossum1acceb01997-08-14 23:12:18 +0000208\item[\code{(?:...)}] A non-grouping version of regular parentheses.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000209Matches whatever regular expression is inside the parentheses, but the
210substring matched by the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000211group \emph{cannot} be retrieved after performing a match or
212referenced later in the pattern.
Fred Draked16d4981998-09-10 20:21:00 +0000213
Guido van Rossum1acceb01997-08-14 23:12:18 +0000214\item[\code{(?P<\var{name}>...)}] Similar to regular parentheses, but
Guido van Rossume9625e81998-04-02 01:32:24 +0000215the substring matched by the group is accessible via the symbolic group
Guido van Rossum1acceb01997-08-14 23:12:18 +0000216name \var{name}. Group names must be valid Python identifiers. A
217symbolic group is also a numbered group, just as if the group were not
218named. So the group named 'id' in the example above can also be
219referenced as the numbered group 1.
220
Guido van Rossum48d04371997-12-11 20:19:08 +0000221For example, if the pattern is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000222\regexp{(?P<id>[a-zA-Z_]\e w*)}, the group can be referenced by its
Guido van Rossum1acceb01997-08-14 23:12:18 +0000223name in arguments to methods of match objects, such as \code{m.group('id')}
Fred Drake023f87f1998-01-12 19:16:24 +0000224or \code{m.end('id')}, and also by name in pattern text
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000225(e.g. \regexp{(?P=id)}) and replacement text (e.g. \code{\e g<id>}).
Fred Draked16d4981998-09-10 20:21:00 +0000226
Fred Drake023f87f1998-01-12 19:16:24 +0000227\item[\code{(?P=\var{name})}] Matches whatever text was matched by the
228earlier group named \var{name}.
Fred Draked16d4981998-09-10 20:21:00 +0000229
Fred Drake023f87f1998-01-12 19:16:24 +0000230\item[\code{(?\#...)}] A comment; the contents of the parentheses are
231simply ignored.
Fred Draked16d4981998-09-10 20:21:00 +0000232
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000233\item[\code{(?=...)}] Matches if \regexp{...} matches next, but doesn't
Fred Drake023f87f1998-01-12 19:16:24 +0000234consume any of the string. This is called a lookahead assertion. For
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000235example, \regexp{Isaac (?=Asimov)} will match \code{'Isaac~'} only if it's
236followed by \code{'Asimov'}.
Fred Draked16d4981998-09-10 20:21:00 +0000237
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000238\item[\code{(?!...)}] Matches if \regexp{...} doesn't match next. This
Fred Drake023f87f1998-01-12 19:16:24 +0000239is a negative lookahead assertion. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000240\regexp{Isaac (?!Asimov)} will match \code{'Isaac~'} only if it's \emph{not}
241followed by \code{'Asimov'}.
Guido van Rossum0b334101997-12-08 17:33:40 +0000242
Andrew M. Kuchling9351dd22000-10-05 15:22:28 +0000243\item[\code{(?<=...)}] Matches if the current position in the string
244is preceded by a match for \regexp{...} that ends at the current
245position. This is called a positive lookbehind assertion.
246\regexp{(?<=abc)def} will match \samp{abcdef}, since the lookbehind
247will back up 3 characters and check if the contained pattern matches.
248The contained pattern must only match strings of some fixed length,
249meaning that \regexp{abc} or \regexp{a|b} are allowed, but \regexp{a*}
250isn't.
251
252\item[\code{(?<!...)}] Matches if the current position in the string
253is not preceded by a match for \regexp{...}. This
254is called a negative lookbehind assertion. Similar to positive lookbehind
255assertions, the contained pattern must only match strings of some
256fixed length.
257
Fred Drake2705e801998-02-16 21:21:13 +0000258\end{list}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000259
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000260The special sequences consist of \character{\e} and a character from the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000261list below. If the ordinary character is not on the list, then the
262resulting RE will match the second character. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000263\regexp{\e\$} matches the character \character{\$}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000264
Fred Drake1e270f01998-11-30 22:58:12 +0000265\begin{list}{}{\leftmargin 0.7in \labelwidth 0.65in}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000266
Guido van Rossum1acceb01997-08-14 23:12:18 +0000267\item[\code{\e \var{number}}] Matches the contents of the group of the
Guido van Rossum0b334101997-12-08 17:33:40 +0000268same number. Groups are numbered starting from 1. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000269\regexp{(.+) \e 1} matches \code{'the the'} or \code{'55 55'}, but not
270\code{'the end'} (note
Guido van Rossum0b334101997-12-08 17:33:40 +0000271the space after the group). This special sequence can only be used to
272match one of the first 99 groups. If the first digit of \var{number}
273is 0, or \var{number} is 3 octal digits long, it will not be interpreted
274as a group match, but as the character with octal value \var{number}.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000275Inside the \character{[} and \character{]} of a character class, all numeric
Guido van Rossume9625e81998-04-02 01:32:24 +0000276escapes are treated as characters.
Fred Drakee53793b2000-09-25 17:52:40 +0000277
Guido van Rossum1acceb01997-08-14 23:12:18 +0000278\item[\code{\e A}] Matches only at the start of the string.
Fred Drakee53793b2000-09-25 17:52:40 +0000279
Guido van Rossum1acceb01997-08-14 23:12:18 +0000280\item[\code{\e b}] Matches the empty string, but only at the
281beginning or end of a word. A word is defined as a sequence of
282alphanumeric characters, so the end of a word is indicated by
Guido van Rossum48d04371997-12-11 20:19:08 +0000283whitespace or a non-alphanumeric character. Inside a character range,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000284\regexp{\e b} represents the backspace character, for compatibility with
Guido van Rossum48d04371997-12-11 20:19:08 +0000285Python's string literals.
Fred Drakee53793b2000-09-25 17:52:40 +0000286
Guido van Rossum0b334101997-12-08 17:33:40 +0000287\item[\code{\e B}] Matches the empty string, but only when it is
288\emph{not} at the beginning or end of a word.
Fred Drakee53793b2000-09-25 17:52:40 +0000289
Guido van Rossum1acceb01997-08-14 23:12:18 +0000290\item[\code{\e d}]Matches any decimal digit; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000291equivalent to the set \regexp{[0-9]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000292
Guido van Rossum1acceb01997-08-14 23:12:18 +0000293\item[\code{\e D}]Matches any non-digit character; this is
Fred Drakecd058531998-12-28 19:03:24 +0000294equivalent to the set \regexp{[{\^}0-9]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000295
Guido van Rossum1acceb01997-08-14 23:12:18 +0000296\item[\code{\e s}]Matches any whitespace character; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000297equivalent to the set \regexp{[ \e t\e n\e r\e f\e v]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000298
Guido van Rossum1acceb01997-08-14 23:12:18 +0000299\item[\code{\e S}]Matches any non-whitespace character; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000300equivalent to the set \regexp{[\^\ \e t\e n\e r\e f\e v]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000301
302\item[\code{\e w}]When the \constant{LOCALE} and \constant{UNICODE}
303flags are not specified,
Fred Drake023f87f1998-01-12 19:16:24 +0000304matches any alphanumeric character; this is equivalent to the set
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000305\regexp{[a-zA-Z0-9_]}. With \constant{LOCALE}, it will match the set
Fred Drakee53793b2000-09-25 17:52:40 +0000306\regexp{[0-9_]} plus whatever characters are defined as letters for
307the current locale. If \constant{UNICODE} is set, this will match the
308characters \regexp{[0-9_]} plus whatever is classified as alphanumeric
309in the Unicode character properties database.
310
311\item[\code{\e W}]When the \constant{LOCALE} and \constant{UNICODE}
312flags are not specified, matches any non-alphanumeric character; this
313is equivalent to the set \regexp{[{\^}a-zA-Z0-9_]}. With
314\constant{LOCALE}, it will match any character not in the set
315\regexp{[0-9_]}, and not defined as a letter for the current locale.
316If \constant{UNICODE} is set, this will match anything other than
317\regexp{[0-9_]} and characters marked at alphanumeric in the Unicode
318character properties database.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000319
320\item[\code{\e Z}]Matches only at the end of the string.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000321
322\item[\code{\e \e}] Matches a literal backslash.
323
Fred Drake2705e801998-02-16 21:21:13 +0000324\end{list}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000325
Fred Drake42de1851998-04-20 16:28:44 +0000326
Fred Drake768ac6b1998-12-22 18:19:45 +0000327\subsection{Matching vs. Searching \label{matching-searching}}
328\sectionauthor{Fred L. Drake, Jr.}{fdrake@acm.org}
329
Fred Drake768ac6b1998-12-22 18:19:45 +0000330Python offers two different primitive operations based on regular
331expressions: match and search. If you are accustomed to Perl's
332semantics, the search operation is what you're looking for. See the
333\function{search()} function and corresponding method of compiled
334regular expression objects.
335
336Note that match may differ from search using a regular expression
Fred Drake3d0971e1999-06-29 21:21:19 +0000337beginning with \character{\^}: \character{\^} matches only at the
338start of the string, or in \constant{MULTILINE} mode also immediately
339following a newline. The ``match'' operation succeeds only if the
340pattern matches at the start of the string regardless of mode, or at
341the starting position given by the optional \var{pos} argument
342regardless of whether a newline precedes it.
Fred Drake768ac6b1998-12-22 18:19:45 +0000343
344% Examples from Tim Peters:
345\begin{verbatim}
346re.compile("a").match("ba", 1) # succeeds
347re.compile("^a").search("ba", 1) # fails; 'a' not at start
348re.compile("^a").search("\na", 1) # fails; 'a' not at start
349re.compile("^a", re.M).search("\na", 1) # succeeds
350re.compile("^a", re.M).search("ba", 1) # fails; no preceding \n
351\end{verbatim}
352
353
Guido van Rossum1acceb01997-08-14 23:12:18 +0000354\subsection{Module Contents}
Fred Drake78f8e981997-12-29 21:39:39 +0000355\nodename{Contents of Module re}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000356
357The module defines the following functions and constants, and an exception:
358
Guido van Rossum1acceb01997-08-14 23:12:18 +0000359
Fred Drake013ad981998-03-08 07:38:27 +0000360\begin{funcdesc}{compile}{pattern\optional{, flags}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000361 Compile a regular expression pattern into a regular expression
Fred Drake20e01961998-02-19 15:09:35 +0000362 object, which can be used for matching using its \function{match()} and
363 \function{search()} methods, described below.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000364
Guido van Rossum0b334101997-12-08 17:33:40 +0000365 The expression's behaviour can be modified by specifying a
366 \var{flags} value. Values can be any of the following variables,
367 combined using bitwise OR (the \code{|} operator).
368
Fred Drake76547c51998-04-03 05:59:05 +0000369The sequence
370
371\begin{verbatim}
372prog = re.compile(pat)
373result = prog.match(str)
374\end{verbatim}
375
376is equivalent to
377
378\begin{verbatim}
379result = re.match(pat, str)
380\end{verbatim}
381
382but the version using \function{compile()} is more efficient when the
383expression will be used several times in a single program.
384%(The compiled version of the last pattern passed to
385%\function{regex.match()} or \function{regex.search()} is cached, so
386%programs that use only a single regular expression at a time needn't
387%worry about compiling regular expressions.)
388\end{funcdesc}
389
Fred Drake013ad981998-03-08 07:38:27 +0000390\begin{datadesc}{I}
391\dataline{IGNORECASE}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000392Perform case-insensitive matching; expressions like \regexp{[A-Z]} will match
Guido van Rossum48d04371997-12-11 20:19:08 +0000393lowercase letters, too. This is not affected by the current locale.
Fred Drake013ad981998-03-08 07:38:27 +0000394\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000395
Fred Drake013ad981998-03-08 07:38:27 +0000396\begin{datadesc}{L}
397\dataline{LOCALE}
Fred Drakee53793b2000-09-25 17:52:40 +0000398Make \regexp{\e w}, \regexp{\e W}, \regexp{\e b}, and
399\regexp{\e B} dependent on the current locale.
Fred Drake013ad981998-03-08 07:38:27 +0000400\end{datadesc}
Guido van Rossuma42c1781997-12-09 20:41:47 +0000401
Fred Drake013ad981998-03-08 07:38:27 +0000402\begin{datadesc}{M}
403\dataline{MULTILINE}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000404When specified, the pattern character \character{\^} matches at the
Fred Drake023f87f1998-01-12 19:16:24 +0000405beginning of the string and at the beginning of each line
406(immediately following each newline); and the pattern character
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000407\character{\$} matches at the end of the string and at the end of each line
Guido van Rossum48d04371997-12-11 20:19:08 +0000408(immediately preceding each newline).
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000409By default, \character{\^} matches only at the beginning of the string, and
410\character{\$} only at the end of the string and immediately before the
Guido van Rossum0b334101997-12-08 17:33:40 +0000411newline (if any) at the end of the string.
Fred Drake013ad981998-03-08 07:38:27 +0000412\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000413
Fred Drake013ad981998-03-08 07:38:27 +0000414\begin{datadesc}{S}
415\dataline{DOTALL}
Fred Drakee53793b2000-09-25 17:52:40 +0000416Make the \character{.} special character match any character at all,
417including a newline; without this flag, \character{.} will match
418anything \emph{except} a newline.
419\end{datadesc}
420
421\begin{datadesc}{U}
422\dataline{UNICODE}
423Make \regexp{\e w}, \regexp{\e W}, \regexp{\e b}, and
424\regexp{\e B} dependent on the Unicode character properties database.
425\versionadded{2.0}
Fred Drake013ad981998-03-08 07:38:27 +0000426\end{datadesc}
Guido van Rossum48d04371997-12-11 20:19:08 +0000427
Fred Drake013ad981998-03-08 07:38:27 +0000428\begin{datadesc}{X}
429\dataline{VERBOSE}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000430This flag allows you to write regular expressions that look nicer.
431Whitespace within the pattern is ignored,
Guido van Rossum48d04371997-12-11 20:19:08 +0000432except when in a character class or preceded by an unescaped
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000433backslash, and, when a line contains a \character{\#} neither in a character
Guido van Rossum48d04371997-12-11 20:19:08 +0000434class or preceded by an unescaped backslash, all characters from the
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000435leftmost such \character{\#} through the end of the line are ignored.
436% XXX should add an example here
Fred Drake013ad981998-03-08 07:38:27 +0000437\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000438
Guido van Rossum0b334101997-12-08 17:33:40 +0000439
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000440\begin{funcdesc}{search}{pattern, string\optional{, flags}}
441 Scan through \var{string} looking for a location where the regular
442 expression \var{pattern} produces a match, and return a
443 corresponding \class{MatchObject} instance.
444 Return \code{None} if no
445 position in the string matches the pattern; note that this is
446 different from finding a zero-length match at some point in the string.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000447\end{funcdesc}
448
Fred Drake013ad981998-03-08 07:38:27 +0000449\begin{funcdesc}{match}{pattern, string\optional{, flags}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000450 If zero or more characters at the beginning of \var{string} match
451 the regular expression \var{pattern}, return a corresponding
Fred Drake20e01961998-02-19 15:09:35 +0000452 \class{MatchObject} instance. Return \code{None} if the string does not
Guido van Rossum1acceb01997-08-14 23:12:18 +0000453 match the pattern; note that this is different from a zero-length
454 match.
Fred Drake768ac6b1998-12-22 18:19:45 +0000455
456 \strong{Note:} If you want to locate a match anywhere in
457 \var{string}, use \method{search()} instead.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000458\end{funcdesc}
459
Fred Drake77a6c9e2000-09-07 14:00:51 +0000460\begin{funcdesc}{split}{pattern, string\optional{, maxsplit\code{ = 0}}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000461 Split \var{string} by the occurrences of \var{pattern}. If
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000462 capturing parentheses are used in \var{pattern}, then the text of all
463 groups in the pattern are also returned as part of the resulting list.
Guido van Rossum97546391998-01-12 18:58:53 +0000464 If \var{maxsplit} is nonzero, at most \var{maxsplit} splits
465 occur, and the remainder of the string is returned as the final
466 element of the list. (Incompatibility note: in the original Python
467 1.5 release, \var{maxsplit} was ignored. This has been fixed in
468 later releases.)
Fred Drake768ac6b1998-12-22 18:19:45 +0000469
Fred Drake19479911998-02-13 06:58:54 +0000470\begin{verbatim}
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000471>>> re.split('\W+', 'Words, words, words.')
Guido van Rossum1acceb01997-08-14 23:12:18 +0000472['Words', 'words', 'words', '']
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000473>>> re.split('(\W+)', 'Words, words, words.')
Guido van Rossum1acceb01997-08-14 23:12:18 +0000474['Words', ', ', 'words', ', ', 'words', '.', '']
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000475>>> re.split('\W+', 'Words, words, words.', 1)
Guido van Rossum97546391998-01-12 18:58:53 +0000476['Words', 'words, words.']
Fred Drake19479911998-02-13 06:58:54 +0000477\end{verbatim}
Fred Drake768ac6b1998-12-22 18:19:45 +0000478
Guido van Rossum1acceb01997-08-14 23:12:18 +0000479 This function combines and extends the functionality of
Fred Drake20e01961998-02-19 15:09:35 +0000480 the old \function{regsub.split()} and \function{regsub.splitx()}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000481\end{funcdesc}
482
Guido van Rossum6c373f71998-06-29 22:48:01 +0000483\begin{funcdesc}{findall}{pattern, string}
484Return a list of all non-overlapping matches of \var{pattern} in
485\var{string}. If one or more groups are present in the pattern,
486return a list of groups; this will be a list of tuples if the pattern
487has more than one group. Empty matches are included in the result.
Fred Drakedda199b1999-02-02 19:01:37 +0000488\versionadded{1.5.2}
Guido van Rossum6c373f71998-06-29 22:48:01 +0000489\end{funcdesc}
490
Fred Drake013ad981998-03-08 07:38:27 +0000491\begin{funcdesc}{sub}{pattern, repl, string\optional{, count\code{ = 0}}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000492Return the string obtained by replacing the leftmost non-overlapping
493occurrences of \var{pattern} in \var{string} by the replacement
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000494\var{repl}. If the pattern isn't found, \var{string} is returned
495unchanged. \var{repl} can be a string or a function; if a function,
Fred Drakebfb092e1999-04-09 19:57:09 +0000496it is called for every non-overlapping occurrence of \var{pattern}.
Guido van Rossum0b334101997-12-08 17:33:40 +0000497The function takes a single match object argument, and returns the
498replacement string. For example:
Fred Drake768ac6b1998-12-22 18:19:45 +0000499
Fred Drake19479911998-02-13 06:58:54 +0000500\begin{verbatim}
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000501>>> def dashrepl(matchobj):
Guido van Rossume9625e81998-04-02 01:32:24 +0000502.... if matchobj.group(0) == '-': return ' '
503.... else: return '-'
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000504>>> re.sub('-{1,2}', dashrepl, 'pro----gram-files')
505'pro--gram files'
Fred Drake19479911998-02-13 06:58:54 +0000506\end{verbatim}
Fred Drake768ac6b1998-12-22 18:19:45 +0000507
Guido van Rossum0b334101997-12-08 17:33:40 +0000508The pattern may be a string or a
Guido van Rossum48d04371997-12-11 20:19:08 +0000509regex object; if you need to specify
510regular expression flags, you must use a regex object, or use
511embedded modifiers in a pattern; e.g.
Fred Drake013ad981998-03-08 07:38:27 +0000512\samp{sub("(?i)b+", "x", "bbbb BBBB")} returns \code{'x x'}.
Fred Drake023f87f1998-01-12 19:16:24 +0000513
Guido van Rossum1acceb01997-08-14 23:12:18 +0000514The optional argument \var{count} is the maximum number of pattern
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000515occurrences to be replaced; \var{count} must be a non-negative integer, and
Guido van Rossum1acceb01997-08-14 23:12:18 +0000516the default value of 0 means to replace all occurrences.
517
518Empty matches for the pattern are replaced only when not adjacent to a
Fred Drake013ad981998-03-08 07:38:27 +0000519previous match, so \samp{sub('x*', '-', 'abc')} returns \code{'-a-b-c-'}.
Guido van Rossume9625e81998-04-02 01:32:24 +0000520
521If \var{repl} is a string, any backslash escapes in it are processed.
522That is, \samp{\e n} is converted to a single newline character,
523\samp{\e r} is converted to a linefeed, and so forth. Unknown escapes
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000524such as \samp{\e j} are left alone. Backreferences, such as \samp{\e 6}, are
Guido van Rossume9625e81998-04-02 01:32:24 +0000525replaced with the substring matched by group 6 in the pattern.
526
527In addition to character escapes and backreferences as described
528above, \samp{\e g<name>} will use the substring matched by the group
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000529named \samp{name}, as defined by the \regexp{(?P<name>...)} syntax.
Guido van Rossume9625e81998-04-02 01:32:24 +0000530\samp{\e g<number>} uses the corresponding group number; \samp{\e
531g<2>} is therefore equivalent to \samp{\e 2}, but isn't ambiguous in a
532replacement such as \samp{\e g<2>0}. \samp{\e 20} would be
533interpreted as a reference to group 20, not a reference to group 2
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000534followed by the literal character \character{0}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000535\end{funcdesc}
536
Fred Drake013ad981998-03-08 07:38:27 +0000537\begin{funcdesc}{subn}{pattern, repl, string\optional{, count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000538Perform the same operation as \function{sub()}, but return a tuple
Fred Drake023f87f1998-01-12 19:16:24 +0000539\code{(\var{new_string}, \var{number_of_subs_made})}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000540\end{funcdesc}
541
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000542\begin{funcdesc}{escape}{string}
543 Return \var{string} with all non-alphanumerics backslashed; this is
544 useful if you want to match an arbitrary literal string that may have
545 regular expression metacharacters in it.
546\end{funcdesc}
547
Guido van Rossum1acceb01997-08-14 23:12:18 +0000548\begin{excdesc}{error}
549 Exception raised when a string passed to one of the functions here
550 is not a valid regular expression (e.g., unmatched parentheses) or
Fred Drake013ad981998-03-08 07:38:27 +0000551 when some other error occurs during compilation or matching. It is
552 never an error if a string contains no match for a pattern.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000553\end{excdesc}
554
Fred Drake42de1851998-04-20 16:28:44 +0000555
Fred Draked16d4981998-09-10 20:21:00 +0000556\subsection{Regular Expression Objects \label{re-objects}}
Fred Drake42de1851998-04-20 16:28:44 +0000557
Guido van Rossum1acceb01997-08-14 23:12:18 +0000558Compiled regular expression objects support the following methods and
559attributes:
560
Fred Drake77a6c9e2000-09-07 14:00:51 +0000561\begin{methoddesc}[RegexObject]{search}{string\optional{, pos\optional{,
562 endpos}}}
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000563 Scan through \var{string} looking for a location where this regular
564 expression produces a match, and return a
565 corresponding \class{MatchObject} instance. Return \code{None} if no
566 position in the string matches the pattern; note that this is
567 different from finding a zero-length match at some point in the string.
568
569 The optional \var{pos} and \var{endpos} parameters have the same
570 meaning as for the \method{match()} method.
571\end{methoddesc}
572
Fred Drake77a6c9e2000-09-07 14:00:51 +0000573\begin{methoddesc}[RegexObject]{match}{string\optional{, pos\optional{,
574 endpos}}}
Guido van Rossumeb53ae41997-10-05 18:54:07 +0000575 If zero or more characters at the beginning of \var{string} match
576 this regular expression, return a corresponding
Fred Drake20e01961998-02-19 15:09:35 +0000577 \class{MatchObject} instance. Return \code{None} if the string does not
Guido van Rossumeb53ae41997-10-05 18:54:07 +0000578 match the pattern; note that this is different from a zero-length
579 match.
Fred Drake768ac6b1998-12-22 18:19:45 +0000580
581 \strong{Note:} If you want to locate a match anywhere in
582 \var{string}, use \method{search()} instead.
583
Guido van Rossum1acceb01997-08-14 23:12:18 +0000584 The optional second parameter \var{pos} gives an index in the string
Andrew M. Kuchling65b78631998-06-22 15:02:42 +0000585 where the search is to start; it defaults to \code{0}. This is not
586 completely equivalent to slicing the string; the \code{'\^'} pattern
587 character matches at the real beginning of the string and at positions
588 just after a newline, but not necessarily at the index where the search
589 is to start.
Guido van Rossum0b334101997-12-08 17:33:40 +0000590
591 The optional parameter \var{endpos} limits how far the string will
592 be searched; it will be as if the string is \var{endpos} characters
593 long, so only the characters from \var{pos} to \var{endpos} will be
594 searched for a match.
Fred Drake76547c51998-04-03 05:59:05 +0000595\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000596
Fred Drake77a6c9e2000-09-07 14:00:51 +0000597\begin{methoddesc}[RegexObject]{split}{string\optional{,
Fred Drake76547c51998-04-03 05:59:05 +0000598 maxsplit\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000599Identical to the \function{split()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000600\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000601
Guido van Rossum6c373f71998-06-29 22:48:01 +0000602\begin{methoddesc}[RegexObject]{findall}{string}
603Identical to the \function{findall()} function, using the compiled pattern.
604\end{methoddesc}
605
Fred Drake76547c51998-04-03 05:59:05 +0000606\begin{methoddesc}[RegexObject]{sub}{repl, string\optional{, count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000607Identical to the \function{sub()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000608\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000609
Fred Drake76547c51998-04-03 05:59:05 +0000610\begin{methoddesc}[RegexObject]{subn}{repl, string\optional{,
611 count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000612Identical to the \function{subn()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000613\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000614
Guido van Rossum1acceb01997-08-14 23:12:18 +0000615
Fred Drake76547c51998-04-03 05:59:05 +0000616\begin{memberdesc}[RegexObject]{flags}
Fred Drake013ad981998-03-08 07:38:27 +0000617The flags argument used when the regex object was compiled, or
618\code{0} if no flags were provided.
Fred Drake76547c51998-04-03 05:59:05 +0000619\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000620
Fred Drake76547c51998-04-03 05:59:05 +0000621\begin{memberdesc}[RegexObject]{groupindex}
Fred Drake013ad981998-03-08 07:38:27 +0000622A dictionary mapping any symbolic group names defined by
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000623\regexp{(?P<\var{id}>)} to group numbers. The dictionary is empty if no
Guido van Rossum1acceb01997-08-14 23:12:18 +0000624symbolic groups were used in the pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000625\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000626
Fred Drake76547c51998-04-03 05:59:05 +0000627\begin{memberdesc}[RegexObject]{pattern}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000628The pattern string from which the regex object was compiled.
Fred Drake76547c51998-04-03 05:59:05 +0000629\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000630
Fred Drake42de1851998-04-20 16:28:44 +0000631
Fred Draked16d4981998-09-10 20:21:00 +0000632\subsection{Match Objects \label{match-objects}}
Fred Drake023f87f1998-01-12 19:16:24 +0000633
Fred Drake20e01961998-02-19 15:09:35 +0000634\class{MatchObject} instances support the following methods and attributes:
Guido van Rossum1acceb01997-08-14 23:12:18 +0000635
Andrew M. Kuchling7a90db62000-10-05 12:35:29 +0000636\begin{methoddesc}[MatchObject]{expand}{template}
637 Return the string obtained by doing backslash substitution on the
638template string \var{template}, as done by the \method{sub()} method.
639Escapes such as \samp{\e n} are converted to the appropriate
640characters, and numeric backreferences (\samp{\e 1}, \samp{\e 2}) and named
641backreferences (\samp{\e g<1>}, \samp{\e g<name>}) are replaced by the contents of the
642corresponding group.
643\end{methoddesc}
644
Fred Drake77a6c9e2000-09-07 14:00:51 +0000645\begin{methoddesc}[MatchObject]{group}{\optional{group1, \moreargs}}
Guido van Rossum46503921998-01-19 23:14:17 +0000646Returns one or more subgroups of the match. If there is a single
647argument, the result is a single string; if there are
Guido van Rossum48d04371997-12-11 20:19:08 +0000648multiple arguments, the result is a tuple with one item per argument.
Guido van Rossum46503921998-01-19 23:14:17 +0000649Without arguments, \var{group1} defaults to zero (i.e. the whole match
650is returned).
651If a \var{groupN} argument is zero, the corresponding return value is the
Guido van Rossum48d04371997-12-11 20:19:08 +0000652entire matching string; if it is in the inclusive range [1..99], it is
Guido van Rossum791468f1998-04-03 20:07:37 +0000653the string matching the the corresponding parenthesized group. If a
654group number is negative or larger than the number of groups defined
655in the pattern, an \exception{IndexError} exception is raised.
656If a group is contained in a part of the pattern that did not match,
Fred Drake77a6c9e2000-09-07 14:00:51 +0000657the corresponding result is \code{-1}. If a group is contained in a
Guido van Rossum791468f1998-04-03 20:07:37 +0000658part of the pattern that matched multiple times, the last match is
659returned.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000660
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000661If the regular expression uses the \regexp{(?P<\var{name}>...)} syntax,
Guido van Rossum46503921998-01-19 23:14:17 +0000662the \var{groupN} arguments may also be strings identifying groups by
Guido van Rossum791468f1998-04-03 20:07:37 +0000663their group name. If a string argument is not used as a group name in
664the pattern, an \exception{IndexError} exception is raised.
Guido van Rossume4eb2231997-12-17 00:23:39 +0000665
666A moderately complicated example:
Fred Drake023f87f1998-01-12 19:16:24 +0000667
668\begin{verbatim}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000669m = re.match(r"(?P<int>\d+)\.(\d*)", '3.14')
Fred Drake023f87f1998-01-12 19:16:24 +0000670\end{verbatim}
671
672After performing this match, \code{m.group(1)} is \code{'3'}, as is
Guido van Rossum46503921998-01-19 23:14:17 +0000673\code{m.group('int')}, and \code{m.group(2)} is \code{'14'}.
Fred Drake76547c51998-04-03 05:59:05 +0000674\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000675
Guido van Rossum6c373f71998-06-29 22:48:01 +0000676\begin{methoddesc}[MatchObject]{groups}{\optional{default}}
Guido van Rossum48d04371997-12-11 20:19:08 +0000677Return a tuple containing all the subgroups of the match, from 1 up to
Guido van Rossum6c373f71998-06-29 22:48:01 +0000678however many groups are in the pattern. The \var{default} argument is
679used for groups that did not participate in the match; it defaults to
680\code{None}. (Incompatibility note: in the original Python 1.5
681release, if the tuple was one element long, a string would be returned
682instead. In later versions (from 1.5.1 on), a singleton tuple is
683returned in such cases.)
684\end{methoddesc}
685
686\begin{methoddesc}[MatchObject]{groupdict}{\optional{default}}
687Return a dictionary containing all the \emph{named} subgroups of the
688match, keyed by the subgroup name. The \var{default} argument is
689used for groups that did not participate in the match; it defaults to
690\code{None}.
Fred Drake76547c51998-04-03 05:59:05 +0000691\end{methoddesc}
Guido van Rossum48d04371997-12-11 20:19:08 +0000692
Fred Drake76547c51998-04-03 05:59:05 +0000693\begin{methoddesc}[MatchObject]{start}{\optional{group}}
Fred Drake013ad981998-03-08 07:38:27 +0000694\funcline{end}{\optional{group}}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000695Return the indices of the start and end of the substring
Guido van Rossum46503921998-01-19 23:14:17 +0000696matched by \var{group}; \var{group} defaults to zero (meaning the whole
697matched substring).
Fred Drake77a6c9e2000-09-07 14:00:51 +0000698Return \code{-1} if \var{group} exists but
Guido van Rossume4eb2231997-12-17 00:23:39 +0000699did not contribute to the match. For a match object
Fred Drake023f87f1998-01-12 19:16:24 +0000700\var{m}, and a group \var{g} that did contribute to the match, the
701substring matched by group \var{g} (equivalent to
702\code{\var{m}.group(\var{g})}) is
703
704\begin{verbatim}
705m.string[m.start(g):m.end(g)]
706\end{verbatim}
707
Guido van Rossume4eb2231997-12-17 00:23:39 +0000708Note that
709\code{m.start(\var{group})} will equal \code{m.end(\var{group})} if
Fred Drake023f87f1998-01-12 19:16:24 +0000710\var{group} matched a null string. For example, after \code{\var{m} =
711re.search('b(c?)', 'cba')}, \code{\var{m}.start(0)} is 1,
712\code{\var{m}.end(0)} is 2, \code{\var{m}.start(1)} and
713\code{\var{m}.end(1)} are both 2, and \code{\var{m}.start(2)} raises
Fred Drake20e01961998-02-19 15:09:35 +0000714an \exception{IndexError} exception.
Fred Drake76547c51998-04-03 05:59:05 +0000715\end{methoddesc}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000716
Fred Drake76547c51998-04-03 05:59:05 +0000717\begin{methoddesc}[MatchObject]{span}{\optional{group}}
Fred Drake20e01961998-02-19 15:09:35 +0000718For \class{MatchObject} \var{m}, return the 2-tuple
Fred Drake023f87f1998-01-12 19:16:24 +0000719\code{(\var{m}.start(\var{group}), \var{m}.end(\var{group}))}.
Guido van Rossume4eb2231997-12-17 00:23:39 +0000720Note that if \var{group} did not contribute to the match, this is
Fred Drake77a6c9e2000-09-07 14:00:51 +0000721\code{(-1, -1)}. Again, \var{group} defaults to zero.
Fred Drake76547c51998-04-03 05:59:05 +0000722\end{methoddesc}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000723
Fred Drake76547c51998-04-03 05:59:05 +0000724\begin{memberdesc}[MatchObject]{pos}
Guido van Rossum0b334101997-12-08 17:33:40 +0000725The value of \var{pos} which was passed to the
Fred Drake20e01961998-02-19 15:09:35 +0000726\function{search()} or \function{match()} function. This is the index into
Fred Drake023f87f1998-01-12 19:16:24 +0000727the string at which the regex engine started looking for a match.
Fred Drake76547c51998-04-03 05:59:05 +0000728\end{memberdesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000729
Fred Drake76547c51998-04-03 05:59:05 +0000730\begin{memberdesc}[MatchObject]{endpos}
Guido van Rossum0b334101997-12-08 17:33:40 +0000731The value of \var{endpos} which was passed to the
Fred Drake20e01961998-02-19 15:09:35 +0000732\function{search()} or \function{match()} function. This is the index into
Fred Drake023f87f1998-01-12 19:16:24 +0000733the string beyond which the regex engine will not go.
Fred Drake76547c51998-04-03 05:59:05 +0000734\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000735
Fred Drake76547c51998-04-03 05:59:05 +0000736\begin{memberdesc}[MatchObject]{re}
Fred Drake20e01961998-02-19 15:09:35 +0000737The regular expression object whose \method{match()} or
738\method{search()} method produced this \class{MatchObject} instance.
Fred Drake76547c51998-04-03 05:59:05 +0000739\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000740
Fred Drake76547c51998-04-03 05:59:05 +0000741\begin{memberdesc}[MatchObject]{string}
Fred Drake20e01961998-02-19 15:09:35 +0000742The string passed to \function{match()} or \function{search()}.
Fred Drake76547c51998-04-03 05:59:05 +0000743\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000744
Guido van Rossum1acceb01997-08-14 23:12:18 +0000745\begin{seealso}
Fred Drake356d0ce1999-11-09 20:10:01 +0000746\seetext{Jeffrey Friedl, \citetitle{Mastering Regular Expressions},
Fred Drake023f87f1998-01-12 19:16:24 +0000747O'Reilly. The Python material in this book dates from before the
Fred Drake20e01961998-02-19 15:09:35 +0000748\module{re} module, but it covers writing good regular expression
Fred Drake023f87f1998-01-12 19:16:24 +0000749patterns in great detail.}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000750\end{seealso}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000751