blob: 45b1ca5e5d8a67ed26bd529503d550db51225846 [file] [log] [blame]
Fred Drake295da241998-08-10 19:42:37 +00001\section{\module{re} ---
Fred Drake062ea2e2000-10-06 19:59:22 +00002 Regular expression operations}
Fred Drake66da9d61998-08-07 18:57:18 +00003\declaremodule{standard}{re}
Andrew M. Kuchlingaf5b7662000-06-27 03:16:04 +00004\moduleauthor{Andrew M. Kuchling}{amk1@bigfoot.com}
Fred Drake062ea2e2000-10-06 19:59:22 +00005\moduleauthor{Fredrik Lundh}{effbot@telia.com}
Andrew M. Kuchlingaf5b7662000-06-27 03:16:04 +00006\sectionauthor{Andrew M. Kuchling}{amk1@bigfoot.com}
Guido van Rossum1acceb01997-08-14 23:12:18 +00007
Fred Drakeb91e9341998-07-23 17:59:49 +00008
Fred Drake062ea2e2000-10-06 19:59:22 +00009\modulesynopsis{Regular expression search and match operations with a
10 Perl-style expression syntax.}
Fred Drakeb91e9341998-07-23 17:59:49 +000011
Guido van Rossum1acceb01997-08-14 23:12:18 +000012
Guido van Rossum1acceb01997-08-14 23:12:18 +000013This module provides regular expression matching operations similar to
Fred Drake062ea2e2000-10-06 19:59:22 +000014those found in Perl. Regular expression pattern strings may not
15contain null bytes, but can specify the null byte using the
16\code{\e\var{number}} notation. Both patterns and strings to be
17searched can be Unicode strings as well as 8-bit strings. The
18\module{re} module is always available.
Guido van Rossum1acceb01997-08-14 23:12:18 +000019
Andrew M. Kuchling25332811998-04-09 14:56:04 +000020Regular expressions use the backslash character (\character{\e}) to
Guido van Rossum1acceb01997-08-14 23:12:18 +000021indicate special forms or to allow special characters to be used
22without invoking their special meaning. This collides with Python's
23usage of the same character for the same purpose in string literals;
24for example, to match a literal backslash, one might have to write
Andrew M. Kuchling25332811998-04-09 14:56:04 +000025\code{'\e\e\e\e'} as the pattern string, because the regular expression
Fred Drake20e01961998-02-19 15:09:35 +000026must be \samp{\e\e}, and each backslash must be expressed as
27\samp{\e\e} inside a regular Python string literal.
Guido van Rossum1acceb01997-08-14 23:12:18 +000028
29The solution is to use Python's raw string notation for regular
30expression patterns; backslashes are not handled in any special way in
Andrew M. Kuchling25332811998-04-09 14:56:04 +000031a string literal prefixed with \character{r}. So \code{r"\e n"} is a
32two-character string containing \character{\e} and \character{n},
33while \code{"\e n"} is a one-character string containing a newline.
34Usually patterns will be expressed in Python code using this raw
35string notation.
Guido van Rossum1acceb01997-08-14 23:12:18 +000036
Fred Drake062ea2e2000-10-06 19:59:22 +000037\strong{Implementation note:}
38The \module{re}\refstmodindex{pre} module has two distinct
39implementations: \module{sre} is the default implementation and
40includes Unicode support, but may run into stack limitations for some
41patterns. Though this will be fixed for a future release of Python,
42the older implementation (without Unicode support) is still available
43as the \module{pre}\refstmodindex{pre} module.
44
45
Fred Drakee20bd192001-04-12 16:47:17 +000046\begin{seealso}
47 \seetitle{Mastering Regular Expressions}{Book on regular expressions
48 by Jeffrey Friedl, published by O'Reilly. The Python
49 material in this book dates from before the \refmodule{re}
50 module, but it covers writing good regular expression
51 patterns in great detail.}
52\end{seealso}
53
54
Fred Draked16d4981998-09-10 20:21:00 +000055\subsection{Regular Expression Syntax \label{re-syntax}}
Guido van Rossum1acceb01997-08-14 23:12:18 +000056
57A regular expression (or RE) specifies a set of strings that matches
58it; the functions in this module let you check if a particular string
59matches a given regular expression (or if a given regular expression
60matches a particular string, which comes down to the same thing).
61
62Regular expressions can be concatenated to form new regular
63expressions; if \emph{A} and \emph{B} are both regular expressions,
64then \emph{AB} is also an regular expression. If a string \emph{p}
65matches A and another string \emph{q} matches B, the string \emph{pq}
66will match AB. Thus, complex expressions can easily be constructed
67from simpler primitive expressions like the ones described here. For
68details of the theory and implementation of regular expressions,
69consult the Friedl book referenced below, or almost any textbook about
70compiler construction.
71
Andrew M. Kuchlingc1cea201998-10-28 15:44:14 +000072A brief explanation of the format of regular expressions follows. For
73further information and a gentler presentation, consult the Regular
74Expression HOWTO, accessible from \url{http://www.python.org/doc/howto/}.
Guido van Rossum1acceb01997-08-14 23:12:18 +000075
76Regular expressions can contain both special and ordinary characters.
Fred Drakef4bdb572001-07-12 14:13:43 +000077Most ordinary characters, like \character{A}, \character{a}, or
78\character{0}, are the simplest regular expressions; they simply match
79themselves. You can concatenate ordinary characters, so \regexp{last}
80matches the string \code{'last'}. (In the rest of this section, we'll
81write RE's in \regexp{this special style}, usually without quotes, and
82strings to be matched \code{'in single quotes'}.)
Guido van Rossum1acceb01997-08-14 23:12:18 +000083
Fred Drakef4bdb572001-07-12 14:13:43 +000084Some characters, like \character{|} or \character{(}, are special.
85Special characters either stand for classes of ordinary characters, or
86affect how the regular expressions around them are interpreted.
Guido van Rossum1acceb01997-08-14 23:12:18 +000087
88The special characters are:
Fred Draked16d4981998-09-10 20:21:00 +000089
Fred Drake1e270f01998-11-30 22:58:12 +000090\begin{list}{}{\leftmargin 0.7in \labelwidth 0.65in}
Fred Draked16d4981998-09-10 20:21:00 +000091
Andrew M. Kuchling25332811998-04-09 14:56:04 +000092\item[\character{.}] (Dot.) In the default mode, this matches any
Fred Drake20e01961998-02-19 15:09:35 +000093character except a newline. If the \constant{DOTALL} flag has been
Guido van Rossum1acceb01997-08-14 23:12:18 +000094specified, this matches any character including a newline.
Fred Draked16d4981998-09-10 20:21:00 +000095
Andrew M. Kuchling25332811998-04-09 14:56:04 +000096\item[\character{\^}] (Caret.) Matches the start of the string, and in
97\constant{MULTILINE} mode also matches immediately after each newline.
Fred Draked16d4981998-09-10 20:21:00 +000098
Fred Drakec547b462001-07-23 21:14:59 +000099\item[\character{\$}] Matches the end of the string or just before the
100newline at the end of the string, and in \constant{MULTILINE} mode
101also matches before a newline. \regexp{foo} matches both 'foo' and
102'foobar', while the regular expression \regexp{foo\$} matches only
103'foo'. More interestingly, searching for \regexp{foo\e d} in
104'foo1\textbackslash nfoo2\textbackslash n' matches 'foo2' normally,
105but 'foo1' in \constant{MULTILINE} mode.
Fred Draked16d4981998-09-10 20:21:00 +0000106
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000107\item[\character{*}] Causes the resulting RE to
Guido van Rossum1acceb01997-08-14 23:12:18 +0000108match 0 or more repetitions of the preceding RE, as many repetitions
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000109as are possible. \regexp{ab*} will
Guido van Rossum1acceb01997-08-14 23:12:18 +0000110match 'a', 'ab', or 'a' followed by any number of 'b's.
Fred Draked16d4981998-09-10 20:21:00 +0000111
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000112\item[\character{+}] Causes the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000113resulting RE to match 1 or more repetitions of the preceding RE.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000114\regexp{ab+} will match 'a' followed by any non-zero number of 'b's; it
Guido van Rossum1acceb01997-08-14 23:12:18 +0000115will not match just 'a'.
Fred Draked16d4981998-09-10 20:21:00 +0000116
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000117\item[\character{?}] Causes the resulting RE to
118match 0 or 1 repetitions of the preceding RE. \regexp{ab?} will
Guido van Rossum1acceb01997-08-14 23:12:18 +0000119match either 'a' or 'ab'.
Fred Drakef4bdb572001-07-12 14:13:43 +0000120
121\item[\code{*?}, \code{+?}, \code{??}] The \character{*},
122\character{+}, and \character{?} qualifiers are all \dfn{greedy}; they
123match as much text as possible. Sometimes this behaviour isn't
124desired; if the RE \regexp{<.*>} is matched against
125\code{'<H1>title</H1>'}, it will match the entire string, and not just
126\code{'<H1>'}. Adding \character{?} after the qualifier makes it
127perform the match in \dfn{non-greedy} or \dfn{minimal} fashion; as
128\emph{few} characters as possible will be matched. Using \regexp{.*?}
129in the previous expression will match only \code{'<H1>'}.
Fred Draked16d4981998-09-10 20:21:00 +0000130
Fred Drakee74f8de2001-08-01 16:56:51 +0000131\item[\code{\{\var{m}\}}]
132Specifies that exactly \var{m} copies of the previous RE should be
133matched; fewer matches cause the entire RE not to match. For example,
134\regexp{a\{6\}} will match exactly six \character{a} characters, but
135not five.
136
Guido van Rossum0148bbf1997-12-22 22:41:40 +0000137\item[\code{\{\var{m},\var{n}\}}] Causes the resulting RE to match from
138\var{m} to \var{n} repetitions of the preceding RE, attempting to
Andrew M. Kuchlingc1cea201998-10-28 15:44:14 +0000139match as many repetitions as possible. For example, \regexp{a\{3,5\}}
140will match from 3 to 5 \character{a} characters. Omitting \var{n}
Fred Drakee74f8de2001-08-01 16:56:51 +0000141specifies an infinite upper bound; you can't omit \var{m}. The comma
142may not be omitted or the modifier would be confused with the
143previously described form.
Fred Draked16d4981998-09-10 20:21:00 +0000144
Guido van Rossum0148bbf1997-12-22 22:41:40 +0000145\item[\code{\{\var{m},\var{n}\}?}] Causes the resulting RE to
146match from \var{m} to \var{n} repetitions of the preceding RE,
147attempting to match as \emph{few} repetitions as possible. This is
148the non-greedy version of the previous qualifier. For example, on the
Fred Draked16d4981998-09-10 20:21:00 +00001496-character string \code{'aaaaaa'}, \regexp{a\{3,5\}} will match 5
150\character{a} characters, while \regexp{a\{3,5\}?} will only match 3
151characters.
152
153\item[\character{\e}] Either escapes special characters (permitting
154you to match characters like \character{*}, \character{?}, and so
155forth), or signals a special sequence; special sequences are discussed
156below.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000157
158If you're not using a raw string to
159express the pattern, remember that Python also uses the
160backslash as an escape sequence in string literals; if the escape
161sequence isn't recognized by Python's parser, the backslash and
162subsequent character are included in the resulting string. However,
163if Python would recognize the resulting sequence, the backslash should
Fred Drake023f87f1998-01-12 19:16:24 +0000164be repeated twice. This is complicated and hard to understand, so
165it's highly recommended that you use raw strings for all but the
166simplest expressions.
Fred Draked16d4981998-09-10 20:21:00 +0000167
Guido van Rossum1acceb01997-08-14 23:12:18 +0000168\item[\code{[]}] Used to indicate a set of characters. Characters can
Guido van Rossum48d04371997-12-11 20:19:08 +0000169be listed individually, or a range of characters can be indicated by
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000170giving two characters and separating them by a \character{-}. Special
171characters are not active inside sets. For example, \regexp{[akm\$]}
Fred Drake76547c51998-04-03 05:59:05 +0000172will match any of the characters \character{a}, \character{k},
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000173\character{m}, or \character{\$}; \regexp{[a-z]}
174will match any lowercase letter, and \code{[a-zA-Z0-9]} matches any
Fred Drake1e270f01998-11-30 22:58:12 +0000175letter or digit. Character classes such as \code{\e w} or \code{\e S}
176(defined below) are also acceptable inside a range. If you want to
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000177include a \character{]} or a \character{-} inside a set, precede it with a
178backslash, or place it as the first character. The
179pattern \regexp{[]]} will match \code{']'}, for example.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000180
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000181You can match the characters not within a range by \dfn{complementing}
Fred Drakef4bdb572001-07-12 14:13:43 +0000182the set. This is indicated by including a \character{\^} as the first
183character of the set; \character{\^} elsewhere will simply match the
184\character{\^} character. For example, \regexp{[{\^}5]} will match
185any character except \character{5}.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000186
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000187\item[\character{|}]\code{A|B}, where A and B can be arbitrary REs,
Fred Drake062ea2e2000-10-06 19:59:22 +0000188creates a regular expression that will match either A or B. An
189arbitrary number of REs can be separated by the \character{|} in this
190way. This can be used inside groups (see below) as well. REs
191separated by \character{|} are tried from left to right, and the first
192one that allows the complete pattern to match is considered the
193accepted branch. This means that if \code{A} matches, \code{B} will
194never be tested, even if it would produce a longer overall match. In
195other words, the \character{|} operator is never greedy. To match a
196literal \character{|}, use \regexp{\e|}, or enclose it inside a
197character class, as in \regexp{[|]}.
Fred Draked16d4981998-09-10 20:21:00 +0000198
Guido van Rossum48d04371997-12-11 20:19:08 +0000199\item[\code{(...)}] Matches whatever regular expression is inside the
200parentheses, and indicates the start and end of a group; the contents
201of a group can be retrieved after a match has been performed, and can
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000202be matched later in the string with the \regexp{\e \var{number}} special
Fred Draked16d4981998-09-10 20:21:00 +0000203sequence, described below. To match the literals \character{(} or
Fred Drake2c4f5542000-10-10 22:00:03 +0000204\character{)}, use \regexp{\e(} or \regexp{\e)}, or enclose them
Fred Draked16d4981998-09-10 20:21:00 +0000205inside a character class: \regexp{[(] [)]}.
206
207\item[\code{(?...)}] This is an extension notation (a \character{?}
208following a \character{(} is not meaningful otherwise). The first
209character after the \character{?}
Guido van Rossum0b334101997-12-08 17:33:40 +0000210determines what the meaning and further syntax of the construct is.
Guido van Rossume9625e81998-04-02 01:32:24 +0000211Extensions usually do not create a new group;
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000212\regexp{(?P<\var{name}>...)} is the only exception to this rule.
Guido van Rossum0b334101997-12-08 17:33:40 +0000213Following are the currently supported extensions.
Fred Draked16d4981998-09-10 20:21:00 +0000214
Fred Drakee53793b2000-09-25 17:52:40 +0000215\item[\code{(?iLmsux)}] (One or more letters from the set \character{i},
216\character{L}, \character{m}, \character{s}, \character{u},
217\character{x}.) The group matches the empty string; the letters set
218the corresponding flags (\constant{re.I}, \constant{re.L},
219\constant{re.M}, \constant{re.S}, \constant{re.U}, \constant{re.X})
220for the entire regular expression. This is useful if you wish to
221include the flags as part of the regular expression, instead of
222passing a \var{flag} argument to the \function{compile()} function.
Fred Draked16d4981998-09-10 20:21:00 +0000223
Fred Drake062ea2e2000-10-06 19:59:22 +0000224Note that the \regexp{(?x)} flag changes how the expression is parsed.
225It should be used first in the expression string, or after one or more
226whitespace characters. If there are non-whitespace characters before
227the flag, the results are undefined.
228
Guido van Rossum1acceb01997-08-14 23:12:18 +0000229\item[\code{(?:...)}] A non-grouping version of regular parentheses.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000230Matches whatever regular expression is inside the parentheses, but the
231substring matched by the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000232group \emph{cannot} be retrieved after performing a match or
233referenced later in the pattern.
Fred Draked16d4981998-09-10 20:21:00 +0000234
Guido van Rossum1acceb01997-08-14 23:12:18 +0000235\item[\code{(?P<\var{name}>...)}] Similar to regular parentheses, but
Guido van Rossume9625e81998-04-02 01:32:24 +0000236the substring matched by the group is accessible via the symbolic group
Guido van Rossum1acceb01997-08-14 23:12:18 +0000237name \var{name}. Group names must be valid Python identifiers. A
238symbolic group is also a numbered group, just as if the group were not
239named. So the group named 'id' in the example above can also be
240referenced as the numbered group 1.
241
Guido van Rossum48d04371997-12-11 20:19:08 +0000242For example, if the pattern is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000243\regexp{(?P<id>[a-zA-Z_]\e w*)}, the group can be referenced by its
Fred Drake907e76b2001-07-06 20:30:11 +0000244name in arguments to methods of match objects, such as
245\code{m.group('id')} or \code{m.end('id')}, and also by name in
246pattern text (for example, \regexp{(?P=id)}) and replacement text
247(such as \code{\e g<id>}).
Fred Draked16d4981998-09-10 20:21:00 +0000248
Fred Drake023f87f1998-01-12 19:16:24 +0000249\item[\code{(?P=\var{name})}] Matches whatever text was matched by the
250earlier group named \var{name}.
Fred Draked16d4981998-09-10 20:21:00 +0000251
Fred Drake023f87f1998-01-12 19:16:24 +0000252\item[\code{(?\#...)}] A comment; the contents of the parentheses are
253simply ignored.
Fred Draked16d4981998-09-10 20:21:00 +0000254
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000255\item[\code{(?=...)}] Matches if \regexp{...} matches next, but doesn't
Fred Drake023f87f1998-01-12 19:16:24 +0000256consume any of the string. This is called a lookahead assertion. For
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000257example, \regexp{Isaac (?=Asimov)} will match \code{'Isaac~'} only if it's
258followed by \code{'Asimov'}.
Fred Draked16d4981998-09-10 20:21:00 +0000259
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000260\item[\code{(?!...)}] Matches if \regexp{...} doesn't match next. This
Fred Drake023f87f1998-01-12 19:16:24 +0000261is a negative lookahead assertion. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000262\regexp{Isaac (?!Asimov)} will match \code{'Isaac~'} only if it's \emph{not}
263followed by \code{'Asimov'}.
Guido van Rossum0b334101997-12-08 17:33:40 +0000264
Andrew M. Kuchling9351dd22000-10-05 15:22:28 +0000265\item[\code{(?<=...)}] Matches if the current position in the string
266is preceded by a match for \regexp{...} that ends at the current
267position. This is called a positive lookbehind assertion.
268\regexp{(?<=abc)def} will match \samp{abcdef}, since the lookbehind
269will back up 3 characters and check if the contained pattern matches.
270The contained pattern must only match strings of some fixed length,
271meaning that \regexp{abc} or \regexp{a|b} are allowed, but \regexp{a*}
272isn't.
273
274\item[\code{(?<!...)}] Matches if the current position in the string
275is not preceded by a match for \regexp{...}. This
276is called a negative lookbehind assertion. Similar to positive lookbehind
277assertions, the contained pattern must only match strings of some
278fixed length.
279
Fred Drake2705e801998-02-16 21:21:13 +0000280\end{list}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000281
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000282The special sequences consist of \character{\e} and a character from the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000283list below. If the ordinary character is not on the list, then the
284resulting RE will match the second character. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000285\regexp{\e\$} matches the character \character{\$}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000286
Fred Drake1e270f01998-11-30 22:58:12 +0000287\begin{list}{}{\leftmargin 0.7in \labelwidth 0.65in}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000288
Guido van Rossum1acceb01997-08-14 23:12:18 +0000289\item[\code{\e \var{number}}] Matches the contents of the group of the
Guido van Rossum0b334101997-12-08 17:33:40 +0000290same number. Groups are numbered starting from 1. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000291\regexp{(.+) \e 1} matches \code{'the the'} or \code{'55 55'}, but not
292\code{'the end'} (note
Guido van Rossum0b334101997-12-08 17:33:40 +0000293the space after the group). This special sequence can only be used to
294match one of the first 99 groups. If the first digit of \var{number}
295is 0, or \var{number} is 3 octal digits long, it will not be interpreted
296as a group match, but as the character with octal value \var{number}.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000297Inside the \character{[} and \character{]} of a character class, all numeric
Guido van Rossume9625e81998-04-02 01:32:24 +0000298escapes are treated as characters.
Fred Drakee53793b2000-09-25 17:52:40 +0000299
Guido van Rossum1acceb01997-08-14 23:12:18 +0000300\item[\code{\e A}] Matches only at the start of the string.
Fred Drakee53793b2000-09-25 17:52:40 +0000301
Guido van Rossum1acceb01997-08-14 23:12:18 +0000302\item[\code{\e b}] Matches the empty string, but only at the
303beginning or end of a word. A word is defined as a sequence of
304alphanumeric characters, so the end of a word is indicated by
Guido van Rossum48d04371997-12-11 20:19:08 +0000305whitespace or a non-alphanumeric character. Inside a character range,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000306\regexp{\e b} represents the backspace character, for compatibility with
Guido van Rossum48d04371997-12-11 20:19:08 +0000307Python's string literals.
Fred Drakee53793b2000-09-25 17:52:40 +0000308
Guido van Rossum0b334101997-12-08 17:33:40 +0000309\item[\code{\e B}] Matches the empty string, but only when it is
310\emph{not} at the beginning or end of a word.
Fred Drakee53793b2000-09-25 17:52:40 +0000311
Guido van Rossum1acceb01997-08-14 23:12:18 +0000312\item[\code{\e d}]Matches any decimal digit; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000313equivalent to the set \regexp{[0-9]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000314
Guido van Rossum1acceb01997-08-14 23:12:18 +0000315\item[\code{\e D}]Matches any non-digit character; this is
Fred Drakecd058531998-12-28 19:03:24 +0000316equivalent to the set \regexp{[{\^}0-9]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000317
Guido van Rossum1acceb01997-08-14 23:12:18 +0000318\item[\code{\e s}]Matches any whitespace character; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000319equivalent to the set \regexp{[ \e t\e n\e r\e f\e v]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000320
Guido van Rossum1acceb01997-08-14 23:12:18 +0000321\item[\code{\e S}]Matches any non-whitespace character; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000322equivalent to the set \regexp{[\^\ \e t\e n\e r\e f\e v]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000323
324\item[\code{\e w}]When the \constant{LOCALE} and \constant{UNICODE}
325flags are not specified,
Fred Drake023f87f1998-01-12 19:16:24 +0000326matches any alphanumeric character; this is equivalent to the set
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000327\regexp{[a-zA-Z0-9_]}. With \constant{LOCALE}, it will match the set
Fred Drakee53793b2000-09-25 17:52:40 +0000328\regexp{[0-9_]} plus whatever characters are defined as letters for
329the current locale. If \constant{UNICODE} is set, this will match the
330characters \regexp{[0-9_]} plus whatever is classified as alphanumeric
331in the Unicode character properties database.
332
333\item[\code{\e W}]When the \constant{LOCALE} and \constant{UNICODE}
334flags are not specified, matches any non-alphanumeric character; this
335is equivalent to the set \regexp{[{\^}a-zA-Z0-9_]}. With
336\constant{LOCALE}, it will match any character not in the set
337\regexp{[0-9_]}, and not defined as a letter for the current locale.
338If \constant{UNICODE} is set, this will match anything other than
339\regexp{[0-9_]} and characters marked at alphanumeric in the Unicode
340character properties database.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000341
342\item[\code{\e Z}]Matches only at the end of the string.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000343
344\item[\code{\e \e}] Matches a literal backslash.
345
Fred Drake2705e801998-02-16 21:21:13 +0000346\end{list}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000347
Fred Drake42de1851998-04-20 16:28:44 +0000348
Fred Drake768ac6b1998-12-22 18:19:45 +0000349\subsection{Matching vs. Searching \label{matching-searching}}
350\sectionauthor{Fred L. Drake, Jr.}{fdrake@acm.org}
351
Fred Drake768ac6b1998-12-22 18:19:45 +0000352Python offers two different primitive operations based on regular
353expressions: match and search. If you are accustomed to Perl's
354semantics, the search operation is what you're looking for. See the
355\function{search()} function and corresponding method of compiled
356regular expression objects.
357
358Note that match may differ from search using a regular expression
Fred Drake3d0971e1999-06-29 21:21:19 +0000359beginning with \character{\^}: \character{\^} matches only at the
360start of the string, or in \constant{MULTILINE} mode also immediately
361following a newline. The ``match'' operation succeeds only if the
362pattern matches at the start of the string regardless of mode, or at
363the starting position given by the optional \var{pos} argument
364regardless of whether a newline precedes it.
Fred Drake768ac6b1998-12-22 18:19:45 +0000365
366% Examples from Tim Peters:
367\begin{verbatim}
368re.compile("a").match("ba", 1) # succeeds
369re.compile("^a").search("ba", 1) # fails; 'a' not at start
370re.compile("^a").search("\na", 1) # fails; 'a' not at start
371re.compile("^a", re.M).search("\na", 1) # succeeds
372re.compile("^a", re.M).search("ba", 1) # fails; no preceding \n
373\end{verbatim}
374
375
Guido van Rossum1acceb01997-08-14 23:12:18 +0000376\subsection{Module Contents}
Fred Drake78f8e981997-12-29 21:39:39 +0000377\nodename{Contents of Module re}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000378
379The module defines the following functions and constants, and an exception:
380
Guido van Rossum1acceb01997-08-14 23:12:18 +0000381
Fred Drake013ad981998-03-08 07:38:27 +0000382\begin{funcdesc}{compile}{pattern\optional{, flags}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000383 Compile a regular expression pattern into a regular expression
Fred Drake20e01961998-02-19 15:09:35 +0000384 object, which can be used for matching using its \function{match()} and
385 \function{search()} methods, described below.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000386
Guido van Rossum0b334101997-12-08 17:33:40 +0000387 The expression's behaviour can be modified by specifying a
388 \var{flags} value. Values can be any of the following variables,
389 combined using bitwise OR (the \code{|} operator).
390
Fred Drake76547c51998-04-03 05:59:05 +0000391The sequence
392
393\begin{verbatim}
394prog = re.compile(pat)
395result = prog.match(str)
396\end{verbatim}
397
398is equivalent to
399
400\begin{verbatim}
401result = re.match(pat, str)
402\end{verbatim}
403
404but the version using \function{compile()} is more efficient when the
405expression will be used several times in a single program.
406%(The compiled version of the last pattern passed to
Fred Drake895aa9d2001-04-18 17:26:20 +0000407%\function{re.match()} or \function{re.search()} is cached, so
Fred Drake76547c51998-04-03 05:59:05 +0000408%programs that use only a single regular expression at a time needn't
409%worry about compiling regular expressions.)
410\end{funcdesc}
411
Fred Drake013ad981998-03-08 07:38:27 +0000412\begin{datadesc}{I}
413\dataline{IGNORECASE}
Fred Drakef4bdb572001-07-12 14:13:43 +0000414Perform case-insensitive matching; expressions like \regexp{[A-Z]}
415will match lowercase letters, too. This is not affected by the
416current locale.
Fred Drake013ad981998-03-08 07:38:27 +0000417\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000418
Fred Drake013ad981998-03-08 07:38:27 +0000419\begin{datadesc}{L}
420\dataline{LOCALE}
Fred Drakee53793b2000-09-25 17:52:40 +0000421Make \regexp{\e w}, \regexp{\e W}, \regexp{\e b}, and
422\regexp{\e B} dependent on the current locale.
Fred Drake013ad981998-03-08 07:38:27 +0000423\end{datadesc}
Guido van Rossuma42c1781997-12-09 20:41:47 +0000424
Fred Drake013ad981998-03-08 07:38:27 +0000425\begin{datadesc}{M}
426\dataline{MULTILINE}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000427When specified, the pattern character \character{\^} matches at the
Fred Drake023f87f1998-01-12 19:16:24 +0000428beginning of the string and at the beginning of each line
429(immediately following each newline); and the pattern character
Fred Drakef4bdb572001-07-12 14:13:43 +0000430\character{\$} matches at the end of the string and at the end of each
431line (immediately preceding each newline). By default, \character{\^}
432matches only at the beginning of the string, and \character{\$} only
433at the end of the string and immediately before the newline (if any)
434at the end of the string.
Fred Drake013ad981998-03-08 07:38:27 +0000435\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000436
Fred Drake013ad981998-03-08 07:38:27 +0000437\begin{datadesc}{S}
438\dataline{DOTALL}
Fred Drakee53793b2000-09-25 17:52:40 +0000439Make the \character{.} special character match any character at all,
440including a newline; without this flag, \character{.} will match
441anything \emph{except} a newline.
442\end{datadesc}
443
444\begin{datadesc}{U}
445\dataline{UNICODE}
446Make \regexp{\e w}, \regexp{\e W}, \regexp{\e b}, and
447\regexp{\e B} dependent on the Unicode character properties database.
448\versionadded{2.0}
Fred Drake013ad981998-03-08 07:38:27 +0000449\end{datadesc}
Guido van Rossum48d04371997-12-11 20:19:08 +0000450
Fred Drake013ad981998-03-08 07:38:27 +0000451\begin{datadesc}{X}
452\dataline{VERBOSE}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000453This flag allows you to write regular expressions that look nicer.
454Whitespace within the pattern is ignored,
Guido van Rossum48d04371997-12-11 20:19:08 +0000455except when in a character class or preceded by an unescaped
Fred Drakef4bdb572001-07-12 14:13:43 +0000456backslash, and, when a line contains a \character{\#} neither in a
457character class or preceded by an unescaped backslash, all characters
458from the leftmost such \character{\#} through the end of the line are
459ignored.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000460% XXX should add an example here
Fred Drake013ad981998-03-08 07:38:27 +0000461\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000462
Guido van Rossum0b334101997-12-08 17:33:40 +0000463
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000464\begin{funcdesc}{search}{pattern, string\optional{, flags}}
465 Scan through \var{string} looking for a location where the regular
466 expression \var{pattern} produces a match, and return a
467 corresponding \class{MatchObject} instance.
468 Return \code{None} if no
469 position in the string matches the pattern; note that this is
470 different from finding a zero-length match at some point in the string.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000471\end{funcdesc}
472
Fred Drake013ad981998-03-08 07:38:27 +0000473\begin{funcdesc}{match}{pattern, string\optional{, flags}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000474 If zero or more characters at the beginning of \var{string} match
475 the regular expression \var{pattern}, return a corresponding
Fred Drake20e01961998-02-19 15:09:35 +0000476 \class{MatchObject} instance. Return \code{None} if the string does not
Guido van Rossum1acceb01997-08-14 23:12:18 +0000477 match the pattern; note that this is different from a zero-length
478 match.
Fred Drake768ac6b1998-12-22 18:19:45 +0000479
480 \strong{Note:} If you want to locate a match anywhere in
481 \var{string}, use \method{search()} instead.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000482\end{funcdesc}
483
Fred Drake77a6c9e2000-09-07 14:00:51 +0000484\begin{funcdesc}{split}{pattern, string\optional{, maxsplit\code{ = 0}}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000485 Split \var{string} by the occurrences of \var{pattern}. If
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000486 capturing parentheses are used in \var{pattern}, then the text of all
487 groups in the pattern are also returned as part of the resulting list.
Guido van Rossum97546391998-01-12 18:58:53 +0000488 If \var{maxsplit} is nonzero, at most \var{maxsplit} splits
489 occur, and the remainder of the string is returned as the final
490 element of the list. (Incompatibility note: in the original Python
491 1.5 release, \var{maxsplit} was ignored. This has been fixed in
492 later releases.)
Fred Drake768ac6b1998-12-22 18:19:45 +0000493
Fred Drake19479911998-02-13 06:58:54 +0000494\begin{verbatim}
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000495>>> re.split('\W+', 'Words, words, words.')
Guido van Rossum1acceb01997-08-14 23:12:18 +0000496['Words', 'words', 'words', '']
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000497>>> re.split('(\W+)', 'Words, words, words.')
Guido van Rossum1acceb01997-08-14 23:12:18 +0000498['Words', ', ', 'words', ', ', 'words', '.', '']
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000499>>> re.split('\W+', 'Words, words, words.', 1)
Guido van Rossum97546391998-01-12 18:58:53 +0000500['Words', 'words, words.']
Fred Drake19479911998-02-13 06:58:54 +0000501\end{verbatim}
Fred Drake768ac6b1998-12-22 18:19:45 +0000502
Guido van Rossum1acceb01997-08-14 23:12:18 +0000503 This function combines and extends the functionality of
Fred Drake20e01961998-02-19 15:09:35 +0000504 the old \function{regsub.split()} and \function{regsub.splitx()}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000505\end{funcdesc}
506
Guido van Rossum6c373f71998-06-29 22:48:01 +0000507\begin{funcdesc}{findall}{pattern, string}
Fred Drakee74f8de2001-08-01 16:56:51 +0000508 Return a list of all non-overlapping matches of \var{pattern} in
509 \var{string}. If one or more groups are present in the pattern,
510 return a list of groups; this will be a list of tuples if the
511 pattern has more than one group. Empty matches are included in the
512 result.
513 \versionadded{1.5.2}
Guido van Rossum6c373f71998-06-29 22:48:01 +0000514\end{funcdesc}
515
Fred Drakee74f8de2001-08-01 16:56:51 +0000516\begin{funcdesc}{sub}{pattern, repl, string\optional{, count}}
517 Return the string obtained by replacing the leftmost non-overlapping
518 occurrences of \var{pattern} in \var{string} by the replacement
519 \var{repl}. If the pattern isn't found, \var{string} is returned
520 unchanged. \var{repl} can be a string or a function; if it is a
521 string, any backslash escapes in it are processed. That is,
522 \samp{\e n} is converted to a single newline character, \samp{\e r}
523 is converted to a linefeed, and so forth. Unknown escapes such as
524 \samp{\e j} are left alone. Backreferences, such as \samp{\e6}, are
525 replaced with the substring matched by group 6 in the pattern. For
526 example:
527
528\begin{verbatim}
529>>> re.sub(r'def\s+([a-zA-Z_][a-zA-Z_0-9]*)\s*\(\s*\):',
530... r'static PyObject*\npy_\1(void)\n{',
531... 'def myfunc():')
532'static PyObject*\npy_myfunc(void)\n{'
533\end{verbatim}
534
535 If \var{repl} is a function, it is called for every non-overlapping
536 occurrence of \var{pattern}. The function takes a single match
537 object argument, and returns the replacement string. For example:
Fred Drake768ac6b1998-12-22 18:19:45 +0000538
Fred Drake19479911998-02-13 06:58:54 +0000539\begin{verbatim}
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000540>>> def dashrepl(matchobj):
Guido van Rossume9625e81998-04-02 01:32:24 +0000541.... if matchobj.group(0) == '-': return ' '
542.... else: return '-'
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000543>>> re.sub('-{1,2}', dashrepl, 'pro----gram-files')
544'pro--gram files'
Fred Drake19479911998-02-13 06:58:54 +0000545\end{verbatim}
Fred Drake768ac6b1998-12-22 18:19:45 +0000546
Fred Drakee74f8de2001-08-01 16:56:51 +0000547 The pattern may be a string or an RE object; if you need to specify
548 regular expression flags, you must use a RE object, or use embedded
549 modifiers in a pattern; for example, \samp{sub("(?i)b+", "x", "bbbb
550 BBBB")} returns \code{'x x'}.
Fred Drake023f87f1998-01-12 19:16:24 +0000551
Fred Drakee74f8de2001-08-01 16:56:51 +0000552 The optional argument \var{count} is the maximum number of pattern
553 occurrences to be replaced; \var{count} must be a non-negative
554 integer. If omitted or zero, all occurrences will be replaced.
555 Empty matches for the pattern are replaced only when not adjacent to
556 a previous match, so \samp{sub('x*', '-', 'abc')} returns
557 \code{'-a-b-c-'}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000558
Fred Drakee74f8de2001-08-01 16:56:51 +0000559 In addition to character escapes and backreferences as described
560 above, \samp{\e g<name>} will use the substring matched by the group
561 named \samp{name}, as defined by the \regexp{(?P<name>...)} syntax.
562 \samp{\e g<number>} uses the corresponding group number;
563 \samp{\e g<2>} is therefore equivalent to \samp{\e 2}, but isn't
564 ambiguous in a replacement such as \samp{\e g<2>0}. \samp{\e 20}
565 would be interpreted as a reference to group 20, not a reference to
566 group 2 followed by the literal character \character{0}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000567\end{funcdesc}
568
Fred Drakee74f8de2001-08-01 16:56:51 +0000569\begin{funcdesc}{subn}{pattern, repl, string\optional{, count}}
570 Perform the same operation as \function{sub()}, but return a tuple
571 \code{(\var{new_string}, \var{number_of_subs_made})}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000572\end{funcdesc}
573
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000574\begin{funcdesc}{escape}{string}
575 Return \var{string} with all non-alphanumerics backslashed; this is
576 useful if you want to match an arbitrary literal string that may have
577 regular expression metacharacters in it.
578\end{funcdesc}
579
Guido van Rossum1acceb01997-08-14 23:12:18 +0000580\begin{excdesc}{error}
581 Exception raised when a string passed to one of the functions here
Fred Drake907e76b2001-07-06 20:30:11 +0000582 is not a valid regular expression (for example, it might contain
583 unmatched parentheses) or when some other error occurs during
584 compilation or matching. It is never an error if a string contains
585 no match for a pattern.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000586\end{excdesc}
587
Fred Drake42de1851998-04-20 16:28:44 +0000588
Fred Draked16d4981998-09-10 20:21:00 +0000589\subsection{Regular Expression Objects \label{re-objects}}
Fred Drake42de1851998-04-20 16:28:44 +0000590
Guido van Rossum1acceb01997-08-14 23:12:18 +0000591Compiled regular expression objects support the following methods and
592attributes:
593
Fred Drake77a6c9e2000-09-07 14:00:51 +0000594\begin{methoddesc}[RegexObject]{search}{string\optional{, pos\optional{,
595 endpos}}}
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000596 Scan through \var{string} looking for a location where this regular
597 expression produces a match, and return a
598 corresponding \class{MatchObject} instance. Return \code{None} if no
599 position in the string matches the pattern; note that this is
600 different from finding a zero-length match at some point in the string.
601
602 The optional \var{pos} and \var{endpos} parameters have the same
603 meaning as for the \method{match()} method.
604\end{methoddesc}
605
Fred Drake77a6c9e2000-09-07 14:00:51 +0000606\begin{methoddesc}[RegexObject]{match}{string\optional{, pos\optional{,
607 endpos}}}
Guido van Rossumeb53ae41997-10-05 18:54:07 +0000608 If zero or more characters at the beginning of \var{string} match
609 this regular expression, return a corresponding
Fred Drake20e01961998-02-19 15:09:35 +0000610 \class{MatchObject} instance. Return \code{None} if the string does not
Guido van Rossumeb53ae41997-10-05 18:54:07 +0000611 match the pattern; note that this is different from a zero-length
612 match.
Fred Drake768ac6b1998-12-22 18:19:45 +0000613
614 \strong{Note:} If you want to locate a match anywhere in
615 \var{string}, use \method{search()} instead.
616
Guido van Rossum1acceb01997-08-14 23:12:18 +0000617 The optional second parameter \var{pos} gives an index in the string
Andrew M. Kuchling65b78631998-06-22 15:02:42 +0000618 where the search is to start; it defaults to \code{0}. This is not
619 completely equivalent to slicing the string; the \code{'\^'} pattern
620 character matches at the real beginning of the string and at positions
621 just after a newline, but not necessarily at the index where the search
622 is to start.
Guido van Rossum0b334101997-12-08 17:33:40 +0000623
624 The optional parameter \var{endpos} limits how far the string will
625 be searched; it will be as if the string is \var{endpos} characters
626 long, so only the characters from \var{pos} to \var{endpos} will be
627 searched for a match.
Fred Drake76547c51998-04-03 05:59:05 +0000628\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000629
Fred Drake77a6c9e2000-09-07 14:00:51 +0000630\begin{methoddesc}[RegexObject]{split}{string\optional{,
Fred Drake76547c51998-04-03 05:59:05 +0000631 maxsplit\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000632Identical to the \function{split()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000633\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000634
Guido van Rossum6c373f71998-06-29 22:48:01 +0000635\begin{methoddesc}[RegexObject]{findall}{string}
636Identical to the \function{findall()} function, using the compiled pattern.
637\end{methoddesc}
638
Fred Drake76547c51998-04-03 05:59:05 +0000639\begin{methoddesc}[RegexObject]{sub}{repl, string\optional{, count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000640Identical to the \function{sub()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000641\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000642
Fred Drake76547c51998-04-03 05:59:05 +0000643\begin{methoddesc}[RegexObject]{subn}{repl, string\optional{,
644 count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000645Identical to the \function{subn()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000646\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000647
Guido van Rossum1acceb01997-08-14 23:12:18 +0000648
Fred Drake76547c51998-04-03 05:59:05 +0000649\begin{memberdesc}[RegexObject]{flags}
Fred Drake895aa9d2001-04-18 17:26:20 +0000650The flags argument used when the RE object was compiled, or
Fred Drake013ad981998-03-08 07:38:27 +0000651\code{0} if no flags were provided.
Fred Drake76547c51998-04-03 05:59:05 +0000652\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000653
Fred Drake76547c51998-04-03 05:59:05 +0000654\begin{memberdesc}[RegexObject]{groupindex}
Fred Drake013ad981998-03-08 07:38:27 +0000655A dictionary mapping any symbolic group names defined by
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000656\regexp{(?P<\var{id}>)} to group numbers. The dictionary is empty if no
Guido van Rossum1acceb01997-08-14 23:12:18 +0000657symbolic groups were used in the pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000658\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000659
Fred Drake76547c51998-04-03 05:59:05 +0000660\begin{memberdesc}[RegexObject]{pattern}
Fred Drake895aa9d2001-04-18 17:26:20 +0000661The pattern string from which the RE object was compiled.
Fred Drake76547c51998-04-03 05:59:05 +0000662\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000663
Fred Drake42de1851998-04-20 16:28:44 +0000664
Fred Draked16d4981998-09-10 20:21:00 +0000665\subsection{Match Objects \label{match-objects}}
Fred Drake023f87f1998-01-12 19:16:24 +0000666
Fred Drakef4bdb572001-07-12 14:13:43 +0000667\class{MatchObject} instances support the following methods and
668attributes:
Guido van Rossum1acceb01997-08-14 23:12:18 +0000669
Andrew M. Kuchling7a90db62000-10-05 12:35:29 +0000670\begin{methoddesc}[MatchObject]{expand}{template}
671 Return the string obtained by doing backslash substitution on the
672template string \var{template}, as done by the \method{sub()} method.
673Escapes such as \samp{\e n} are converted to the appropriate
Fred Drakef4bdb572001-07-12 14:13:43 +0000674characters, and numeric backreferences (\samp{\e 1}, \samp{\e 2}) and
675named backreferences (\samp{\e g<1>}, \samp{\e g<name>}) are replaced
676by the contents of the corresponding group.
Andrew M. Kuchling7a90db62000-10-05 12:35:29 +0000677\end{methoddesc}
678
Fred Drake77a6c9e2000-09-07 14:00:51 +0000679\begin{methoddesc}[MatchObject]{group}{\optional{group1, \moreargs}}
Guido van Rossum46503921998-01-19 23:14:17 +0000680Returns one or more subgroups of the match. If there is a single
681argument, the result is a single string; if there are
Guido van Rossum48d04371997-12-11 20:19:08 +0000682multiple arguments, the result is a tuple with one item per argument.
Fred Drake907e76b2001-07-06 20:30:11 +0000683Without arguments, \var{group1} defaults to zero (the whole match
Guido van Rossum46503921998-01-19 23:14:17 +0000684is returned).
685If a \var{groupN} argument is zero, the corresponding return value is the
Guido van Rossum48d04371997-12-11 20:19:08 +0000686entire matching string; if it is in the inclusive range [1..99], it is
Guido van Rossum791468f1998-04-03 20:07:37 +0000687the string matching the the corresponding parenthesized group. If a
688group number is negative or larger than the number of groups defined
689in the pattern, an \exception{IndexError} exception is raised.
690If a group is contained in a part of the pattern that did not match,
Fred Drakef4bdb572001-07-12 14:13:43 +0000691the corresponding result is \code{None}. If a group is contained in a
Guido van Rossum791468f1998-04-03 20:07:37 +0000692part of the pattern that matched multiple times, the last match is
693returned.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000694
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000695If the regular expression uses the \regexp{(?P<\var{name}>...)} syntax,
Guido van Rossum46503921998-01-19 23:14:17 +0000696the \var{groupN} arguments may also be strings identifying groups by
Guido van Rossum791468f1998-04-03 20:07:37 +0000697their group name. If a string argument is not used as a group name in
698the pattern, an \exception{IndexError} exception is raised.
Guido van Rossume4eb2231997-12-17 00:23:39 +0000699
700A moderately complicated example:
Fred Drake023f87f1998-01-12 19:16:24 +0000701
702\begin{verbatim}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000703m = re.match(r"(?P<int>\d+)\.(\d*)", '3.14')
Fred Drake023f87f1998-01-12 19:16:24 +0000704\end{verbatim}
705
706After performing this match, \code{m.group(1)} is \code{'3'}, as is
Guido van Rossum46503921998-01-19 23:14:17 +0000707\code{m.group('int')}, and \code{m.group(2)} is \code{'14'}.
Fred Drake76547c51998-04-03 05:59:05 +0000708\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000709
Guido van Rossum6c373f71998-06-29 22:48:01 +0000710\begin{methoddesc}[MatchObject]{groups}{\optional{default}}
Guido van Rossum48d04371997-12-11 20:19:08 +0000711Return a tuple containing all the subgroups of the match, from 1 up to
Guido van Rossum6c373f71998-06-29 22:48:01 +0000712however many groups are in the pattern. The \var{default} argument is
713used for groups that did not participate in the match; it defaults to
714\code{None}. (Incompatibility note: in the original Python 1.5
715release, if the tuple was one element long, a string would be returned
716instead. In later versions (from 1.5.1 on), a singleton tuple is
717returned in such cases.)
718\end{methoddesc}
719
720\begin{methoddesc}[MatchObject]{groupdict}{\optional{default}}
721Return a dictionary containing all the \emph{named} subgroups of the
722match, keyed by the subgroup name. The \var{default} argument is
723used for groups that did not participate in the match; it defaults to
724\code{None}.
Fred Drake76547c51998-04-03 05:59:05 +0000725\end{methoddesc}
Guido van Rossum48d04371997-12-11 20:19:08 +0000726
Fred Drake76547c51998-04-03 05:59:05 +0000727\begin{methoddesc}[MatchObject]{start}{\optional{group}}
Fred Drake013ad981998-03-08 07:38:27 +0000728\funcline{end}{\optional{group}}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000729Return the indices of the start and end of the substring
Guido van Rossum46503921998-01-19 23:14:17 +0000730matched by \var{group}; \var{group} defaults to zero (meaning the whole
731matched substring).
Fred Drake77a6c9e2000-09-07 14:00:51 +0000732Return \code{-1} if \var{group} exists but
Guido van Rossume4eb2231997-12-17 00:23:39 +0000733did not contribute to the match. For a match object
Fred Drake023f87f1998-01-12 19:16:24 +0000734\var{m}, and a group \var{g} that did contribute to the match, the
735substring matched by group \var{g} (equivalent to
736\code{\var{m}.group(\var{g})}) is
737
738\begin{verbatim}
739m.string[m.start(g):m.end(g)]
740\end{verbatim}
741
Guido van Rossume4eb2231997-12-17 00:23:39 +0000742Note that
743\code{m.start(\var{group})} will equal \code{m.end(\var{group})} if
Fred Drake023f87f1998-01-12 19:16:24 +0000744\var{group} matched a null string. For example, after \code{\var{m} =
745re.search('b(c?)', 'cba')}, \code{\var{m}.start(0)} is 1,
746\code{\var{m}.end(0)} is 2, \code{\var{m}.start(1)} and
747\code{\var{m}.end(1)} are both 2, and \code{\var{m}.start(2)} raises
Fred Drake20e01961998-02-19 15:09:35 +0000748an \exception{IndexError} exception.
Fred Drake76547c51998-04-03 05:59:05 +0000749\end{methoddesc}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000750
Fred Drake76547c51998-04-03 05:59:05 +0000751\begin{methoddesc}[MatchObject]{span}{\optional{group}}
Fred Drake20e01961998-02-19 15:09:35 +0000752For \class{MatchObject} \var{m}, return the 2-tuple
Fred Drake023f87f1998-01-12 19:16:24 +0000753\code{(\var{m}.start(\var{group}), \var{m}.end(\var{group}))}.
Guido van Rossume4eb2231997-12-17 00:23:39 +0000754Note that if \var{group} did not contribute to the match, this is
Fred Drake77a6c9e2000-09-07 14:00:51 +0000755\code{(-1, -1)}. Again, \var{group} defaults to zero.
Fred Drake76547c51998-04-03 05:59:05 +0000756\end{methoddesc}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000757
Fred Drake76547c51998-04-03 05:59:05 +0000758\begin{memberdesc}[MatchObject]{pos}
Guido van Rossum0b334101997-12-08 17:33:40 +0000759The value of \var{pos} which was passed to the
Fred Drake895aa9d2001-04-18 17:26:20 +0000760\function{search()} or \function{match()} function. This is the index
761into the string at which the RE engine started looking for a match.
Fred Drake76547c51998-04-03 05:59:05 +0000762\end{memberdesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000763
Fred Drake76547c51998-04-03 05:59:05 +0000764\begin{memberdesc}[MatchObject]{endpos}
Guido van Rossum0b334101997-12-08 17:33:40 +0000765The value of \var{endpos} which was passed to the
Fred Drake895aa9d2001-04-18 17:26:20 +0000766\function{search()} or \function{match()} function. This is the index
767into the string beyond which the RE engine will not go.
Fred Drake76547c51998-04-03 05:59:05 +0000768\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000769
Andrew M. Kuchling75afc0b2000-10-18 23:08:13 +0000770\begin{memberdesc}[MatchObject]{lastgroup}
771The name of the last matched capturing group, or \code{None} if the
772group didn't have a name, or if no group was matched at all.
773\end{memberdesc}
774
775\begin{memberdesc}[MatchObject]{lastindex}
776The integer index of the last matched capturing group, or \code{None}
777if no group was matched at all.
778\end{memberdesc}
779
Fred Drake76547c51998-04-03 05:59:05 +0000780\begin{memberdesc}[MatchObject]{re}
Fred Drake20e01961998-02-19 15:09:35 +0000781The regular expression object whose \method{match()} or
782\method{search()} method produced this \class{MatchObject} instance.
Fred Drake76547c51998-04-03 05:59:05 +0000783\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000784
Fred Drake76547c51998-04-03 05:59:05 +0000785\begin{memberdesc}[MatchObject]{string}
Fred Drake20e01961998-02-19 15:09:35 +0000786The string passed to \function{match()} or \function{search()}.
Fred Drake76547c51998-04-03 05:59:05 +0000787\end{memberdesc}