blob: 4cadac17e8f3d7a7048736da0997c304d6704880 [file] [log] [blame]
Fred Drake295da241998-08-10 19:42:37 +00001\section{\module{re} ---
Fred Drake062ea2e2000-10-06 19:59:22 +00002 Regular expression operations}
Fred Drake66da9d61998-08-07 18:57:18 +00003\declaremodule{standard}{re}
Andrew M. Kuchlingaf5b7662000-06-27 03:16:04 +00004\moduleauthor{Andrew M. Kuchling}{amk1@bigfoot.com}
Fred Drake062ea2e2000-10-06 19:59:22 +00005\moduleauthor{Fredrik Lundh}{effbot@telia.com}
Andrew M. Kuchlingaf5b7662000-06-27 03:16:04 +00006\sectionauthor{Andrew M. Kuchling}{amk1@bigfoot.com}
Guido van Rossum1acceb01997-08-14 23:12:18 +00007
Fred Drakeb91e9341998-07-23 17:59:49 +00008
Fred Drake062ea2e2000-10-06 19:59:22 +00009\modulesynopsis{Regular expression search and match operations with a
10 Perl-style expression syntax.}
Fred Drakeb91e9341998-07-23 17:59:49 +000011
Guido van Rossum1acceb01997-08-14 23:12:18 +000012
Guido van Rossum1acceb01997-08-14 23:12:18 +000013This module provides regular expression matching operations similar to
Fred Drake062ea2e2000-10-06 19:59:22 +000014those found in Perl. Regular expression pattern strings may not
15contain null bytes, but can specify the null byte using the
16\code{\e\var{number}} notation. Both patterns and strings to be
17searched can be Unicode strings as well as 8-bit strings. The
18\module{re} module is always available.
Guido van Rossum1acceb01997-08-14 23:12:18 +000019
Andrew M. Kuchling25332811998-04-09 14:56:04 +000020Regular expressions use the backslash character (\character{\e}) to
Guido van Rossum1acceb01997-08-14 23:12:18 +000021indicate special forms or to allow special characters to be used
22without invoking their special meaning. This collides with Python's
23usage of the same character for the same purpose in string literals;
24for example, to match a literal backslash, one might have to write
Andrew M. Kuchling25332811998-04-09 14:56:04 +000025\code{'\e\e\e\e'} as the pattern string, because the regular expression
Fred Drake20e01961998-02-19 15:09:35 +000026must be \samp{\e\e}, and each backslash must be expressed as
27\samp{\e\e} inside a regular Python string literal.
Guido van Rossum1acceb01997-08-14 23:12:18 +000028
29The solution is to use Python's raw string notation for regular
30expression patterns; backslashes are not handled in any special way in
Andrew M. Kuchling25332811998-04-09 14:56:04 +000031a string literal prefixed with \character{r}. So \code{r"\e n"} is a
32two-character string containing \character{\e} and \character{n},
33while \code{"\e n"} is a one-character string containing a newline.
34Usually patterns will be expressed in Python code using this raw
35string notation.
Guido van Rossum1acceb01997-08-14 23:12:18 +000036
Fred Drake062ea2e2000-10-06 19:59:22 +000037\strong{Implementation note:}
38The \module{re}\refstmodindex{pre} module has two distinct
39implementations: \module{sre} is the default implementation and
40includes Unicode support, but may run into stack limitations for some
41patterns. Though this will be fixed for a future release of Python,
42the older implementation (without Unicode support) is still available
43as the \module{pre}\refstmodindex{pre} module.
44
45
Fred Drakee20bd192001-04-12 16:47:17 +000046\begin{seealso}
47 \seetitle{Mastering Regular Expressions}{Book on regular expressions
48 by Jeffrey Friedl, published by O'Reilly. The Python
49 material in this book dates from before the \refmodule{re}
50 module, but it covers writing good regular expression
51 patterns in great detail.}
52\end{seealso}
53
54
Fred Draked16d4981998-09-10 20:21:00 +000055\subsection{Regular Expression Syntax \label{re-syntax}}
Guido van Rossum1acceb01997-08-14 23:12:18 +000056
57A regular expression (or RE) specifies a set of strings that matches
58it; the functions in this module let you check if a particular string
59matches a given regular expression (or if a given regular expression
60matches a particular string, which comes down to the same thing).
61
62Regular expressions can be concatenated to form new regular
63expressions; if \emph{A} and \emph{B} are both regular expressions,
64then \emph{AB} is also an regular expression. If a string \emph{p}
65matches A and another string \emph{q} matches B, the string \emph{pq}
66will match AB. Thus, complex expressions can easily be constructed
67from simpler primitive expressions like the ones described here. For
68details of the theory and implementation of regular expressions,
69consult the Friedl book referenced below, or almost any textbook about
70compiler construction.
71
Andrew M. Kuchlingc1cea201998-10-28 15:44:14 +000072A brief explanation of the format of regular expressions follows. For
73further information and a gentler presentation, consult the Regular
74Expression HOWTO, accessible from \url{http://www.python.org/doc/howto/}.
Guido van Rossum1acceb01997-08-14 23:12:18 +000075
76Regular expressions can contain both special and ordinary characters.
Fred Drakef4bdb572001-07-12 14:13:43 +000077Most ordinary characters, like \character{A}, \character{a}, or
78\character{0}, are the simplest regular expressions; they simply match
79themselves. You can concatenate ordinary characters, so \regexp{last}
80matches the string \code{'last'}. (In the rest of this section, we'll
81write RE's in \regexp{this special style}, usually without quotes, and
82strings to be matched \code{'in single quotes'}.)
Guido van Rossum1acceb01997-08-14 23:12:18 +000083
Fred Drakef4bdb572001-07-12 14:13:43 +000084Some characters, like \character{|} or \character{(}, are special.
85Special characters either stand for classes of ordinary characters, or
86affect how the regular expressions around them are interpreted.
Guido van Rossum1acceb01997-08-14 23:12:18 +000087
88The special characters are:
Fred Draked16d4981998-09-10 20:21:00 +000089
Fred Drake1e270f01998-11-30 22:58:12 +000090\begin{list}{}{\leftmargin 0.7in \labelwidth 0.65in}
Fred Draked16d4981998-09-10 20:21:00 +000091
Andrew M. Kuchling25332811998-04-09 14:56:04 +000092\item[\character{.}] (Dot.) In the default mode, this matches any
Fred Drake20e01961998-02-19 15:09:35 +000093character except a newline. If the \constant{DOTALL} flag has been
Guido van Rossum1acceb01997-08-14 23:12:18 +000094specified, this matches any character including a newline.
Fred Draked16d4981998-09-10 20:21:00 +000095
Andrew M. Kuchling25332811998-04-09 14:56:04 +000096\item[\character{\^}] (Caret.) Matches the start of the string, and in
97\constant{MULTILINE} mode also matches immediately after each newline.
Fred Draked16d4981998-09-10 20:21:00 +000098
Andrew M. Kuchling25332811998-04-09 14:56:04 +000099\item[\character{\$}] Matches the end of the string, and in
Fred Drake20e01961998-02-19 15:09:35 +0000100\constant{MULTILINE} mode also matches before a newline.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000101\regexp{foo} matches both 'foo' and 'foobar', while the regular
102expression \regexp{foo\$} matches only 'foo'.
Fred Draked16d4981998-09-10 20:21:00 +0000103
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000104\item[\character{*}] Causes the resulting RE to
Guido van Rossum1acceb01997-08-14 23:12:18 +0000105match 0 or more repetitions of the preceding RE, as many repetitions
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000106as are possible. \regexp{ab*} will
Guido van Rossum1acceb01997-08-14 23:12:18 +0000107match 'a', 'ab', or 'a' followed by any number of 'b's.
Fred Draked16d4981998-09-10 20:21:00 +0000108
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000109\item[\character{+}] Causes the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000110resulting RE to match 1 or more repetitions of the preceding RE.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000111\regexp{ab+} will match 'a' followed by any non-zero number of 'b's; it
Guido van Rossum1acceb01997-08-14 23:12:18 +0000112will not match just 'a'.
Fred Draked16d4981998-09-10 20:21:00 +0000113
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000114\item[\character{?}] Causes the resulting RE to
115match 0 or 1 repetitions of the preceding RE. \regexp{ab?} will
Guido van Rossum1acceb01997-08-14 23:12:18 +0000116match either 'a' or 'ab'.
Fred Drakef4bdb572001-07-12 14:13:43 +0000117
118\item[\code{*?}, \code{+?}, \code{??}] The \character{*},
119\character{+}, and \character{?} qualifiers are all \dfn{greedy}; they
120match as much text as possible. Sometimes this behaviour isn't
121desired; if the RE \regexp{<.*>} is matched against
122\code{'<H1>title</H1>'}, it will match the entire string, and not just
123\code{'<H1>'}. Adding \character{?} after the qualifier makes it
124perform the match in \dfn{non-greedy} or \dfn{minimal} fashion; as
125\emph{few} characters as possible will be matched. Using \regexp{.*?}
126in the previous expression will match only \code{'<H1>'}.
Fred Draked16d4981998-09-10 20:21:00 +0000127
Guido van Rossum0148bbf1997-12-22 22:41:40 +0000128\item[\code{\{\var{m},\var{n}\}}] Causes the resulting RE to match from
129\var{m} to \var{n} repetitions of the preceding RE, attempting to
Andrew M. Kuchlingc1cea201998-10-28 15:44:14 +0000130match as many repetitions as possible. For example, \regexp{a\{3,5\}}
131will match from 3 to 5 \character{a} characters. Omitting \var{n}
132specifies an infinite upper bound; you can't omit \var{m}.
Fred Draked16d4981998-09-10 20:21:00 +0000133
Guido van Rossum0148bbf1997-12-22 22:41:40 +0000134\item[\code{\{\var{m},\var{n}\}?}] Causes the resulting RE to
135match from \var{m} to \var{n} repetitions of the preceding RE,
136attempting to match as \emph{few} repetitions as possible. This is
137the non-greedy version of the previous qualifier. For example, on the
Fred Draked16d4981998-09-10 20:21:00 +00001386-character string \code{'aaaaaa'}, \regexp{a\{3,5\}} will match 5
139\character{a} characters, while \regexp{a\{3,5\}?} will only match 3
140characters.
141
142\item[\character{\e}] Either escapes special characters (permitting
143you to match characters like \character{*}, \character{?}, and so
144forth), or signals a special sequence; special sequences are discussed
145below.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000146
147If you're not using a raw string to
148express the pattern, remember that Python also uses the
149backslash as an escape sequence in string literals; if the escape
150sequence isn't recognized by Python's parser, the backslash and
151subsequent character are included in the resulting string. However,
152if Python would recognize the resulting sequence, the backslash should
Fred Drake023f87f1998-01-12 19:16:24 +0000153be repeated twice. This is complicated and hard to understand, so
154it's highly recommended that you use raw strings for all but the
155simplest expressions.
Fred Draked16d4981998-09-10 20:21:00 +0000156
Guido van Rossum1acceb01997-08-14 23:12:18 +0000157\item[\code{[]}] Used to indicate a set of characters. Characters can
Guido van Rossum48d04371997-12-11 20:19:08 +0000158be listed individually, or a range of characters can be indicated by
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000159giving two characters and separating them by a \character{-}. Special
160characters are not active inside sets. For example, \regexp{[akm\$]}
Fred Drake76547c51998-04-03 05:59:05 +0000161will match any of the characters \character{a}, \character{k},
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000162\character{m}, or \character{\$}; \regexp{[a-z]}
163will match any lowercase letter, and \code{[a-zA-Z0-9]} matches any
Fred Drake1e270f01998-11-30 22:58:12 +0000164letter or digit. Character classes such as \code{\e w} or \code{\e S}
165(defined below) are also acceptable inside a range. If you want to
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000166include a \character{]} or a \character{-} inside a set, precede it with a
167backslash, or place it as the first character. The
168pattern \regexp{[]]} will match \code{']'}, for example.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000169
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000170You can match the characters not within a range by \dfn{complementing}
Fred Drakef4bdb572001-07-12 14:13:43 +0000171the set. This is indicated by including a \character{\^} as the first
172character of the set; \character{\^} elsewhere will simply match the
173\character{\^} character. For example, \regexp{[{\^}5]} will match
174any character except \character{5}.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000175
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000176\item[\character{|}]\code{A|B}, where A and B can be arbitrary REs,
Fred Drake062ea2e2000-10-06 19:59:22 +0000177creates a regular expression that will match either A or B. An
178arbitrary number of REs can be separated by the \character{|} in this
179way. This can be used inside groups (see below) as well. REs
180separated by \character{|} are tried from left to right, and the first
181one that allows the complete pattern to match is considered the
182accepted branch. This means that if \code{A} matches, \code{B} will
183never be tested, even if it would produce a longer overall match. In
184other words, the \character{|} operator is never greedy. To match a
185literal \character{|}, use \regexp{\e|}, or enclose it inside a
186character class, as in \regexp{[|]}.
Fred Draked16d4981998-09-10 20:21:00 +0000187
Guido van Rossum48d04371997-12-11 20:19:08 +0000188\item[\code{(...)}] Matches whatever regular expression is inside the
189parentheses, and indicates the start and end of a group; the contents
190of a group can be retrieved after a match has been performed, and can
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000191be matched later in the string with the \regexp{\e \var{number}} special
Fred Draked16d4981998-09-10 20:21:00 +0000192sequence, described below. To match the literals \character{(} or
Fred Drake2c4f5542000-10-10 22:00:03 +0000193\character{)}, use \regexp{\e(} or \regexp{\e)}, or enclose them
Fred Draked16d4981998-09-10 20:21:00 +0000194inside a character class: \regexp{[(] [)]}.
195
196\item[\code{(?...)}] This is an extension notation (a \character{?}
197following a \character{(} is not meaningful otherwise). The first
198character after the \character{?}
Guido van Rossum0b334101997-12-08 17:33:40 +0000199determines what the meaning and further syntax of the construct is.
Guido van Rossume9625e81998-04-02 01:32:24 +0000200Extensions usually do not create a new group;
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000201\regexp{(?P<\var{name}>...)} is the only exception to this rule.
Guido van Rossum0b334101997-12-08 17:33:40 +0000202Following are the currently supported extensions.
Fred Draked16d4981998-09-10 20:21:00 +0000203
Fred Drakee53793b2000-09-25 17:52:40 +0000204\item[\code{(?iLmsux)}] (One or more letters from the set \character{i},
205\character{L}, \character{m}, \character{s}, \character{u},
206\character{x}.) The group matches the empty string; the letters set
207the corresponding flags (\constant{re.I}, \constant{re.L},
208\constant{re.M}, \constant{re.S}, \constant{re.U}, \constant{re.X})
209for the entire regular expression. This is useful if you wish to
210include the flags as part of the regular expression, instead of
211passing a \var{flag} argument to the \function{compile()} function.
Fred Draked16d4981998-09-10 20:21:00 +0000212
Fred Drake062ea2e2000-10-06 19:59:22 +0000213Note that the \regexp{(?x)} flag changes how the expression is parsed.
214It should be used first in the expression string, or after one or more
215whitespace characters. If there are non-whitespace characters before
216the flag, the results are undefined.
217
Guido van Rossum1acceb01997-08-14 23:12:18 +0000218\item[\code{(?:...)}] A non-grouping version of regular parentheses.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000219Matches whatever regular expression is inside the parentheses, but the
220substring matched by the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000221group \emph{cannot} be retrieved after performing a match or
222referenced later in the pattern.
Fred Draked16d4981998-09-10 20:21:00 +0000223
Guido van Rossum1acceb01997-08-14 23:12:18 +0000224\item[\code{(?P<\var{name}>...)}] Similar to regular parentheses, but
Guido van Rossume9625e81998-04-02 01:32:24 +0000225the substring matched by the group is accessible via the symbolic group
Guido van Rossum1acceb01997-08-14 23:12:18 +0000226name \var{name}. Group names must be valid Python identifiers. A
227symbolic group is also a numbered group, just as if the group were not
228named. So the group named 'id' in the example above can also be
229referenced as the numbered group 1.
230
Guido van Rossum48d04371997-12-11 20:19:08 +0000231For example, if the pattern is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000232\regexp{(?P<id>[a-zA-Z_]\e w*)}, the group can be referenced by its
Fred Drake907e76b2001-07-06 20:30:11 +0000233name in arguments to methods of match objects, such as
234\code{m.group('id')} or \code{m.end('id')}, and also by name in
235pattern text (for example, \regexp{(?P=id)}) and replacement text
236(such as \code{\e g<id>}).
Fred Draked16d4981998-09-10 20:21:00 +0000237
Fred Drake023f87f1998-01-12 19:16:24 +0000238\item[\code{(?P=\var{name})}] Matches whatever text was matched by the
239earlier group named \var{name}.
Fred Draked16d4981998-09-10 20:21:00 +0000240
Fred Drake023f87f1998-01-12 19:16:24 +0000241\item[\code{(?\#...)}] A comment; the contents of the parentheses are
242simply ignored.
Fred Draked16d4981998-09-10 20:21:00 +0000243
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000244\item[\code{(?=...)}] Matches if \regexp{...} matches next, but doesn't
Fred Drake023f87f1998-01-12 19:16:24 +0000245consume any of the string. This is called a lookahead assertion. For
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000246example, \regexp{Isaac (?=Asimov)} will match \code{'Isaac~'} only if it's
247followed by \code{'Asimov'}.
Fred Draked16d4981998-09-10 20:21:00 +0000248
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000249\item[\code{(?!...)}] Matches if \regexp{...} doesn't match next. This
Fred Drake023f87f1998-01-12 19:16:24 +0000250is a negative lookahead assertion. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000251\regexp{Isaac (?!Asimov)} will match \code{'Isaac~'} only if it's \emph{not}
252followed by \code{'Asimov'}.
Guido van Rossum0b334101997-12-08 17:33:40 +0000253
Andrew M. Kuchling9351dd22000-10-05 15:22:28 +0000254\item[\code{(?<=...)}] Matches if the current position in the string
255is preceded by a match for \regexp{...} that ends at the current
256position. This is called a positive lookbehind assertion.
257\regexp{(?<=abc)def} will match \samp{abcdef}, since the lookbehind
258will back up 3 characters and check if the contained pattern matches.
259The contained pattern must only match strings of some fixed length,
260meaning that \regexp{abc} or \regexp{a|b} are allowed, but \regexp{a*}
261isn't.
262
263\item[\code{(?<!...)}] Matches if the current position in the string
264is not preceded by a match for \regexp{...}. This
265is called a negative lookbehind assertion. Similar to positive lookbehind
266assertions, the contained pattern must only match strings of some
267fixed length.
268
Fred Drake2705e801998-02-16 21:21:13 +0000269\end{list}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000270
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000271The special sequences consist of \character{\e} and a character from the
Guido van Rossum1acceb01997-08-14 23:12:18 +0000272list below. If the ordinary character is not on the list, then the
273resulting RE will match the second character. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000274\regexp{\e\$} matches the character \character{\$}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000275
Fred Drake1e270f01998-11-30 22:58:12 +0000276\begin{list}{}{\leftmargin 0.7in \labelwidth 0.65in}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000277
Guido van Rossum1acceb01997-08-14 23:12:18 +0000278\item[\code{\e \var{number}}] Matches the contents of the group of the
Guido van Rossum0b334101997-12-08 17:33:40 +0000279same number. Groups are numbered starting from 1. For example,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000280\regexp{(.+) \e 1} matches \code{'the the'} or \code{'55 55'}, but not
281\code{'the end'} (note
Guido van Rossum0b334101997-12-08 17:33:40 +0000282the space after the group). This special sequence can only be used to
283match one of the first 99 groups. If the first digit of \var{number}
284is 0, or \var{number} is 3 octal digits long, it will not be interpreted
285as a group match, but as the character with octal value \var{number}.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000286Inside the \character{[} and \character{]} of a character class, all numeric
Guido van Rossume9625e81998-04-02 01:32:24 +0000287escapes are treated as characters.
Fred Drakee53793b2000-09-25 17:52:40 +0000288
Guido van Rossum1acceb01997-08-14 23:12:18 +0000289\item[\code{\e A}] Matches only at the start of the string.
Fred Drakee53793b2000-09-25 17:52:40 +0000290
Guido van Rossum1acceb01997-08-14 23:12:18 +0000291\item[\code{\e b}] Matches the empty string, but only at the
292beginning or end of a word. A word is defined as a sequence of
293alphanumeric characters, so the end of a word is indicated by
Guido van Rossum48d04371997-12-11 20:19:08 +0000294whitespace or a non-alphanumeric character. Inside a character range,
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000295\regexp{\e b} represents the backspace character, for compatibility with
Guido van Rossum48d04371997-12-11 20:19:08 +0000296Python's string literals.
Fred Drakee53793b2000-09-25 17:52:40 +0000297
Guido van Rossum0b334101997-12-08 17:33:40 +0000298\item[\code{\e B}] Matches the empty string, but only when it is
299\emph{not} at the beginning or end of a word.
Fred Drakee53793b2000-09-25 17:52:40 +0000300
Guido van Rossum1acceb01997-08-14 23:12:18 +0000301\item[\code{\e d}]Matches any decimal digit; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000302equivalent to the set \regexp{[0-9]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000303
Guido van Rossum1acceb01997-08-14 23:12:18 +0000304\item[\code{\e D}]Matches any non-digit character; this is
Fred Drakecd058531998-12-28 19:03:24 +0000305equivalent to the set \regexp{[{\^}0-9]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000306
Guido van Rossum1acceb01997-08-14 23:12:18 +0000307\item[\code{\e s}]Matches any whitespace character; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000308equivalent to the set \regexp{[ \e t\e n\e r\e f\e v]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000309
Guido van Rossum1acceb01997-08-14 23:12:18 +0000310\item[\code{\e S}]Matches any non-whitespace character; this is
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000311equivalent to the set \regexp{[\^\ \e t\e n\e r\e f\e v]}.
Fred Drakee53793b2000-09-25 17:52:40 +0000312
313\item[\code{\e w}]When the \constant{LOCALE} and \constant{UNICODE}
314flags are not specified,
Fred Drake023f87f1998-01-12 19:16:24 +0000315matches any alphanumeric character; this is equivalent to the set
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000316\regexp{[a-zA-Z0-9_]}. With \constant{LOCALE}, it will match the set
Fred Drakee53793b2000-09-25 17:52:40 +0000317\regexp{[0-9_]} plus whatever characters are defined as letters for
318the current locale. If \constant{UNICODE} is set, this will match the
319characters \regexp{[0-9_]} plus whatever is classified as alphanumeric
320in the Unicode character properties database.
321
322\item[\code{\e W}]When the \constant{LOCALE} and \constant{UNICODE}
323flags are not specified, matches any non-alphanumeric character; this
324is equivalent to the set \regexp{[{\^}a-zA-Z0-9_]}. With
325\constant{LOCALE}, it will match any character not in the set
326\regexp{[0-9_]}, and not defined as a letter for the current locale.
327If \constant{UNICODE} is set, this will match anything other than
328\regexp{[0-9_]} and characters marked at alphanumeric in the Unicode
329character properties database.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000330
331\item[\code{\e Z}]Matches only at the end of the string.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000332
333\item[\code{\e \e}] Matches a literal backslash.
334
Fred Drake2705e801998-02-16 21:21:13 +0000335\end{list}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000336
Fred Drake42de1851998-04-20 16:28:44 +0000337
Fred Drake768ac6b1998-12-22 18:19:45 +0000338\subsection{Matching vs. Searching \label{matching-searching}}
339\sectionauthor{Fred L. Drake, Jr.}{fdrake@acm.org}
340
Fred Drake768ac6b1998-12-22 18:19:45 +0000341Python offers two different primitive operations based on regular
342expressions: match and search. If you are accustomed to Perl's
343semantics, the search operation is what you're looking for. See the
344\function{search()} function and corresponding method of compiled
345regular expression objects.
346
347Note that match may differ from search using a regular expression
Fred Drake3d0971e1999-06-29 21:21:19 +0000348beginning with \character{\^}: \character{\^} matches only at the
349start of the string, or in \constant{MULTILINE} mode also immediately
350following a newline. The ``match'' operation succeeds only if the
351pattern matches at the start of the string regardless of mode, or at
352the starting position given by the optional \var{pos} argument
353regardless of whether a newline precedes it.
Fred Drake768ac6b1998-12-22 18:19:45 +0000354
355% Examples from Tim Peters:
356\begin{verbatim}
357re.compile("a").match("ba", 1) # succeeds
358re.compile("^a").search("ba", 1) # fails; 'a' not at start
359re.compile("^a").search("\na", 1) # fails; 'a' not at start
360re.compile("^a", re.M).search("\na", 1) # succeeds
361re.compile("^a", re.M).search("ba", 1) # fails; no preceding \n
362\end{verbatim}
363
364
Guido van Rossum1acceb01997-08-14 23:12:18 +0000365\subsection{Module Contents}
Fred Drake78f8e981997-12-29 21:39:39 +0000366\nodename{Contents of Module re}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000367
368The module defines the following functions and constants, and an exception:
369
Guido van Rossum1acceb01997-08-14 23:12:18 +0000370
Fred Drake013ad981998-03-08 07:38:27 +0000371\begin{funcdesc}{compile}{pattern\optional{, flags}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000372 Compile a regular expression pattern into a regular expression
Fred Drake20e01961998-02-19 15:09:35 +0000373 object, which can be used for matching using its \function{match()} and
374 \function{search()} methods, described below.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000375
Guido van Rossum0b334101997-12-08 17:33:40 +0000376 The expression's behaviour can be modified by specifying a
377 \var{flags} value. Values can be any of the following variables,
378 combined using bitwise OR (the \code{|} operator).
379
Fred Drake76547c51998-04-03 05:59:05 +0000380The sequence
381
382\begin{verbatim}
383prog = re.compile(pat)
384result = prog.match(str)
385\end{verbatim}
386
387is equivalent to
388
389\begin{verbatim}
390result = re.match(pat, str)
391\end{verbatim}
392
393but the version using \function{compile()} is more efficient when the
394expression will be used several times in a single program.
395%(The compiled version of the last pattern passed to
Fred Drake895aa9d2001-04-18 17:26:20 +0000396%\function{re.match()} or \function{re.search()} is cached, so
Fred Drake76547c51998-04-03 05:59:05 +0000397%programs that use only a single regular expression at a time needn't
398%worry about compiling regular expressions.)
399\end{funcdesc}
400
Fred Drake013ad981998-03-08 07:38:27 +0000401\begin{datadesc}{I}
402\dataline{IGNORECASE}
Fred Drakef4bdb572001-07-12 14:13:43 +0000403Perform case-insensitive matching; expressions like \regexp{[A-Z]}
404will match lowercase letters, too. This is not affected by the
405current locale.
Fred Drake013ad981998-03-08 07:38:27 +0000406\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000407
Fred Drake013ad981998-03-08 07:38:27 +0000408\begin{datadesc}{L}
409\dataline{LOCALE}
Fred Drakee53793b2000-09-25 17:52:40 +0000410Make \regexp{\e w}, \regexp{\e W}, \regexp{\e b}, and
411\regexp{\e B} dependent on the current locale.
Fred Drake013ad981998-03-08 07:38:27 +0000412\end{datadesc}
Guido van Rossuma42c1781997-12-09 20:41:47 +0000413
Fred Drake013ad981998-03-08 07:38:27 +0000414\begin{datadesc}{M}
415\dataline{MULTILINE}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000416When specified, the pattern character \character{\^} matches at the
Fred Drake023f87f1998-01-12 19:16:24 +0000417beginning of the string and at the beginning of each line
418(immediately following each newline); and the pattern character
Fred Drakef4bdb572001-07-12 14:13:43 +0000419\character{\$} matches at the end of the string and at the end of each
420line (immediately preceding each newline). By default, \character{\^}
421matches only at the beginning of the string, and \character{\$} only
422at the end of the string and immediately before the newline (if any)
423at the end of the string.
Fred Drake013ad981998-03-08 07:38:27 +0000424\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000425
Fred Drake013ad981998-03-08 07:38:27 +0000426\begin{datadesc}{S}
427\dataline{DOTALL}
Fred Drakee53793b2000-09-25 17:52:40 +0000428Make the \character{.} special character match any character at all,
429including a newline; without this flag, \character{.} will match
430anything \emph{except} a newline.
431\end{datadesc}
432
433\begin{datadesc}{U}
434\dataline{UNICODE}
435Make \regexp{\e w}, \regexp{\e W}, \regexp{\e b}, and
436\regexp{\e B} dependent on the Unicode character properties database.
437\versionadded{2.0}
Fred Drake013ad981998-03-08 07:38:27 +0000438\end{datadesc}
Guido van Rossum48d04371997-12-11 20:19:08 +0000439
Fred Drake013ad981998-03-08 07:38:27 +0000440\begin{datadesc}{X}
441\dataline{VERBOSE}
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000442This flag allows you to write regular expressions that look nicer.
443Whitespace within the pattern is ignored,
Guido van Rossum48d04371997-12-11 20:19:08 +0000444except when in a character class or preceded by an unescaped
Fred Drakef4bdb572001-07-12 14:13:43 +0000445backslash, and, when a line contains a \character{\#} neither in a
446character class or preceded by an unescaped backslash, all characters
447from the leftmost such \character{\#} through the end of the line are
448ignored.
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000449% XXX should add an example here
Fred Drake013ad981998-03-08 07:38:27 +0000450\end{datadesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000451
Guido van Rossum0b334101997-12-08 17:33:40 +0000452
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000453\begin{funcdesc}{search}{pattern, string\optional{, flags}}
454 Scan through \var{string} looking for a location where the regular
455 expression \var{pattern} produces a match, and return a
456 corresponding \class{MatchObject} instance.
457 Return \code{None} if no
458 position in the string matches the pattern; note that this is
459 different from finding a zero-length match at some point in the string.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000460\end{funcdesc}
461
Fred Drake013ad981998-03-08 07:38:27 +0000462\begin{funcdesc}{match}{pattern, string\optional{, flags}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000463 If zero or more characters at the beginning of \var{string} match
464 the regular expression \var{pattern}, return a corresponding
Fred Drake20e01961998-02-19 15:09:35 +0000465 \class{MatchObject} instance. Return \code{None} if the string does not
Guido van Rossum1acceb01997-08-14 23:12:18 +0000466 match the pattern; note that this is different from a zero-length
467 match.
Fred Drake768ac6b1998-12-22 18:19:45 +0000468
469 \strong{Note:} If you want to locate a match anywhere in
470 \var{string}, use \method{search()} instead.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000471\end{funcdesc}
472
Fred Drake77a6c9e2000-09-07 14:00:51 +0000473\begin{funcdesc}{split}{pattern, string\optional{, maxsplit\code{ = 0}}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000474 Split \var{string} by the occurrences of \var{pattern}. If
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000475 capturing parentheses are used in \var{pattern}, then the text of all
476 groups in the pattern are also returned as part of the resulting list.
Guido van Rossum97546391998-01-12 18:58:53 +0000477 If \var{maxsplit} is nonzero, at most \var{maxsplit} splits
478 occur, and the remainder of the string is returned as the final
479 element of the list. (Incompatibility note: in the original Python
480 1.5 release, \var{maxsplit} was ignored. This has been fixed in
481 later releases.)
Fred Drake768ac6b1998-12-22 18:19:45 +0000482
Fred Drake19479911998-02-13 06:58:54 +0000483\begin{verbatim}
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000484>>> re.split('\W+', 'Words, words, words.')
Guido van Rossum1acceb01997-08-14 23:12:18 +0000485['Words', 'words', 'words', '']
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000486>>> re.split('(\W+)', 'Words, words, words.')
Guido van Rossum1acceb01997-08-14 23:12:18 +0000487['Words', ', ', 'words', ', ', 'words', '.', '']
Andrew M. Kuchlingd22e2501998-08-14 14:49:20 +0000488>>> re.split('\W+', 'Words, words, words.', 1)
Guido van Rossum97546391998-01-12 18:58:53 +0000489['Words', 'words, words.']
Fred Drake19479911998-02-13 06:58:54 +0000490\end{verbatim}
Fred Drake768ac6b1998-12-22 18:19:45 +0000491
Guido van Rossum1acceb01997-08-14 23:12:18 +0000492 This function combines and extends the functionality of
Fred Drake20e01961998-02-19 15:09:35 +0000493 the old \function{regsub.split()} and \function{regsub.splitx()}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000494\end{funcdesc}
495
Guido van Rossum6c373f71998-06-29 22:48:01 +0000496\begin{funcdesc}{findall}{pattern, string}
497Return a list of all non-overlapping matches of \var{pattern} in
498\var{string}. If one or more groups are present in the pattern,
499return a list of groups; this will be a list of tuples if the pattern
500has more than one group. Empty matches are included in the result.
Fred Drakedda199b1999-02-02 19:01:37 +0000501\versionadded{1.5.2}
Guido van Rossum6c373f71998-06-29 22:48:01 +0000502\end{funcdesc}
503
Fred Drake013ad981998-03-08 07:38:27 +0000504\begin{funcdesc}{sub}{pattern, repl, string\optional{, count\code{ = 0}}}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000505Return the string obtained by replacing the leftmost non-overlapping
506occurrences of \var{pattern} in \var{string} by the replacement
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000507\var{repl}. If the pattern isn't found, \var{string} is returned
508unchanged. \var{repl} can be a string or a function; if a function,
Fred Drakebfb092e1999-04-09 19:57:09 +0000509it is called for every non-overlapping occurrence of \var{pattern}.
Guido van Rossum0b334101997-12-08 17:33:40 +0000510The function takes a single match object argument, and returns the
511replacement string. For example:
Fred Drake768ac6b1998-12-22 18:19:45 +0000512
Fred Drake19479911998-02-13 06:58:54 +0000513\begin{verbatim}
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000514>>> def dashrepl(matchobj):
Guido van Rossume9625e81998-04-02 01:32:24 +0000515.... if matchobj.group(0) == '-': return ' '
516.... else: return '-'
Barry Warsaw4552f3d1997-11-20 00:15:13 +0000517>>> re.sub('-{1,2}', dashrepl, 'pro----gram-files')
518'pro--gram files'
Fred Drake19479911998-02-13 06:58:54 +0000519\end{verbatim}
Fred Drake768ac6b1998-12-22 18:19:45 +0000520
Fred Drake895aa9d2001-04-18 17:26:20 +0000521The pattern may be a string or an RE object; if you need to specify
522regular expression flags, you must use a RE object, or use
Fred Drake907e76b2001-07-06 20:30:11 +0000523embedded modifiers in a pattern; for example,
Fred Drake013ad981998-03-08 07:38:27 +0000524\samp{sub("(?i)b+", "x", "bbbb BBBB")} returns \code{'x x'}.
Fred Drake023f87f1998-01-12 19:16:24 +0000525
Guido van Rossum1acceb01997-08-14 23:12:18 +0000526The optional argument \var{count} is the maximum number of pattern
Fred Drakef4bdb572001-07-12 14:13:43 +0000527occurrences to be replaced; \var{count} must be a non-negative
528integer, and the default value of 0 means to replace all occurrences.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000529
530Empty matches for the pattern are replaced only when not adjacent to a
Fred Drakef4bdb572001-07-12 14:13:43 +0000531previous match, so \samp{sub('x*', '-', 'abc')} returns
532\code{'-a-b-c-'}.
Guido van Rossume9625e81998-04-02 01:32:24 +0000533
534If \var{repl} is a string, any backslash escapes in it are processed.
535That is, \samp{\e n} is converted to a single newline character,
536\samp{\e r} is converted to a linefeed, and so forth. Unknown escapes
Fred Drakef4bdb572001-07-12 14:13:43 +0000537such as \samp{\e j} are left alone. Backreferences, such as \samp{\e
5386}, are replaced with the substring matched by group 6 in the pattern.
Guido van Rossume9625e81998-04-02 01:32:24 +0000539
540In addition to character escapes and backreferences as described
541above, \samp{\e g<name>} will use the substring matched by the group
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000542named \samp{name}, as defined by the \regexp{(?P<name>...)} syntax.
Guido van Rossume9625e81998-04-02 01:32:24 +0000543\samp{\e g<number>} uses the corresponding group number; \samp{\e
544g<2>} is therefore equivalent to \samp{\e 2}, but isn't ambiguous in a
545replacement such as \samp{\e g<2>0}. \samp{\e 20} would be
546interpreted as a reference to group 20, not a reference to group 2
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000547followed by the literal character \character{0}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000548\end{funcdesc}
549
Fred Drake013ad981998-03-08 07:38:27 +0000550\begin{funcdesc}{subn}{pattern, repl, string\optional{, count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000551Perform the same operation as \function{sub()}, but return a tuple
Fred Drake023f87f1998-01-12 19:16:24 +0000552\code{(\var{new_string}, \var{number_of_subs_made})}.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000553\end{funcdesc}
554
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000555\begin{funcdesc}{escape}{string}
556 Return \var{string} with all non-alphanumerics backslashed; this is
557 useful if you want to match an arbitrary literal string that may have
558 regular expression metacharacters in it.
559\end{funcdesc}
560
Guido van Rossum1acceb01997-08-14 23:12:18 +0000561\begin{excdesc}{error}
562 Exception raised when a string passed to one of the functions here
Fred Drake907e76b2001-07-06 20:30:11 +0000563 is not a valid regular expression (for example, it might contain
564 unmatched parentheses) or when some other error occurs during
565 compilation or matching. It is never an error if a string contains
566 no match for a pattern.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000567\end{excdesc}
568
Fred Drake42de1851998-04-20 16:28:44 +0000569
Fred Draked16d4981998-09-10 20:21:00 +0000570\subsection{Regular Expression Objects \label{re-objects}}
Fred Drake42de1851998-04-20 16:28:44 +0000571
Guido van Rossum1acceb01997-08-14 23:12:18 +0000572Compiled regular expression objects support the following methods and
573attributes:
574
Fred Drake77a6c9e2000-09-07 14:00:51 +0000575\begin{methoddesc}[RegexObject]{search}{string\optional{, pos\optional{,
576 endpos}}}
Guido van Rossum7d447aa1998-10-13 16:03:52 +0000577 Scan through \var{string} looking for a location where this regular
578 expression produces a match, and return a
579 corresponding \class{MatchObject} instance. Return \code{None} if no
580 position in the string matches the pattern; note that this is
581 different from finding a zero-length match at some point in the string.
582
583 The optional \var{pos} and \var{endpos} parameters have the same
584 meaning as for the \method{match()} method.
585\end{methoddesc}
586
Fred Drake77a6c9e2000-09-07 14:00:51 +0000587\begin{methoddesc}[RegexObject]{match}{string\optional{, pos\optional{,
588 endpos}}}
Guido van Rossumeb53ae41997-10-05 18:54:07 +0000589 If zero or more characters at the beginning of \var{string} match
590 this regular expression, return a corresponding
Fred Drake20e01961998-02-19 15:09:35 +0000591 \class{MatchObject} instance. Return \code{None} if the string does not
Guido van Rossumeb53ae41997-10-05 18:54:07 +0000592 match the pattern; note that this is different from a zero-length
593 match.
Fred Drake768ac6b1998-12-22 18:19:45 +0000594
595 \strong{Note:} If you want to locate a match anywhere in
596 \var{string}, use \method{search()} instead.
597
Guido van Rossum1acceb01997-08-14 23:12:18 +0000598 The optional second parameter \var{pos} gives an index in the string
Andrew M. Kuchling65b78631998-06-22 15:02:42 +0000599 where the search is to start; it defaults to \code{0}. This is not
600 completely equivalent to slicing the string; the \code{'\^'} pattern
601 character matches at the real beginning of the string and at positions
602 just after a newline, but not necessarily at the index where the search
603 is to start.
Guido van Rossum0b334101997-12-08 17:33:40 +0000604
605 The optional parameter \var{endpos} limits how far the string will
606 be searched; it will be as if the string is \var{endpos} characters
607 long, so only the characters from \var{pos} to \var{endpos} will be
608 searched for a match.
Fred Drake76547c51998-04-03 05:59:05 +0000609\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000610
Fred Drake77a6c9e2000-09-07 14:00:51 +0000611\begin{methoddesc}[RegexObject]{split}{string\optional{,
Fred Drake76547c51998-04-03 05:59:05 +0000612 maxsplit\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000613Identical to the \function{split()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000614\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000615
Guido van Rossum6c373f71998-06-29 22:48:01 +0000616\begin{methoddesc}[RegexObject]{findall}{string}
617Identical to the \function{findall()} function, using the compiled pattern.
618\end{methoddesc}
619
Fred Drake76547c51998-04-03 05:59:05 +0000620\begin{methoddesc}[RegexObject]{sub}{repl, string\optional{, count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000621Identical to the \function{sub()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000622\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000623
Fred Drake76547c51998-04-03 05:59:05 +0000624\begin{methoddesc}[RegexObject]{subn}{repl, string\optional{,
625 count\code{ = 0}}}
Fred Drake20e01961998-02-19 15:09:35 +0000626Identical to the \function{subn()} function, using the compiled pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000627\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000628
Guido van Rossum1acceb01997-08-14 23:12:18 +0000629
Fred Drake76547c51998-04-03 05:59:05 +0000630\begin{memberdesc}[RegexObject]{flags}
Fred Drake895aa9d2001-04-18 17:26:20 +0000631The flags argument used when the RE object was compiled, or
Fred Drake013ad981998-03-08 07:38:27 +0000632\code{0} if no flags were provided.
Fred Drake76547c51998-04-03 05:59:05 +0000633\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000634
Fred Drake76547c51998-04-03 05:59:05 +0000635\begin{memberdesc}[RegexObject]{groupindex}
Fred Drake013ad981998-03-08 07:38:27 +0000636A dictionary mapping any symbolic group names defined by
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000637\regexp{(?P<\var{id}>)} to group numbers. The dictionary is empty if no
Guido van Rossum1acceb01997-08-14 23:12:18 +0000638symbolic groups were used in the pattern.
Fred Drake76547c51998-04-03 05:59:05 +0000639\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000640
Fred Drake76547c51998-04-03 05:59:05 +0000641\begin{memberdesc}[RegexObject]{pattern}
Fred Drake895aa9d2001-04-18 17:26:20 +0000642The pattern string from which the RE object was compiled.
Fred Drake76547c51998-04-03 05:59:05 +0000643\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000644
Fred Drake42de1851998-04-20 16:28:44 +0000645
Fred Draked16d4981998-09-10 20:21:00 +0000646\subsection{Match Objects \label{match-objects}}
Fred Drake023f87f1998-01-12 19:16:24 +0000647
Fred Drakef4bdb572001-07-12 14:13:43 +0000648\class{MatchObject} instances support the following methods and
649attributes:
Guido van Rossum1acceb01997-08-14 23:12:18 +0000650
Andrew M. Kuchling7a90db62000-10-05 12:35:29 +0000651\begin{methoddesc}[MatchObject]{expand}{template}
652 Return the string obtained by doing backslash substitution on the
653template string \var{template}, as done by the \method{sub()} method.
654Escapes such as \samp{\e n} are converted to the appropriate
Fred Drakef4bdb572001-07-12 14:13:43 +0000655characters, and numeric backreferences (\samp{\e 1}, \samp{\e 2}) and
656named backreferences (\samp{\e g<1>}, \samp{\e g<name>}) are replaced
657by the contents of the corresponding group.
Andrew M. Kuchling7a90db62000-10-05 12:35:29 +0000658\end{methoddesc}
659
Fred Drake77a6c9e2000-09-07 14:00:51 +0000660\begin{methoddesc}[MatchObject]{group}{\optional{group1, \moreargs}}
Guido van Rossum46503921998-01-19 23:14:17 +0000661Returns one or more subgroups of the match. If there is a single
662argument, the result is a single string; if there are
Guido van Rossum48d04371997-12-11 20:19:08 +0000663multiple arguments, the result is a tuple with one item per argument.
Fred Drake907e76b2001-07-06 20:30:11 +0000664Without arguments, \var{group1} defaults to zero (the whole match
Guido van Rossum46503921998-01-19 23:14:17 +0000665is returned).
666If a \var{groupN} argument is zero, the corresponding return value is the
Guido van Rossum48d04371997-12-11 20:19:08 +0000667entire matching string; if it is in the inclusive range [1..99], it is
Guido van Rossum791468f1998-04-03 20:07:37 +0000668the string matching the the corresponding parenthesized group. If a
669group number is negative or larger than the number of groups defined
670in the pattern, an \exception{IndexError} exception is raised.
671If a group is contained in a part of the pattern that did not match,
Fred Drakef4bdb572001-07-12 14:13:43 +0000672the corresponding result is \code{None}. If a group is contained in a
Guido van Rossum791468f1998-04-03 20:07:37 +0000673part of the pattern that matched multiple times, the last match is
674returned.
Guido van Rossum1acceb01997-08-14 23:12:18 +0000675
Andrew M. Kuchling25332811998-04-09 14:56:04 +0000676If the regular expression uses the \regexp{(?P<\var{name}>...)} syntax,
Guido van Rossum46503921998-01-19 23:14:17 +0000677the \var{groupN} arguments may also be strings identifying groups by
Guido van Rossum791468f1998-04-03 20:07:37 +0000678their group name. If a string argument is not used as a group name in
679the pattern, an \exception{IndexError} exception is raised.
Guido van Rossume4eb2231997-12-17 00:23:39 +0000680
681A moderately complicated example:
Fred Drake023f87f1998-01-12 19:16:24 +0000682
683\begin{verbatim}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000684m = re.match(r"(?P<int>\d+)\.(\d*)", '3.14')
Fred Drake023f87f1998-01-12 19:16:24 +0000685\end{verbatim}
686
687After performing this match, \code{m.group(1)} is \code{'3'}, as is
Guido van Rossum46503921998-01-19 23:14:17 +0000688\code{m.group('int')}, and \code{m.group(2)} is \code{'14'}.
Fred Drake76547c51998-04-03 05:59:05 +0000689\end{methoddesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000690
Guido van Rossum6c373f71998-06-29 22:48:01 +0000691\begin{methoddesc}[MatchObject]{groups}{\optional{default}}
Guido van Rossum48d04371997-12-11 20:19:08 +0000692Return a tuple containing all the subgroups of the match, from 1 up to
Guido van Rossum6c373f71998-06-29 22:48:01 +0000693however many groups are in the pattern. The \var{default} argument is
694used for groups that did not participate in the match; it defaults to
695\code{None}. (Incompatibility note: in the original Python 1.5
696release, if the tuple was one element long, a string would be returned
697instead. In later versions (from 1.5.1 on), a singleton tuple is
698returned in such cases.)
699\end{methoddesc}
700
701\begin{methoddesc}[MatchObject]{groupdict}{\optional{default}}
702Return a dictionary containing all the \emph{named} subgroups of the
703match, keyed by the subgroup name. The \var{default} argument is
704used for groups that did not participate in the match; it defaults to
705\code{None}.
Fred Drake76547c51998-04-03 05:59:05 +0000706\end{methoddesc}
Guido van Rossum48d04371997-12-11 20:19:08 +0000707
Fred Drake76547c51998-04-03 05:59:05 +0000708\begin{methoddesc}[MatchObject]{start}{\optional{group}}
Fred Drake013ad981998-03-08 07:38:27 +0000709\funcline{end}{\optional{group}}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000710Return the indices of the start and end of the substring
Guido van Rossum46503921998-01-19 23:14:17 +0000711matched by \var{group}; \var{group} defaults to zero (meaning the whole
712matched substring).
Fred Drake77a6c9e2000-09-07 14:00:51 +0000713Return \code{-1} if \var{group} exists but
Guido van Rossume4eb2231997-12-17 00:23:39 +0000714did not contribute to the match. For a match object
Fred Drake023f87f1998-01-12 19:16:24 +0000715\var{m}, and a group \var{g} that did contribute to the match, the
716substring matched by group \var{g} (equivalent to
717\code{\var{m}.group(\var{g})}) is
718
719\begin{verbatim}
720m.string[m.start(g):m.end(g)]
721\end{verbatim}
722
Guido van Rossume4eb2231997-12-17 00:23:39 +0000723Note that
724\code{m.start(\var{group})} will equal \code{m.end(\var{group})} if
Fred Drake023f87f1998-01-12 19:16:24 +0000725\var{group} matched a null string. For example, after \code{\var{m} =
726re.search('b(c?)', 'cba')}, \code{\var{m}.start(0)} is 1,
727\code{\var{m}.end(0)} is 2, \code{\var{m}.start(1)} and
728\code{\var{m}.end(1)} are both 2, and \code{\var{m}.start(2)} raises
Fred Drake20e01961998-02-19 15:09:35 +0000729an \exception{IndexError} exception.
Fred Drake76547c51998-04-03 05:59:05 +0000730\end{methoddesc}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000731
Fred Drake76547c51998-04-03 05:59:05 +0000732\begin{methoddesc}[MatchObject]{span}{\optional{group}}
Fred Drake20e01961998-02-19 15:09:35 +0000733For \class{MatchObject} \var{m}, return the 2-tuple
Fred Drake023f87f1998-01-12 19:16:24 +0000734\code{(\var{m}.start(\var{group}), \var{m}.end(\var{group}))}.
Guido van Rossume4eb2231997-12-17 00:23:39 +0000735Note that if \var{group} did not contribute to the match, this is
Fred Drake77a6c9e2000-09-07 14:00:51 +0000736\code{(-1, -1)}. Again, \var{group} defaults to zero.
Fred Drake76547c51998-04-03 05:59:05 +0000737\end{methoddesc}
Guido van Rossume4eb2231997-12-17 00:23:39 +0000738
Fred Drake76547c51998-04-03 05:59:05 +0000739\begin{memberdesc}[MatchObject]{pos}
Guido van Rossum0b334101997-12-08 17:33:40 +0000740The value of \var{pos} which was passed to the
Fred Drake895aa9d2001-04-18 17:26:20 +0000741\function{search()} or \function{match()} function. This is the index
742into the string at which the RE engine started looking for a match.
Fred Drake76547c51998-04-03 05:59:05 +0000743\end{memberdesc}
Guido van Rossum0b334101997-12-08 17:33:40 +0000744
Fred Drake76547c51998-04-03 05:59:05 +0000745\begin{memberdesc}[MatchObject]{endpos}
Guido van Rossum0b334101997-12-08 17:33:40 +0000746The value of \var{endpos} which was passed to the
Fred Drake895aa9d2001-04-18 17:26:20 +0000747\function{search()} or \function{match()} function. This is the index
748into the string beyond which the RE engine will not go.
Fred Drake76547c51998-04-03 05:59:05 +0000749\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000750
Andrew M. Kuchling75afc0b2000-10-18 23:08:13 +0000751\begin{memberdesc}[MatchObject]{lastgroup}
752The name of the last matched capturing group, or \code{None} if the
753group didn't have a name, or if no group was matched at all.
754\end{memberdesc}
755
756\begin{memberdesc}[MatchObject]{lastindex}
757The integer index of the last matched capturing group, or \code{None}
758if no group was matched at all.
759\end{memberdesc}
760
Fred Drake76547c51998-04-03 05:59:05 +0000761\begin{memberdesc}[MatchObject]{re}
Fred Drake20e01961998-02-19 15:09:35 +0000762The regular expression object whose \method{match()} or
763\method{search()} method produced this \class{MatchObject} instance.
Fred Drake76547c51998-04-03 05:59:05 +0000764\end{memberdesc}
Guido van Rossum1acceb01997-08-14 23:12:18 +0000765
Fred Drake76547c51998-04-03 05:59:05 +0000766\begin{memberdesc}[MatchObject]{string}
Fred Drake20e01961998-02-19 15:09:35 +0000767The string passed to \function{match()} or \function{search()}.
Fred Drake76547c51998-04-03 05:59:05 +0000768\end{memberdesc}