Fred Drake | 3a0351c | 1998-04-04 07:23:21 +0000 | [diff] [blame] | 1 | \section{Built-in Module \module{re}} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 2 | \label{module-re} |
| 3 | |
| 4 | \bimodindex{re} |
| 5 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 6 | This module provides regular expression matching operations similar to |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 7 | those found in Perl. It's 8-bit clean: the strings being processed |
| 8 | may contain both null bytes and characters whose high bit is set. Regular |
| 9 | expression patterns may not contain null bytes, but they may contain |
| 10 | characters with the high bit set. The \module{re} module is always |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 11 | available. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 12 | |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 13 | Regular expressions use the backslash character (\character{\e}) to |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 14 | indicate special forms or to allow special characters to be used |
| 15 | without invoking their special meaning. This collides with Python's |
| 16 | usage of the same character for the same purpose in string literals; |
| 17 | for example, to match a literal backslash, one might have to write |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 18 | \code{'\e\e\e\e'} as the pattern string, because the regular expression |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 19 | must be \samp{\e\e}, and each backslash must be expressed as |
| 20 | \samp{\e\e} inside a regular Python string literal. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 21 | |
| 22 | The solution is to use Python's raw string notation for regular |
| 23 | expression patterns; backslashes are not handled in any special way in |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 24 | a string literal prefixed with \character{r}. So \code{r"\e n"} is a |
| 25 | two-character string containing \character{\e} and \character{n}, |
| 26 | while \code{"\e n"} is a one-character string containing a newline. |
| 27 | Usually patterns will be expressed in Python code using this raw |
| 28 | string notation. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 29 | |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 30 | \subsection{Regular Expression Syntax} |
Fred Drake | 42de185 | 1998-04-20 16:28:44 +0000 | [diff] [blame] | 31 | \label{re-syntax} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 32 | |
| 33 | A regular expression (or RE) specifies a set of strings that matches |
| 34 | it; the functions in this module let you check if a particular string |
| 35 | matches a given regular expression (or if a given regular expression |
| 36 | matches a particular string, which comes down to the same thing). |
| 37 | |
| 38 | Regular expressions can be concatenated to form new regular |
| 39 | expressions; if \emph{A} and \emph{B} are both regular expressions, |
| 40 | then \emph{AB} is also an regular expression. If a string \emph{p} |
| 41 | matches A and another string \emph{q} matches B, the string \emph{pq} |
| 42 | will match AB. Thus, complex expressions can easily be constructed |
| 43 | from simpler primitive expressions like the ones described here. For |
| 44 | details of the theory and implementation of regular expressions, |
| 45 | consult the Friedl book referenced below, or almost any textbook about |
| 46 | compiler construction. |
| 47 | |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 48 | A brief explanation of the format of regular expressions follows. |
| 49 | %For further information and a gentler presentation, consult XXX somewhere. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 50 | |
| 51 | Regular expressions can contain both special and ordinary characters. |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 52 | Most ordinary characters, like \character{A}, \character{a}, or \character{0}, |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 53 | are the simplest regular expressions; they simply match themselves. |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 54 | You can concatenate ordinary characters, so \regexp{last} matches the |
| 55 | string \code{'last'}. (In the rest of this section, we'll write RE's in |
| 56 | \regexp{this special style}, usually without quotes, and strings to be |
| 57 | matched \code{'in single quotes'}.) |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 58 | |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 59 | Some characters, like \character{|} or \character{(}, are special. Special |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 60 | characters either stand for classes of ordinary characters, or affect |
| 61 | how the regular expressions around them are interpreted. |
| 62 | |
| 63 | The special characters are: |
Fred Drake | 2705e80 | 1998-02-16 21:21:13 +0000 | [diff] [blame] | 64 | % define these since they're used twice: |
| 65 | \newcommand{\MyLeftMargin}{0.7in} |
| 66 | \newcommand{\MyLabelWidth}{0.65in} |
| 67 | \begin{list}{}{\leftmargin \MyLeftMargin \labelwidth \MyLabelWidth} |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 68 | \item[\character{.}] (Dot.) In the default mode, this matches any |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 69 | character except a newline. If the \constant{DOTALL} flag has been |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 70 | specified, this matches any character including a newline. |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 71 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 72 | \item[\character{\^}] (Caret.) Matches the start of the string, and in |
| 73 | \constant{MULTILINE} mode also matches immediately after each newline. |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 74 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 75 | \item[\character{\$}] Matches the end of the string, and in |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 76 | \constant{MULTILINE} mode also matches before a newline. |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 77 | \regexp{foo} matches both 'foo' and 'foobar', while the regular |
| 78 | expression \regexp{foo\$} matches only 'foo'. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 79 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 80 | \item[\character{*}] Causes the resulting RE to |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 81 | match 0 or more repetitions of the preceding RE, as many repetitions |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 82 | as are possible. \regexp{ab*} will |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 83 | match 'a', 'ab', or 'a' followed by any number of 'b's. |
| 84 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 85 | \item[\character{+}] Causes the |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 86 | resulting RE to match 1 or more repetitions of the preceding RE. |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 87 | \regexp{ab+} will match 'a' followed by any non-zero number of 'b's; it |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 88 | will not match just 'a'. |
| 89 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 90 | \item[\character{?}] Causes the resulting RE to |
| 91 | match 0 or 1 repetitions of the preceding RE. \regexp{ab?} will |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 92 | match either 'a' or 'ab'. |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 93 | \item[\code{*?}, \code{+?}, \code{??}] The \character{*}, \character{+}, and |
| 94 | \character{?} qualifiers are all \dfn{greedy}; they match as much text as |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 95 | possible. Sometimes this behaviour isn't desired; if the RE |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 96 | \regexp{<.*>} is matched against \code{'<H1>title</H1>'}, it will match the |
| 97 | entire string, and not just \code{'<H1>'}. |
| 98 | Adding \character{?} after the qualifier makes it perform the match in |
| 99 | \dfn{non-greedy} or \dfn{minimal} fashion; as \emph{few} characters as |
| 100 | possible will be matched. Using \regexp{.*?} in the previous |
| 101 | expression will match only \code{'<H1>'}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 102 | % |
Guido van Rossum | 0148bbf | 1997-12-22 22:41:40 +0000 | [diff] [blame] | 103 | \item[\code{\{\var{m},\var{n}\}}] Causes the resulting RE to match from |
| 104 | \var{m} to \var{n} repetitions of the preceding RE, attempting to |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 105 | match as many repetitions as possible. For example, \regexp{a\{3,5\}} |
| 106 | will match from 3 to 5 \character{a} characters. Omitting \var{m} is the same |
| 107 | as specifying 0 for the lower bound; omitting \var{n} specifies an |
| 108 | infinite upper bound. |
Guido van Rossum | 0148bbf | 1997-12-22 22:41:40 +0000 | [diff] [blame] | 109 | % |
| 110 | \item[\code{\{\var{m},\var{n}\}?}] Causes the resulting RE to |
| 111 | match from \var{m} to \var{n} repetitions of the preceding RE, |
| 112 | attempting to match as \emph{few} repetitions as possible. This is |
| 113 | the non-greedy version of the previous qualifier. For example, on the |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 114 | 6-character string \code{'aaaaaa'}, \regexp{a\{3,5\}} will match 5 \character{a} |
| 115 | characters, while \regexp{a\{3,5\}?} will only match 3 characters. |
Guido van Rossum | 0148bbf | 1997-12-22 22:41:40 +0000 | [diff] [blame] | 116 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 117 | \item[\character{\e}] Either escapes special characters (permitting you to match |
| 118 | characters like \character{*}, \character{?}, and so forth), or |
| 119 | signals a special sequence; special sequences are discussed below. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 120 | |
| 121 | If you're not using a raw string to |
| 122 | express the pattern, remember that Python also uses the |
| 123 | backslash as an escape sequence in string literals; if the escape |
| 124 | sequence isn't recognized by Python's parser, the backslash and |
| 125 | subsequent character are included in the resulting string. However, |
| 126 | if Python would recognize the resulting sequence, the backslash should |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 127 | be repeated twice. This is complicated and hard to understand, so |
| 128 | it's highly recommended that you use raw strings for all but the |
| 129 | simplest expressions. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 130 | % |
| 131 | \item[\code{[]}] Used to indicate a set of characters. Characters can |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 132 | be listed individually, or a range of characters can be indicated by |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 133 | giving two characters and separating them by a \character{-}. Special |
| 134 | characters are not active inside sets. For example, \regexp{[akm\$]} |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 135 | will match any of the characters \character{a}, \character{k}, |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 136 | \character{m}, or \character{\$}; \regexp{[a-z]} |
| 137 | will match any lowercase letter, and \code{[a-zA-Z0-9]} matches any |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 138 | letter or digit. Character classes such as \code{\e w} or \code {\e |
| 139 | S} (defined below) are also acceptable inside a range. If you want to |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 140 | include a \character{]} or a \character{-} inside a set, precede it with a |
| 141 | backslash, or place it as the first character. The |
| 142 | pattern \regexp{[]]} will match \code{']'}, for example. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 143 | |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 144 | You can match the characters not within a range by \dfn{complementing} |
| 145 | the set. This is indicated by including a |
| 146 | \character{\^} as the first character of the set; \character{\^} elsewhere will |
| 147 | simply match the \character{\^} character. For example, \regexp{[\^5]} |
| 148 | will match any character except \character{5}. |
| 149 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 150 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 151 | \item[\character{|}]\code{A|B}, where A and B can be arbitrary REs, |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 152 | creates a regular expression that will match either A or B. This can |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 153 | be used inside groups (see below) as well. To match a literal \character{|}, |
| 154 | use \regexp{\e|}, or enclose it inside a character class, as in \regexp{[|]}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 155 | % |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 156 | \item[\code{(...)}] Matches whatever regular expression is inside the |
| 157 | parentheses, and indicates the start and end of a group; the contents |
| 158 | of a group can be retrieved after a match has been performed, and can |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 159 | be matched later in the string with the \regexp{\e \var{number}} special |
| 160 | sequence, described below. To match the literals \character{(} or \character{')}, |
| 161 | use \regexp{\e(} or \regexp{\e)}, or enclose them inside a character |
| 162 | class: \regexp{[(] [)]}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 163 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 164 | \item[\code{(?...)}] This is an extension notation (a \character{?} following a |
| 165 | \character{(} is not meaningful otherwise). The first character after |
| 166 | the \character{?} |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 167 | determines what the meaning and further syntax of the construct is. |
Guido van Rossum | e9625e8 | 1998-04-02 01:32:24 +0000 | [diff] [blame] | 168 | Extensions usually do not create a new group; |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 169 | \regexp{(?P<\var{name}>...)} is the only exception to this rule. |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 170 | Following are the currently supported extensions. |
| 171 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 172 | \item[\code{(?iLmsx)}] (One or more letters from the set \character{i}, |
| 173 | \character{L}, \character{m}, \character{s}, \character{x}.) The group matches |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 174 | the empty string; the letters set the corresponding flags |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 175 | (\constant{re.I}, \constant{re.L}, \constant{re.M}, \constant{re.S}, |
| 176 | \constant{re.X}) for the entire regular expression. This is useful if |
Guido van Rossum | e9625e8 | 1998-04-02 01:32:24 +0000 | [diff] [blame] | 177 | you wish to include the flags as part of the regular expression, instead |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 178 | of passing a \var{flag} argument to the \function{compile()} function. |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 179 | % |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 180 | \item[\code{(?:...)}] A non-grouping version of regular parentheses. |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 181 | Matches whatever regular expression is inside the parentheses, but the |
| 182 | substring matched by the |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 183 | group \emph{cannot} be retrieved after performing a match or |
| 184 | referenced later in the pattern. |
| 185 | % |
| 186 | \item[\code{(?P<\var{name}>...)}] Similar to regular parentheses, but |
Guido van Rossum | e9625e8 | 1998-04-02 01:32:24 +0000 | [diff] [blame] | 187 | the substring matched by the group is accessible via the symbolic group |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 188 | name \var{name}. Group names must be valid Python identifiers. A |
| 189 | symbolic group is also a numbered group, just as if the group were not |
| 190 | named. So the group named 'id' in the example above can also be |
| 191 | referenced as the numbered group 1. |
| 192 | |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 193 | For example, if the pattern is |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 194 | \regexp{(?P<id>[a-zA-Z_]\e w*)}, the group can be referenced by its |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 195 | name in arguments to methods of match objects, such as \code{m.group('id')} |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 196 | or \code{m.end('id')}, and also by name in pattern text |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 197 | (e.g. \regexp{(?P=id)}) and replacement text (e.g. \code{\e g<id>}). |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 198 | % |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 199 | \item[\code{(?P=\var{name})}] Matches whatever text was matched by the |
| 200 | earlier group named \var{name}. |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 201 | % |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 202 | \item[\code{(?\#...)}] A comment; the contents of the parentheses are |
| 203 | simply ignored. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 204 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 205 | \item[\code{(?=...)}] Matches if \regexp{...} matches next, but doesn't |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 206 | consume any of the string. This is called a lookahead assertion. For |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 207 | example, \regexp{Isaac (?=Asimov)} will match \code{'Isaac~'} only if it's |
| 208 | followed by \code{'Asimov'}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 209 | % |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 210 | \item[\code{(?!...)}] Matches if \regexp{...} doesn't match next. This |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 211 | is a negative lookahead assertion. For example, |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 212 | \regexp{Isaac (?!Asimov)} will match \code{'Isaac~'} only if it's \emph{not} |
| 213 | followed by \code{'Asimov'}. |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 214 | |
Fred Drake | 2705e80 | 1998-02-16 21:21:13 +0000 | [diff] [blame] | 215 | \end{list} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 216 | |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 217 | The special sequences consist of \character{\e} and a character from the |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 218 | list below. If the ordinary character is not on the list, then the |
| 219 | resulting RE will match the second character. For example, |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 220 | \regexp{\e\$} matches the character \character{\$}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 221 | |
Fred Drake | 2705e80 | 1998-02-16 21:21:13 +0000 | [diff] [blame] | 222 | \begin{list}{}{\leftmargin \MyLeftMargin \labelwidth \MyLabelWidth} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 223 | |
| 224 | % |
| 225 | \item[\code{\e \var{number}}] Matches the contents of the group of the |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 226 | same number. Groups are numbered starting from 1. For example, |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 227 | \regexp{(.+) \e 1} matches \code{'the the'} or \code{'55 55'}, but not |
| 228 | \code{'the end'} (note |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 229 | the space after the group). This special sequence can only be used to |
| 230 | match one of the first 99 groups. If the first digit of \var{number} |
| 231 | is 0, or \var{number} is 3 octal digits long, it will not be interpreted |
| 232 | as a group match, but as the character with octal value \var{number}. |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 233 | Inside the \character{[} and \character{]} of a character class, all numeric |
Guido van Rossum | e9625e8 | 1998-04-02 01:32:24 +0000 | [diff] [blame] | 234 | escapes are treated as characters. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 235 | % |
| 236 | \item[\code{\e A}] Matches only at the start of the string. |
| 237 | % |
| 238 | \item[\code{\e b}] Matches the empty string, but only at the |
| 239 | beginning or end of a word. A word is defined as a sequence of |
| 240 | alphanumeric characters, so the end of a word is indicated by |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 241 | whitespace or a non-alphanumeric character. Inside a character range, |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 242 | \regexp{\e b} represents the backspace character, for compatibility with |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 243 | Python's string literals. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 244 | % |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 245 | \item[\code{\e B}] Matches the empty string, but only when it is |
| 246 | \emph{not} at the beginning or end of a word. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 247 | % |
| 248 | \item[\code{\e d}]Matches any decimal digit; this is |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 249 | equivalent to the set \regexp{[0-9]}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 250 | % |
| 251 | \item[\code{\e D}]Matches any non-digit character; this is |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 252 | equivalent to the set \regexp{[\^0-9]}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 253 | % |
| 254 | \item[\code{\e s}]Matches any whitespace character; this is |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 255 | equivalent to the set \regexp{[ \e t\e n\e r\e f\e v]}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 256 | % |
| 257 | \item[\code{\e S}]Matches any non-whitespace character; this is |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 258 | equivalent to the set \regexp{[\^\ \e t\e n\e r\e f\e v]}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 259 | % |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 260 | \item[\code{\e w}]When the \constant{LOCALE} flag is not specified, |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 261 | matches any alphanumeric character; this is equivalent to the set |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 262 | \regexp{[a-zA-Z0-9_]}. With \constant{LOCALE}, it will match the set |
| 263 | \regexp{[0-9_]} plus whatever characters are defined as letters for the |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 264 | current locale. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 265 | % |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 266 | \item[\code{\e W}]When the \constant{LOCALE} flag is not specified, |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 267 | matches any non-alphanumeric character; this is equivalent to the set |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 268 | \regexp{[\^a-zA-Z0-9_]}. With \constant{LOCALE}, it will match any |
| 269 | character not in the set \regexp{[0-9_]}, and not defined as a letter |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 270 | for the current locale. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 271 | |
| 272 | \item[\code{\e Z}]Matches only at the end of the string. |
| 273 | % |
| 274 | |
| 275 | \item[\code{\e \e}] Matches a literal backslash. |
| 276 | |
Fred Drake | 2705e80 | 1998-02-16 21:21:13 +0000 | [diff] [blame] | 277 | \end{list} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 278 | |
Fred Drake | 42de185 | 1998-04-20 16:28:44 +0000 | [diff] [blame] | 279 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 280 | \subsection{Module Contents} |
Fred Drake | 78f8e98 | 1997-12-29 21:39:39 +0000 | [diff] [blame] | 281 | \nodename{Contents of Module re} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 282 | |
| 283 | The module defines the following functions and constants, and an exception: |
| 284 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 285 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 286 | \begin{funcdesc}{compile}{pattern\optional{, flags}} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 287 | Compile a regular expression pattern into a regular expression |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 288 | object, which can be used for matching using its \function{match()} and |
| 289 | \function{search()} methods, described below. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 290 | |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 291 | The expression's behaviour can be modified by specifying a |
| 292 | \var{flags} value. Values can be any of the following variables, |
| 293 | combined using bitwise OR (the \code{|} operator). |
| 294 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 295 | The sequence |
| 296 | |
| 297 | \begin{verbatim} |
| 298 | prog = re.compile(pat) |
| 299 | result = prog.match(str) |
| 300 | \end{verbatim} |
| 301 | |
| 302 | is equivalent to |
| 303 | |
| 304 | \begin{verbatim} |
| 305 | result = re.match(pat, str) |
| 306 | \end{verbatim} |
| 307 | |
| 308 | but the version using \function{compile()} is more efficient when the |
| 309 | expression will be used several times in a single program. |
| 310 | %(The compiled version of the last pattern passed to |
| 311 | %\function{regex.match()} or \function{regex.search()} is cached, so |
| 312 | %programs that use only a single regular expression at a time needn't |
| 313 | %worry about compiling regular expressions.) |
| 314 | \end{funcdesc} |
| 315 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 316 | \begin{datadesc}{I} |
| 317 | \dataline{IGNORECASE} |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 318 | Perform case-insensitive matching; expressions like \regexp{[A-Z]} will match |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 319 | lowercase letters, too. This is not affected by the current locale. |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 320 | \end{datadesc} |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 321 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 322 | \begin{datadesc}{L} |
| 323 | \dataline{LOCALE} |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 324 | Make \regexp{\e w}, \regexp{\e W}, \regexp{\e b}, |
| 325 | \regexp{\e B}, dependent on the current locale. |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 326 | \end{datadesc} |
Guido van Rossum | a42c178 | 1997-12-09 20:41:47 +0000 | [diff] [blame] | 327 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 328 | \begin{datadesc}{M} |
| 329 | \dataline{MULTILINE} |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 330 | When specified, the pattern character \character{\^} matches at the |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 331 | beginning of the string and at the beginning of each line |
| 332 | (immediately following each newline); and the pattern character |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 333 | \character{\$} matches at the end of the string and at the end of each line |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 334 | (immediately preceding each newline). |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 335 | By default, \character{\^} matches only at the beginning of the string, and |
| 336 | \character{\$} only at the end of the string and immediately before the |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 337 | newline (if any) at the end of the string. |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 338 | \end{datadesc} |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 339 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 340 | \begin{datadesc}{S} |
| 341 | \dataline{DOTALL} |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 342 | Make the \character{.} special character match any character at all, including a |
| 343 | newline; without this flag, \character{.} will match anything \emph{except} |
Fred Drake | 78f8e98 | 1997-12-29 21:39:39 +0000 | [diff] [blame] | 344 | a newline. |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 345 | \end{datadesc} |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 346 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 347 | \begin{datadesc}{X} |
| 348 | \dataline{VERBOSE} |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 349 | This flag allows you to write regular expressions that look nicer. |
| 350 | Whitespace within the pattern is ignored, |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 351 | except when in a character class or preceded by an unescaped |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 352 | backslash, and, when a line contains a \character{\#} neither in a character |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 353 | class or preceded by an unescaped backslash, all characters from the |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 354 | leftmost such \character{\#} through the end of the line are ignored. |
| 355 | % XXX should add an example here |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 356 | \end{datadesc} |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 357 | |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 358 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 359 | \begin{funcdesc}{escape}{string} |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 360 | Return \var{string} with all non-alphanumerics backslashed; this is |
| 361 | useful if you want to match an arbitrary literal string that may have |
| 362 | regular expression metacharacters in it. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 363 | \end{funcdesc} |
| 364 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 365 | \begin{funcdesc}{match}{pattern, string\optional{, flags}} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 366 | If zero or more characters at the beginning of \var{string} match |
| 367 | the regular expression \var{pattern}, return a corresponding |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 368 | \class{MatchObject} instance. Return \code{None} if the string does not |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 369 | match the pattern; note that this is different from a zero-length |
| 370 | match. |
| 371 | \end{funcdesc} |
| 372 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 373 | \begin{funcdesc}{search}{pattern, string\optional{, flags}} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 374 | Scan through \var{string} looking for a location where the regular |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 375 | expression \var{pattern} produces a match, and return a |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 376 | corresponding \class{MatchObject} instance. |
Guido van Rossum | 0148bbf | 1997-12-22 22:41:40 +0000 | [diff] [blame] | 377 | Return \code{None} if no |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 378 | position in the string matches the pattern; note that this is |
| 379 | different from finding a zero-length match at some point in the string. |
| 380 | \end{funcdesc} |
| 381 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 382 | \begin{funcdesc}{split}{pattern, string, \optional{, maxsplit\code{ = 0}}} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 383 | Split \var{string} by the occurrences of \var{pattern}. If |
| 384 | capturing parentheses are used in pattern, then occurrences of |
| 385 | patterns or subpatterns are also returned. |
Guido van Rossum | 9754639 | 1998-01-12 18:58:53 +0000 | [diff] [blame] | 386 | If \var{maxsplit} is nonzero, at most \var{maxsplit} splits |
| 387 | occur, and the remainder of the string is returned as the final |
| 388 | element of the list. (Incompatibility note: in the original Python |
| 389 | 1.5 release, \var{maxsplit} was ignored. This has been fixed in |
| 390 | later releases.) |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 391 | % |
Fred Drake | 1947991 | 1998-02-13 06:58:54 +0000 | [diff] [blame] | 392 | \begin{verbatim} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 393 | >>> re.split('[\W]+', 'Words, words, words.') |
| 394 | ['Words', 'words', 'words', ''] |
| 395 | >>> re.split('([\W]+)', 'Words, words, words.') |
| 396 | ['Words', ', ', 'words', ', ', 'words', '.', ''] |
Guido van Rossum | 9754639 | 1998-01-12 18:58:53 +0000 | [diff] [blame] | 397 | >>> re.split('[\W]+', 'Words, words, words.', 1) |
| 398 | ['Words', 'words, words.'] |
Fred Drake | 1947991 | 1998-02-13 06:58:54 +0000 | [diff] [blame] | 399 | \end{verbatim} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 400 | % |
| 401 | This function combines and extends the functionality of |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 402 | the old \function{regsub.split()} and \function{regsub.splitx()}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 403 | \end{funcdesc} |
| 404 | |
Guido van Rossum | 6c373f7 | 1998-06-29 22:48:01 +0000 | [diff] [blame] | 405 | \begin{funcdesc}{findall}{pattern, string} |
| 406 | Return a list of all non-overlapping matches of \var{pattern} in |
| 407 | \var{string}. If one or more groups are present in the pattern, |
| 408 | return a list of groups; this will be a list of tuples if the pattern |
| 409 | has more than one group. Empty matches are included in the result. |
| 410 | \end{funcdesc} |
| 411 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 412 | \begin{funcdesc}{sub}{pattern, repl, string\optional{, count\code{ = 0}}} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 413 | Return the string obtained by replacing the leftmost non-overlapping |
| 414 | occurrences of \var{pattern} in \var{string} by the replacement |
Barry Warsaw | 4552f3d | 1997-11-20 00:15:13 +0000 | [diff] [blame] | 415 | \var{repl}. If the pattern isn't found, \var{string} is returned |
| 416 | unchanged. \var{repl} can be a string or a function; if a function, |
| 417 | it is called for every non-overlapping occurance of \var{pattern}. |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 418 | The function takes a single match object argument, and returns the |
| 419 | replacement string. For example: |
Barry Warsaw | 4552f3d | 1997-11-20 00:15:13 +0000 | [diff] [blame] | 420 | % |
Fred Drake | 1947991 | 1998-02-13 06:58:54 +0000 | [diff] [blame] | 421 | \begin{verbatim} |
Barry Warsaw | 4552f3d | 1997-11-20 00:15:13 +0000 | [diff] [blame] | 422 | >>> def dashrepl(matchobj): |
Guido van Rossum | e9625e8 | 1998-04-02 01:32:24 +0000 | [diff] [blame] | 423 | .... if matchobj.group(0) == '-': return ' ' |
| 424 | .... else: return '-' |
Barry Warsaw | 4552f3d | 1997-11-20 00:15:13 +0000 | [diff] [blame] | 425 | >>> re.sub('-{1,2}', dashrepl, 'pro----gram-files') |
| 426 | 'pro--gram files' |
Fred Drake | 1947991 | 1998-02-13 06:58:54 +0000 | [diff] [blame] | 427 | \end{verbatim} |
Barry Warsaw | 4552f3d | 1997-11-20 00:15:13 +0000 | [diff] [blame] | 428 | % |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 429 | The pattern may be a string or a |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 430 | regex object; if you need to specify |
| 431 | regular expression flags, you must use a regex object, or use |
| 432 | embedded modifiers in a pattern; e.g. |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 433 | \samp{sub("(?i)b+", "x", "bbbb BBBB")} returns \code{'x x'}. |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 434 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 435 | The optional argument \var{count} is the maximum number of pattern |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 436 | occurrences to be replaced; \var{count} must be a non-negative integer, and |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 437 | the default value of 0 means to replace all occurrences. |
| 438 | |
| 439 | Empty matches for the pattern are replaced only when not adjacent to a |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 440 | previous match, so \samp{sub('x*', '-', 'abc')} returns \code{'-a-b-c-'}. |
Guido van Rossum | e9625e8 | 1998-04-02 01:32:24 +0000 | [diff] [blame] | 441 | |
| 442 | If \var{repl} is a string, any backslash escapes in it are processed. |
| 443 | That is, \samp{\e n} is converted to a single newline character, |
| 444 | \samp{\e r} is converted to a linefeed, and so forth. Unknown escapes |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 445 | such as \samp{\e j} are left alone. Backreferences, such as \samp{\e 6}, are |
Guido van Rossum | e9625e8 | 1998-04-02 01:32:24 +0000 | [diff] [blame] | 446 | replaced with the substring matched by group 6 in the pattern. |
| 447 | |
| 448 | In addition to character escapes and backreferences as described |
| 449 | above, \samp{\e g<name>} will use the substring matched by the group |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 450 | named \samp{name}, as defined by the \regexp{(?P<name>...)} syntax. |
Guido van Rossum | e9625e8 | 1998-04-02 01:32:24 +0000 | [diff] [blame] | 451 | \samp{\e g<number>} uses the corresponding group number; \samp{\e |
| 452 | g<2>} is therefore equivalent to \samp{\e 2}, but isn't ambiguous in a |
| 453 | replacement such as \samp{\e g<2>0}. \samp{\e 20} would be |
| 454 | interpreted as a reference to group 20, not a reference to group 2 |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 455 | followed by the literal character \character{0}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 456 | \end{funcdesc} |
| 457 | |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 458 | \begin{funcdesc}{subn}{pattern, repl, string\optional{, count\code{ = 0}}} |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 459 | Perform the same operation as \function{sub()}, but return a tuple |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 460 | \code{(\var{new_string}, \var{number_of_subs_made})}. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 461 | \end{funcdesc} |
| 462 | |
| 463 | \begin{excdesc}{error} |
| 464 | Exception raised when a string passed to one of the functions here |
| 465 | is not a valid regular expression (e.g., unmatched parentheses) or |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 466 | when some other error occurs during compilation or matching. It is |
| 467 | never an error if a string contains no match for a pattern. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 468 | \end{excdesc} |
| 469 | |
Fred Drake | 42de185 | 1998-04-20 16:28:44 +0000 | [diff] [blame] | 470 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 471 | \subsection{Regular Expression Objects} |
Fred Drake | 42de185 | 1998-04-20 16:28:44 +0000 | [diff] [blame] | 472 | \label{re-objects} |
| 473 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 474 | Compiled regular expression objects support the following methods and |
| 475 | attributes: |
| 476 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 477 | \begin{methoddesc}[RegexObject]{match}{string\optional{, pos}\optional{, |
| 478 | endpos}} |
Guido van Rossum | eb53ae4 | 1997-10-05 18:54:07 +0000 | [diff] [blame] | 479 | If zero or more characters at the beginning of \var{string} match |
| 480 | this regular expression, return a corresponding |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 481 | \class{MatchObject} instance. Return \code{None} if the string does not |
Guido van Rossum | eb53ae4 | 1997-10-05 18:54:07 +0000 | [diff] [blame] | 482 | match the pattern; note that this is different from a zero-length |
| 483 | match. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 484 | |
| 485 | The optional second parameter \var{pos} gives an index in the string |
Andrew M. Kuchling | 65b7863 | 1998-06-22 15:02:42 +0000 | [diff] [blame] | 486 | where the search is to start; it defaults to \code{0}. This is not |
| 487 | completely equivalent to slicing the string; the \code{'\^'} pattern |
| 488 | character matches at the real beginning of the string and at positions |
| 489 | just after a newline, but not necessarily at the index where the search |
| 490 | is to start. |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 491 | |
| 492 | The optional parameter \var{endpos} limits how far the string will |
| 493 | be searched; it will be as if the string is \var{endpos} characters |
| 494 | long, so only the characters from \var{pos} to \var{endpos} will be |
| 495 | searched for a match. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 496 | \end{methoddesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 497 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 498 | \begin{methoddesc}[RegexObject]{search}{string\optional{, pos}\optional{, |
| 499 | endpos}} |
Guido van Rossum | eb53ae4 | 1997-10-05 18:54:07 +0000 | [diff] [blame] | 500 | Scan through \var{string} looking for a location where this regular |
| 501 | expression produces a match. Return \code{None} if no |
| 502 | position in the string matches the pattern; note that this is |
| 503 | different from finding a zero-length match at some point in the string. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 504 | |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 505 | The optional \var{pos} and \var{endpos} parameters have the same |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 506 | meaning as for the \method{match()} method. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 507 | \end{methoddesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 508 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 509 | \begin{methoddesc}[RegexObject]{split}{string, \optional{, |
| 510 | maxsplit\code{ = 0}}} |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 511 | Identical to the \function{split()} function, using the compiled pattern. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 512 | \end{methoddesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 513 | |
Guido van Rossum | 6c373f7 | 1998-06-29 22:48:01 +0000 | [diff] [blame] | 514 | \begin{methoddesc}[RegexObject]{findall}{string} |
| 515 | Identical to the \function{findall()} function, using the compiled pattern. |
| 516 | \end{methoddesc} |
| 517 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 518 | \begin{methoddesc}[RegexObject]{sub}{repl, string\optional{, count\code{ = 0}}} |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 519 | Identical to the \function{sub()} function, using the compiled pattern. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 520 | \end{methoddesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 521 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 522 | \begin{methoddesc}[RegexObject]{subn}{repl, string\optional{, |
| 523 | count\code{ = 0}}} |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 524 | Identical to the \function{subn()} function, using the compiled pattern. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 525 | \end{methoddesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 526 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 527 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 528 | \begin{memberdesc}[RegexObject]{flags} |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 529 | The flags argument used when the regex object was compiled, or |
| 530 | \code{0} if no flags were provided. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 531 | \end{memberdesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 532 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 533 | \begin{memberdesc}[RegexObject]{groupindex} |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 534 | A dictionary mapping any symbolic group names defined by |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 535 | \regexp{(?P<\var{id}>)} to group numbers. The dictionary is empty if no |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 536 | symbolic groups were used in the pattern. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 537 | \end{memberdesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 538 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 539 | \begin{memberdesc}[RegexObject]{pattern} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 540 | The pattern string from which the regex object was compiled. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 541 | \end{memberdesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 542 | |
Fred Drake | 42de185 | 1998-04-20 16:28:44 +0000 | [diff] [blame] | 543 | |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 544 | \subsection{Match Objects} |
Fred Drake | 42de185 | 1998-04-20 16:28:44 +0000 | [diff] [blame] | 545 | \label{match-objects} |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 546 | |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 547 | \class{MatchObject} instances support the following methods and attributes: |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 548 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 549 | \begin{methoddesc}[MatchObject]{group}{\optional{group1, group2, ...}} |
Guido van Rossum | 4650392 | 1998-01-19 23:14:17 +0000 | [diff] [blame] | 550 | Returns one or more subgroups of the match. If there is a single |
| 551 | argument, the result is a single string; if there are |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 552 | multiple arguments, the result is a tuple with one item per argument. |
Guido van Rossum | 4650392 | 1998-01-19 23:14:17 +0000 | [diff] [blame] | 553 | Without arguments, \var{group1} defaults to zero (i.e. the whole match |
| 554 | is returned). |
| 555 | If a \var{groupN} argument is zero, the corresponding return value is the |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 556 | entire matching string; if it is in the inclusive range [1..99], it is |
Guido van Rossum | 791468f | 1998-04-03 20:07:37 +0000 | [diff] [blame] | 557 | the string matching the the corresponding parenthesized group. If a |
| 558 | group number is negative or larger than the number of groups defined |
| 559 | in the pattern, an \exception{IndexError} exception is raised. |
| 560 | If a group is contained in a part of the pattern that did not match, |
| 561 | the corresponding result is \code{None}. If a group is contained in a |
| 562 | part of the pattern that matched multiple times, the last match is |
| 563 | returned. |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 564 | |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 565 | If the regular expression uses the \regexp{(?P<\var{name}>...)} syntax, |
Guido van Rossum | 4650392 | 1998-01-19 23:14:17 +0000 | [diff] [blame] | 566 | the \var{groupN} arguments may also be strings identifying groups by |
Guido van Rossum | 791468f | 1998-04-03 20:07:37 +0000 | [diff] [blame] | 567 | their group name. If a string argument is not used as a group name in |
| 568 | the pattern, an \exception{IndexError} exception is raised. |
Guido van Rossum | e4eb223 | 1997-12-17 00:23:39 +0000 | [diff] [blame] | 569 | |
| 570 | A moderately complicated example: |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 571 | |
| 572 | \begin{verbatim} |
Guido van Rossum | e4eb223 | 1997-12-17 00:23:39 +0000 | [diff] [blame] | 573 | m = re.match(r"(?P<int>\d+)\.(\d*)", '3.14') |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 574 | \end{verbatim} |
| 575 | |
| 576 | After performing this match, \code{m.group(1)} is \code{'3'}, as is |
Guido van Rossum | 4650392 | 1998-01-19 23:14:17 +0000 | [diff] [blame] | 577 | \code{m.group('int')}, and \code{m.group(2)} is \code{'14'}. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 578 | \end{methoddesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 579 | |
Guido van Rossum | 6c373f7 | 1998-06-29 22:48:01 +0000 | [diff] [blame] | 580 | \begin{methoddesc}[MatchObject]{groups}{\optional{default}} |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 581 | Return a tuple containing all the subgroups of the match, from 1 up to |
Guido van Rossum | 6c373f7 | 1998-06-29 22:48:01 +0000 | [diff] [blame] | 582 | however many groups are in the pattern. The \var{default} argument is |
| 583 | used for groups that did not participate in the match; it defaults to |
| 584 | \code{None}. (Incompatibility note: in the original Python 1.5 |
| 585 | release, if the tuple was one element long, a string would be returned |
| 586 | instead. In later versions (from 1.5.1 on), a singleton tuple is |
| 587 | returned in such cases.) |
| 588 | \end{methoddesc} |
| 589 | |
| 590 | \begin{methoddesc}[MatchObject]{groupdict}{\optional{default}} |
| 591 | Return a dictionary containing all the \emph{named} subgroups of the |
| 592 | match, keyed by the subgroup name. The \var{default} argument is |
| 593 | used for groups that did not participate in the match; it defaults to |
| 594 | \code{None}. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 595 | \end{methoddesc} |
Guido van Rossum | 48d0437 | 1997-12-11 20:19:08 +0000 | [diff] [blame] | 596 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 597 | \begin{methoddesc}[MatchObject]{start}{\optional{group}} |
Fred Drake | 013ad98 | 1998-03-08 07:38:27 +0000 | [diff] [blame] | 598 | \funcline{end}{\optional{group}} |
Guido van Rossum | e4eb223 | 1997-12-17 00:23:39 +0000 | [diff] [blame] | 599 | Return the indices of the start and end of the substring |
Guido van Rossum | 4650392 | 1998-01-19 23:14:17 +0000 | [diff] [blame] | 600 | matched by \var{group}; \var{group} defaults to zero (meaning the whole |
| 601 | matched substring). |
| 602 | Return \code{None} if \var{group} exists but |
Guido van Rossum | e4eb223 | 1997-12-17 00:23:39 +0000 | [diff] [blame] | 603 | did not contribute to the match. For a match object |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 604 | \var{m}, and a group \var{g} that did contribute to the match, the |
| 605 | substring matched by group \var{g} (equivalent to |
| 606 | \code{\var{m}.group(\var{g})}) is |
| 607 | |
| 608 | \begin{verbatim} |
| 609 | m.string[m.start(g):m.end(g)] |
| 610 | \end{verbatim} |
| 611 | |
Guido van Rossum | e4eb223 | 1997-12-17 00:23:39 +0000 | [diff] [blame] | 612 | Note that |
| 613 | \code{m.start(\var{group})} will equal \code{m.end(\var{group})} if |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 614 | \var{group} matched a null string. For example, after \code{\var{m} = |
| 615 | re.search('b(c?)', 'cba')}, \code{\var{m}.start(0)} is 1, |
| 616 | \code{\var{m}.end(0)} is 2, \code{\var{m}.start(1)} and |
| 617 | \code{\var{m}.end(1)} are both 2, and \code{\var{m}.start(2)} raises |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 618 | an \exception{IndexError} exception. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 619 | \end{methoddesc} |
Guido van Rossum | e4eb223 | 1997-12-17 00:23:39 +0000 | [diff] [blame] | 620 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 621 | \begin{methoddesc}[MatchObject]{span}{\optional{group}} |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 622 | For \class{MatchObject} \var{m}, return the 2-tuple |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 623 | \code{(\var{m}.start(\var{group}), \var{m}.end(\var{group}))}. |
Guido van Rossum | e4eb223 | 1997-12-17 00:23:39 +0000 | [diff] [blame] | 624 | Note that if \var{group} did not contribute to the match, this is |
Guido van Rossum | 4650392 | 1998-01-19 23:14:17 +0000 | [diff] [blame] | 625 | \code{(None, None)}. Again, \var{group} defaults to zero. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 626 | \end{methoddesc} |
Guido van Rossum | e4eb223 | 1997-12-17 00:23:39 +0000 | [diff] [blame] | 627 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 628 | \begin{memberdesc}[MatchObject]{pos} |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 629 | The value of \var{pos} which was passed to the |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 630 | \function{search()} or \function{match()} function. This is the index into |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 631 | the string at which the regex engine started looking for a match. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 632 | \end{memberdesc} |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 633 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 634 | \begin{memberdesc}[MatchObject]{endpos} |
Guido van Rossum | 0b33410 | 1997-12-08 17:33:40 +0000 | [diff] [blame] | 635 | The value of \var{endpos} which was passed to the |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 636 | \function{search()} or \function{match()} function. This is the index into |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 637 | the string beyond which the regex engine will not go. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 638 | \end{memberdesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 639 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 640 | \begin{memberdesc}[MatchObject]{re} |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 641 | The regular expression object whose \method{match()} or |
| 642 | \method{search()} method produced this \class{MatchObject} instance. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 643 | \end{memberdesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 644 | |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 645 | \begin{memberdesc}[MatchObject]{string} |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 646 | The string passed to \function{match()} or \function{search()}. |
Fred Drake | 76547c5 | 1998-04-03 05:59:05 +0000 | [diff] [blame] | 647 | \end{memberdesc} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 648 | |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 649 | \begin{seealso} |
Fred Drake | f995181 | 1997-12-29 16:37:04 +0000 | [diff] [blame] | 650 | \seetext{Jeffrey Friedl, \emph{Mastering Regular Expressions}, |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 651 | O'Reilly. The Python material in this book dates from before the |
Fred Drake | 20e0196 | 1998-02-19 15:09:35 +0000 | [diff] [blame] | 652 | \module{re} module, but it covers writing good regular expression |
Fred Drake | 023f87f | 1998-01-12 19:16:24 +0000 | [diff] [blame] | 653 | patterns in great detail.} |
Guido van Rossum | 1acceb0 | 1997-08-14 23:12:18 +0000 | [diff] [blame] | 654 | \end{seealso} |
Andrew M. Kuchling | 2533281 | 1998-04-09 14:56:04 +0000 | [diff] [blame] | 655 | |