| commit | 2c4810efa2421c1a3e0042888b71193a917b39c5 | [log] [tgz] |
|---|---|---|
| author | Senthil Kumaran <senthil@uthcode.com> | Wed May 29 05:58:47 2013 -0700 |
| committer | Senthil Kumaran <senthil@uthcode.com> | Wed May 29 05:58:47 2013 -0700 |
| tree | 462411035677ad245fc32db3b0fd2eabab22b2c0 | |
| parent | 1ab29e78f9e61c86879fa8884a543022ea43112d [diff] |
#17403: urllib.parse.robotparser normalizes the urls before adding to ruleline. This helps in handling certain types invalid urls in a conservative manner.