| commit | c70a6ae49bd162af06130e48a45579d445e058a8 | [log] [tgz] |
|---|---|---|
| author | Senthil Kumaran <senthil@uthcode.com> | Wed May 29 05:54:31 2013 -0700 |
| committer | Senthil Kumaran <senthil@uthcode.com> | Wed May 29 05:54:31 2013 -0700 |
| tree | cecb299ec31a93cda7d9256a7092cd601be0c0b4 | |
| parent | eb4c9c77b8257c05b40467651bdc7764295926e8 [diff] |
#17403: urllib.parse.robotparser normalizes the urls before adding to ruleline. This helps in handling certain types invalid urls in a conservative manner.