commit | 6b3026ce7299056a3f10b25426cda34d771857ac | [log] [tgz] |
---|---|---|
author | Senthil Kumaran <senthil@uthcode.com> | Wed May 29 05:57:21 2013 -0700 |
committer | Senthil Kumaran <senthil@uthcode.com> | Wed May 29 05:57:21 2013 -0700 |
tree | 4aab00c18f16f3a9e9f9dc02e616417836caaac5 | |
parent | 7b503965a0c19c1a19d244e15b74cb0964f08c3c [diff] | |
parent | c70a6ae49bd162af06130e48a45579d445e058a8 [diff] |
merge from 3.3 #17403: urllib.parse.robotparser normalizes the urls before adding to ruleline. This helps in handling certain types invalid urls in a conservative manner. Patch contributed by Mher Movsisyan.