commit | 43ff2654ad4f1c90cfb44b8c9bfa9090c0d502a1 | [log] [tgz] |
---|---|---|
author | Phus Lu <phuslu@hotmail.com> | Sun Apr 02 14:39:52 2017 +0800 |
committer | Sergey Shepelev <temotor@gmail.com> | Mon Apr 03 00:35:04 2017 +0300 |
tree | df60d42a34f92a63ecdcec1ab46bcb15a78a9248 | |
parent | 4b22c7e351ed1acd5b5ad7eca2184fbe4655dc82 [diff] |
Bugfix for Content-Encoding: deflate Refer to https://stackoverflow.com/a/22311297 zlib library supports: RFC 1950 (zlib compressed format) RFC 1951 (deflate compressed format) RFC 1952 (gzip compressed format) choosing windowBits to (de-)compress deflate format, use wbits = -zlib.MAX_WBITS to (de-)compress zlib format, use wbits = zlib.MAX_WBITS to (de-)compress gzip format, use wbits = zlib.MAX_WBITS | 16 See documentation in http://www.zlib.net/manual.html#Advanced (section inflateInit2) Signed-off-by: Phus Lu <phuslu@hotmail.com>
httplib2 is a comprehensive HTTP client library, httplib2.py supports many features left out of other HTTP libraries.
###HTTP and HTTPS HTTPS support is only available if the socket module was compiled with SSL support.
###Keep-Alive Supports HTTP 1.1 Keep-Alive, keeping the socket open and performing multiple requests over the same connection if possible.
###Authentication The following three types of HTTP Authentication are supported. These can be used over both HTTP and HTTPS.
###Caching The module can optionally operate with a private cache that understands the Cache-Control: header and uses both the ETag and Last-Modified cache validators.
###All Methods The module can handle any HTTP request method, not just GET and POST.
###Redirects Automatically follows 3XX redirects on GETs.
###Compression Handles both 'deflate' and 'gzip' types of compression.
###Lost update support Automatically adds back ETags into PUT requests to resources we have already cached. This implements Section 3.2 of Detecting the Lost Update Problem Using Unreserved Checkout.
###Unit Tested A large and growing set of unit tests.
$ pip install httplib2
A simple retrieval:
import httplib2 h = httplib2.Http(".cache") (resp_headers, content) = h.request("http://example.org/", "GET")
The 'content' is the content retrieved from the URL. The content is already decompressed or unzipped if necessary.
To PUT some content to a server that uses SSL and Basic authentication:
import httplib2 h = httplib2.Http(".cache") h.add_credentials('name', 'password') (resp, content) = h.request("https://example.org/chapter/2", "PUT", body="This is text", headers={'content-type':'text/plain'} )
Use the Cache-Control: header to control how the caching operates.
import httplib2 h = httplib2.Http(".cache") (resp, content) = h.request("http://bitworking.org/", "GET") ... (resp, content) = h.request("http://bitworking.org/", "GET", headers={'cache-control':'no-cache'})
The first request will be cached and since this is a request to bitworking.org it will be set to be cached for two hours, because that is how I have my server configured. Any subsequent GET to that URI will return the value from the on-disk cache and no request will be made to the server. You can use the Cache-Control: header to change the caches behavior and in this example the second request adds the Cache-Control: header with a value of 'no-cache' which tells the library that the cached copy must not be used when handling this request.
More example usage can be found at: