How can I see the entire HTTP request that's being sent by my Python application?

A simple method: enable logging in recent versions of Requests (1.x and higher.)

Requests uses the http.client and logging module configuration to control logging verbosity, as described here.

Demonstration

Code excerpted from the linked documentation:

import requestsimport logging# These two lines enable debugging at httplib level (requests->urllib3->http.client)# You will see the REQUEST, including HEADERS and DATA, and RESPONSE with HEADERS but without DATA.# The only thing missing will be the response.body which is not logged.try:    import http.client as http_clientexcept ImportError:    # Python 2    import httplib as http_clienthttp_client.HTTPConnection.debuglevel = 1# You must initialize logging, otherwise you'll not see debug output.logging.basicConfig()logging.getLogger().setLevel(logging.DEBUG)requests_log = logging.getLogger("requests.packages.urllib3")requests_log.setLevel(logging.DEBUG)requests_log.propagate = Truerequests.get('https://httpbin.org/headers')

Example Output

$ python requests-logging.py INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection (1): httpbin.orgsend: 'GET /headers HTTP/1.1\r\nHost: httpbin.org\r\nAccept-Encoding: gzip, deflate, compress\r\nAccept: */*\r\nUser-Agent: python-requests/1.2.0 CPython/2.7.3 Linux/3.2.0-48-generic\r\n\r\n'reply: 'HTTP/1.1 200 OK\r\n'header: Content-Type: application/jsonheader: Date: Sat, 29 Jun 2013 11:19:34 GMTheader: Server: gunicorn/0.17.4header: Content-Length: 226header: Connection: keep-aliveDEBUG:requests.packages.urllib3.connectionpool:"GET /headers HTTP/1.1" 200 226

r = requests.get('https://api.github.com', auth=('user', 'pass'))

r is a response. It has a request attribute which has the information you need.

r.request.allow_redirects  r.request.headers          r.request.register_hookr.request.auth             r.request.hooks            r.request.responser.request.cert             r.request.method           r.request.sendr.request.config           r.request.params           r.request.sentr.request.cookies          r.request.path_url         r.request.sessionr.request.data             r.request.prefetch         r.request.timeoutr.request.deregister_hook  r.request.proxies          r.request.urlr.request.files            r.request.redirect         r.request.verify

r.request.headers gives the headers:

{'Accept': '*/*', 'Accept-Encoding': 'identity, deflate, compress, gzip', 'Authorization': u'Basic dXNlcjpwYXNz', 'User-Agent': 'python-requests/0.12.1'}

Then r.request.data has the body as a mapping. You can convert this with urllib.urlencode if they prefer:

import urllibb = r.request.dataencoded_body = urllib.urlencode(b)

depending on the type of the response the .data-attribute may be missing and a .body-attribute be there instead.

You can use HTTP Toolkit to do exactly this.

It's especially useful if you need to do this quickly, with no code changes: you can open a terminal from HTTP Toolkit, run any Python code from there as normal, and you'll be able to see the full content of every HTTP/HTTPS request immediately.

There's a free version that can do everything you need, and it's 100% open source.

I'm the creator of HTTP Toolkit; I actually built it myself to solve the exact same problem for me a while back! I too was trying to debug a payment integration, but their SDK didn't work, I couldn't tell why, and I needed to know what was actually going on to properly fix it. It's very frustrating, but being able to see the raw traffic really helps.