Getting Redirect URL in a GET request

[NiCkWKT]

I am struggling with getting redirect url from a GET request with httpx.

Using requests

url = "https://news.google.com/rss/articles/CBMifmh0dHBzOi8vd3d3LnNwaWVnZWwuZGUvd2lydHNjaGFmdC90ZXNsYS1zdHJlaWNodC16ZWhuLXByb3plbnQtYWxsZXItam9icy1pbS11bnRlcm5laG1lbi1hLTYyMTkxYzk1LTE5MTAtNDI4Mi05Y2M2LTk5N2I0OTE1NWM0M9IBAA?oc=5"

# Send the request and allow redirection
response = requests.get(url, allow_redirects=True)

# Check if the request was redirected
if response.history:
    last_redirection = response.history[-1]
    print("Redirection Status Code:", last_redirection.status_code)
    print("Redirection URL:", last_redirection.headers["location"])
else:
    print("No redirection occurred.")

Output:

Redirection Status Code: 302
Redirection Headers: https://www.spiegel.de/wirtschaft/tesla-streicht-zehn-prozent-aller-jobs-im-unternehmen-a-62191c95-1910-4282-9cc6-997b49155c43

I can get the redirect url using requests.

Using httpx

url = "https://news.google.com/rss/articles/CBMifmh0dHBzOi8vd3d3LnNwaWVnZWwuZGUvd2lydHNjaGFmdC90ZXNsYS1zdHJlaWNodC16ZWhuLXByb3plbnQtYWxsZXItam9icy1pbS11bnRlcm5laG1lbi1hLTYyMTkxYzk1LTE5MTAtNDI4Mi05Y2M2LTk5N2I0OTE1NWM0M9IBAA?oc=5"

client = httpx.Client(follow_redirects=True)

# Send the request and capture the response
response = client.get(url)

# Check if the request was redirected
if response.history:
    last_redirection = response.history[-1]
    print("Redirection Status Code:", last_redirection.status_code)
    print("Redirection URL:", last_redirection.headers["location"])
else:
    print("No redirection occurred.")

# Close the client
client.close()

Output:

Redirection Status Code: 302
Redirection URL: https://news.google.com/rss/articles/CBMifmh0dHBzOi8vd3d3LnNwaWVnZWwuZGUvd2lydHNjaGFmdC90ZXNsYS1zdHJlaWNodC16ZWhuLXByb3plbnQtYWxsZXItam9icy1pbS11bnRlcm5laG1lbi1hLTYyMTkxYzk1LTE5MTAtNDI4Mi05Y2M2LTk5N2I0OTE1NWM0M9IBAA?oc=5&hl=en-US&gl=US&ceid=US:en

I cannot get the Redirect URL when using httpx.

Is there anything wrong with my code? Or it is a bug?

[ketpatil77]

Your HTTPX code already enables HTTP redirects. response.url is the final URL actually requested; response.history contains only HTTP redirect responses, and each Location may be relative. Inspect the complete chain rather than assuming the last Location is the publisher URL:

import httpx

def redirect_urls(client, url):
    response = client.get(url, follow_redirects=True)
    hops = [(str(hop.url), hop.status_code, hop.headers.get("location"))
            for hop in response.history]
    return hops, str(response.url)

If the final URL is still news.google.com, that response did not send HTTPX to Spiegel with another HTTP redirect. A link in HTML or JavaScript is not an HTTP redirect. Different cookies, request headers, or server-side decisions can also produce different chains. Compare the actual status/Location sequence and final response bodies from both clients; the snippet alone cannot establish which Google behavior caused this difference. Avoid forwarding credentials to unrelated origins while investigating.

Validated the helper with a local MockTransport chain containing both relative and absolute redirects, including a final response without a Location. HTTPX redirects.

Validation version: HTTPX 0.28.1, Python 3.11.9.