I need to check if the url is valid, I don't need its contents. When I use urllib.request.urlopen(), it takes unnecessary time to get even the contents of the url.
Is there a method in urllib.request to do this?
Asked
Active
Viewed 19 times
-2
-
Moreover, `urlopen()` will not download the rest of the file unless the response `http.client.HTTPResponse.read()` is called. – metatoaster May 17 '21 at 04:05
-
Then how is Beautifulsoup able to parse the output of urllib.request.urlopen('url')? – ASWIN VENU May 17 '21 at 04:13
-
It must have called `read()` somewhere directly or implicitly by iterated through the response object (e.g. via a for loop). – metatoaster May 17 '21 at 04:15
-
That explains it, thank you. – ASWIN VENU May 17 '21 at 04:19