爬国外简单网页问题

.is · 发表于 2016-11-1 17:39:00

#encoding=utf8
import requests
import sys
from bs4 import BeautifulSoup
reload(sys)
sys.setdefaultencoding('utf-8')
type = sys.getfilesystemencoding()
proxie = {
'https' : 'http://216.80.82.192:1136'}
url = 'https://www.facebook.com'
header = {
'User-Agent' : 'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.76 Mobile Safari/537.36',
}

s = requests.session()
response = s.get(url,headers = header,proxies = proxie)
#print response.text
f = open('FC.txt','w')
f.write(response.content)
f.close()
是我代理设置有问题还是代码有问题啊，换了几个代理都不行

blueelwang · 发表于 2016-11-1 19:26:39

有报错信息吗？
网上找的代理地址大部分都不可用，代理的代码我看了没问题，怀疑是代理无法连接

.is · 发表于 2016-11-2 09:13:11

blueelwang 发表于 2016-11-1 19:26
有报错信息吗？
网上找的代理地址大部分都不可用，代理的代码我看了没问题，怀疑是代理无法连接 ...

D:\1.png

blueelwang · 发表于 2016-11-2 10:24:30

.is 发表于 2016-11-2 09:13

图片没上传

.is · 发表于 2016-11-2 10:42:24

blueelwang 发表于 2016-11-2 10:24
图片没上传

Traceback (most recent call last):
  File "FC.py", line 16, in <module>
response = s.get(url,headers = header,proxies = proxie)
  File "C:\Python27\lib\site-packages\requests\sessions.py", line 488, in get
return self.request('GET', url, **kwargs)
  File "C:\Python27\lib\site-packages\requests\sessions.py", line 475, in reque
t
resp = self.send(prep, **send_kwargs)
  File "C:\Python27\lib\site-packages\requests\sessions.py", line 596, in send
r = adapter.send(request, **kwargs)
  File "C:\Python27\lib\site-packages\requests\adapters.py", line 487, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='www.facebook.com
, port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<r
quests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x029C87D0
: Failed to establish a new connection: [Errno 10060] ',))

		自动登录	找回密码
密码			立即注册

[已回复] 爬国外简单网页问题

相关帖子

活跃会员

热心会员

最佳导师

默默耕耘

突出贡献

优秀版主

荣誉管理

论坛元老