|
程序如下:
with open ('D:\keyword.txt') as fp1:
keywords = fp1.read()
# 进行百度搜索并下载搜索页面
fakeua = {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36"}
searchPage = requests.get('https://www.baidu.com/s?wd=' + keywords, headers = fakeua)
# 得到前5个搜索结果的链接
searchSoup = bs4.BeautifulSoup(searchPage.text, features="html.parser")
result = searchSoup.select('.t a')
#result = searchSoup.select('#main > ul > li > h3 > a')
#result = searchSoup.select('#\35 > h3 > a')
#输出搜索结果
#fp=open('D:\输出结果.txt', 'w')
print(result)
目前可以从keyword中获取关键字后输出一长串结果,但是我用#result = searchSoup.select('#main > ul > li > h3 > a')可以获得BING的搜索结果,百度搜索结果的selector就是下一行的#result = searchSoup.select('#\35 > h3 > a')。我怎样才能获取百度的搜索结果呢? |
|