美文网首页
urllib urllib2

urllib urllib2

作者: 爱代码的派派星 | 来源:发表于2018-01-25 11:04 被阅读0次

-- coding:utf-8 --

import urllib
import urllib2
import re

page = 1
url = 'http://www.qiushibaike.com/hot/page/' + str(page)
user_agent = 'Mozilla/4.0 (compatible; MSIE 5.5; Windows NT)'
headers = { 'User-Agent' : user_agent }
try:
request = urllib2.Request(url,headers = headers)
response = urllib2.urlopen(request)
content = response.read().decode('utf-8')
pattern = re.compile('<div.?class="author.?>.?<a.?</a>.?<a.?>(.?)</a>.?<div.?class'+
'="content".
?title="(.?)">(.?)</div>(.?)<div class="stats.?class="number">(.*?)</i>',re.S)
items = re.findall(pattern,content)
for item in items:
haveImg = re.search("img",item[3])
if not haveImg:
print item[0],item[1],item[2],item[4]
except urllib2.URLError, e:
if hasattr(e,"code"):
print e.code
if hasattr(e,"reason"):
print e.reason

1516849396(1).png

相关文章

网友评论

      本文标题:urllib urllib2

      本文链接:https://www.haomeiwen.com/subject/igamaxtx.html