美文网首页
爬虫练习:爬取电影天堂下载链接

爬虫练习:爬取电影天堂下载链接

作者: 孤独唯心 | 来源:发表于2018-07-23 09:09 被阅读0次

import requests

import regex

for m in range(31):

    url ='https://www.dy2018.com/html/gndy/dyzz/index_'+str(m)+'.html'

    html = requests.get(url)

    html.encoding ='gb2312' #设定网页编码类型

    data = regex.findall('<a href="(.*?)" class="ulink"', html.text)

    # print(data)

        for n in data:

        url2 ='https://www.dy2018.com'+n

        html2 = requests.get(url2)

        html2.encoding ='gb2312'

        ftp = regex.findall('<a href="(.*?)">.*?</a></td>',html2.text)

        # print(ftp)

        #写入文件

        with open(r'C:\Users\Administrator\Desktop\dy\dytt.txt', 'a',encoding='gb2312') as f:

            f.write(ftp[0]+'\n')

相关文章

网友评论

      本文标题:爬虫练习:爬取电影天堂下载链接

      本文链接:https://www.haomeiwen.com/subject/yhjdmftx.html