python库学习之Requests

基本使用

import requests

data = { 'name': 'germey', 'age': 22}

r = requests.get("http://httpbin.org/get", params=data)

print(r.text)

抓取网页（文本）

import requests

import re

headers = { 'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36'}

r = requests.get("https://www.zhihu.com/explore", headers=headers)

pattern = re.compile('explore-feed.*?question_link.*?>(.*?)', re.S)

titles = re.findall(pattern, r.text)

print(titles)

抓取二进制数据（图片，音频，视频）

import requests

r = requests.get("https://github.com/favicon.ico")

print(r.text)

print(r.content)

如果要保存图片

import requests

r = requests.get("https://github.com/favicon.ico")

with open('favicon.ico', 'wb') as f:

    f.write(r.content)