scrapy获取当前请求网页时的cookie

1、请求Cookie

Cookie=response.request.headers.getlist('Cookie')

print(Cookie)

2、响应 Set-Cookie

Cookie2=response.headers.getlist('Set-Cookie')

print(Cookie2)

注意：

1.   爬虫时一般要获取网页上的cookie是指第一个请求Cookie     ##带b'' 字节

cookies_list= response.request.headers.getlist('Cookie')[0].decode()

cookies= {i.split("=")[0]: i.split("=")[1] for iin cookies_list.split("; ")}

yield scrapy.Request(RoomStUrl, meta={'UnitId':UnitId, 'page':page}, cookies=cookies, callback=self.parseThird, dont_filter=True)

2.  b'ASPSESSIONIDSCADSQAD=AIBIBHPAAJNINANIGBOPLECH'     ##带b'' 字节

cookies_list = (response.headers['Set-Cookie'].decode()).split(";")[0].split("=")

cookies = {cookies_list[0]: cookies_list[1]}

yield scrapy.Request(RoomStUrl, meta={'UnitId':UnitId, 'page':page}, cookies=cookies, callback=self.parseThird, dont_filter=True)