好资源导航 » 文章资讯 » python通过伪装头部数据抵抗反爬虫的实例

python通过伪装头部数据抵抗反爬虫的实例

2023-09-13 05:53:29 62

0x00环境

系统环境:win10

编写工具:JetBrainsPyCharmCommunityEdition2017.1.2x64

python版本:python-3.6.2

抓包工具:Fiddler4

0x01头部数据伪装思路

通过http向服务器提交数据,以下是通过Fiddler抓取python没有伪装的报文头信息

GET/u012870721HTTP/1.1
Accept-Encoding:identity
Host:blog.csdn.net
User-Agent:Python-urllib/3.6
Connection:close

Python-urllib/3.6

很明显啊，我们暴露了。现在要问了，该怎么！模拟浏览器，让自己伪装成浏览器，一下是浏览器访问发送的头部数据

Connection:keep-alive
Upgrade-Insecure-Requests:1
User-Agent:Mozilla/5.0(WindowsNT10.0;Win64;x64)AppleWebKit/537.36(KHTML,likeGecko)Chrome/60.0.3112.113Safari/537.36
Referer:http://write.blog.csdn.net/postlist
Accept-Encoding:gzip,deflate
Accept-Language:zh-CN,zh;q=0.8

0x02代码实现

fromurllibimportrequest
html_url="http://blog.csdn.net/u012870721";
#伪装构造头
header={
"Connection":"keep-alive",
"Upgrade-Insecure-Requests":"1",
"User-Agent":"Mozilla/5.0(WindowsNT10.0;Win64;x64)AppleWebKit/537.36(KHTML,likeGecko)Chrome/60.0.3112.113Safari/537.36",
"Accept":"text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8",
"Accept-Encoding":"gzip,deflate",
"Accept-Language":"zh-CN,zh;q=0.8"
};

#intmain()
#{
req=request.Request(url=html_url,headers=header);

resp=request.urlopen(req);
#return0;
#}

伪装后进行发送的信息头

GET/u012870721HTTP/1.1
Host:blog.csdn.net
Connection:close
Upgrade-Insecure-Requests:1
User-Agent:Mozilla/5.0(WindowsNT10.0;Win64;x64)AppleWebKit/537.36(KHTML,likeGecko)Chrome/60.0.3112.113Safari/537.36
Accept:text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8
Accept-Encoding:gzip,deflate
Accept-Language:zh-CN,zh;q=0.8

以上这篇python通过伪装头部数据抵抗反爬虫的实例就是小编分享给大家的全部内容了，希望能给大家一个参考，也希望大家多多支持毛票票。

返回顶部
514930285
czq8825@qq.com

python通过伪装头部数据抵抗反爬虫的实例

热门推荐

随机推荐