简介:
httprunner是一款基于Python的开源工具。
httprunner目前可以支持http/https协议,使用yaml/json格式的文件编写用例,封装了接口访问方法和pytest测试框架,可以结合allure生成测试报告。
主要特点
继承的所有强大功能requests,只需以人工方式获得乐趣就可以处理HTTP(S)。
以YAML或JSON格式定义测试用例,pytest以简洁优雅的方式运行。
在HAR支持下记录并生成测试用例。
支持variables/ extract/ validate/ hooks机制,以创建非常复杂的测试方案。
使用debugtalk.py插件,任何功能都可以在测试用例的任何部分使用。
使用jmespath,提取和验证json响应从未如此简单。
有了pytest,数百个插件随时可用。
使用allure,测试报告可以非常强大。
通过重复使用locust,您可以进行性能测试,而无需进行额外的工作。
支持CLI命令,与完美结合CI/CD
安装前置条件:
安装Mysql
#wget http://repo.mysql.com/mysql57-community-release-el7-10.noarch.rpm
#rpm -Uvh mysql57-community-release-el7-10.noarch.rpm
#yum install -y mysql-community-server
#systemctl start mysqld.service
如果Centos 8 安装Mysql5.7,以上步骤换成如下:
#dnf remove @mysql --关闭Centos8中MySQL默认的AppStream仓库
#dnf module reset mysql && sudo dnf module disable mysql
#vim /etc/yum.repos.d/mysql-community.repo 添加如下:
[mysql57-community]
name=MySQL 5.7 Community Server
baseurl=http://repo.mysql.com/yum/mysql-5.7-community/el/7/$basearch/
enabled=1
gpgcheck=0
[mysql-connectors-community]
name=MySQL Connectors Community
baseurl=http://repo.mysql.com/yum/mysql-connectors-community/el/7/$basearch/
enabled=1
gpgcheck=0
[mysql-tools-community]
name=MySQL Tools Community
baseurl=http://repo.mysql.com/yum/mysql-tools-community/el/7/$basearch/
enabled=1
gpgcheck=0
#dnf --enablerepo=mysql57-community install mysql-community-server
#systemctl enable --now mysqld.service --开启服务,自动重启
#grep 'A temporary password' /var/log/mysqld.log |tail -1 -- 获取初始化密码
#grep 'A temporary password' /var/log/mysqld.log |tail -1 获取随机密码
#mysql -uroot -p 修改密码
因为MySQL的密码规则需要很复杂,我们一般自己设置的不会设置成这样,所以我们全局修改一下
#mysql> set global validate_password_policy=0;
#mysql> set global validate_password_length=1;
#mysql>ALTER USER 'root'@'localhost' IDENTIFIED BY 'yourpassword';
授权其他机器远程登录
#mysql> GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY 'yourpassword' WITH GRANT OPTION;
#mysql> FLUSH PRIVILEGES;
支持中文
#vim /etc/my.cnf
[mysql]
default-character-set=utf8
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
default-storage-engine=INNODB
character_set_server=utf8
symbolic-links=0
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
#service mysqld restart 重启生效
防火墙开放3306
#firewall-cmd --state
#firewall-cmd --zone=public --add-port=3306/tcp --permanent
#firewall-cmd --reload
卸载MySQL仓库
一开始的时候我们安装的yum,每次yum操作都会更新一次,耗费时间,我们把他卸载掉
#yum -y remove mysql57-community-release-el7-10.noarch
安装jdk
#wget --no-check-certificate --no-cookies --header "Cookie: oraclelicense=accept-securebackup-cookie" http://download.oracle.com/otn-pub/java/jdk/8u131-b11/d54c1d3a095b4ff2b6607d096fa80163/jdk-8u131-linux-x64.rpm
#chmod +x jdk-8u131-linux-x64.rpm
#rpm -ivh jdk-8u131-linux-x64.rpm
#vim /etc/profile
export JAVA_HOME=/usr/java/jdk1.8.0_131
export PATH=$JAVA_HOME/bin:$PATH
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
#source /etc/profile
#yum install libffi-devel -y
#yum install zlib* -y
#yum install gcc -y
#yum install mysql-devel -y
可能报错:
--> Processing Dependency: mariadb-libs(x86-64) = 1:5.5.68-1.el7 for package: 1:mariadb-devel-5.5.68-1.el7.x86_64
--> Finished Dependency Resolution
Error: Package: 1:mariadb-devel-5.5.68-1.el7.x86_64 (os)
Requires: mariadb-libs(x86-64) = 1:5.5.68-1.el7
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest
#yum install python-devel -y (centos 8 提示:No match for argument: python-devel, Error: Unable to find a match)
安装openssl,因为用pip3安装时,会报错:pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available (解决方法:https://www.jianshu.com/p/8e476eef43f7)
#wget https://github.com/openssl/openssl/archive/OpenSSL_1_1_1d.tar.gz
#tar -zxvf OpenSSL_1_1_1d.tar.gz
#./config --prefix=/usr/local/openssl
#make & make install
替换旧版openssl
#mv /usr/bin/openssl /usr/bin/openssl.old
#mv /usr/lib64/openssl /usr/lib64/openssl.old
#mv /usr/lib64/libssl.so /usr/lib64/libssl.so.old (可能提示文件不存在)
#ln -s /usr/local/openssl/bin/openssl /usr/bin/openssl
#ln -s /usr/local/openssl/include/openssl /usr/include/openssl
#ln -s /usr/local/openssl/lib/libssl.so /usr/lib64/libssl.so
#echo "/usr/local/openssl/lib" >> /etc/ld.so.conf
#ldconfig -v // 建立动态链接
#openssl version
1、首先确保安装了python3.8环境,下载pyton3.8源码,解压进入目录安装:
#./configure --prefix=/usr/local/python3 --with-openssl=/usr/local/openssl
#make & make install
#ln -s /usr/local/python3/bin/python3 /usr/bin/python3
#ln -s /usr/local/python3/bin/pip3 /usr/bin/pip3
#vim /etc/profile 在文件最后增加:
#python3.8 configuration
PATH=$PATH:/usr/local/python3/bin
export PATH=$PATH:/usr/local/python3/bin/
#source /etc/profile *配置pytho环境变量,检查安装是否成功。*
#python3 显示是Python 3.8.6版本即可。
如果需要卸载,按如下步骤:
#rpm -qa|grep python3|xargs rpm -ev --allmatches --nodeps --卸载python3
#whereis python3 |xargs rm -frv -- 删除所有残留文件
2、安装pip3 (安装python 会自动安装pip3)
自动安装的pip3版本是20.2.1 ,使用下面命令升级pip3版本
#/usr/local/python3/bin/python3.8 -m pip install --upgrade pip
3、安装httprunner,使用命令
#pip3 install httprunner
可能会报如下错误:
File "/usr/local/python3/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher 报错原因:网络太慢导致下载失败
解决方法:换库:pip3 install -i https://pypi.tuna.tsinghua.edu.cn/simple httprunner (可能仍然会报Read time out 错误,报错后继续重新执行这个命令直到安装下载安装完成)
#vim /usr/local/python3/lib/python3.8/site-packages/setuptools/windows_support.py 注释了第34行(应该不需要这个步骤)
安装完成后,
#ln -s /usr/local/python3/bin/hrun /usr/bin/hrun
#ln -s /usr/local/python3/bin/httprunner /usr/bin/httprunner
#ln -s /usr/local/python3/bin/har2case /usr/bin/har2case
#ln -s /usr/local/python3/bin/hmake /usr/bin/hmake
检查安装是否成功,使用命令: #httprunner -V,输出了版本号,就表示安装成功
Tips:
If you want to keep up with the latest version, you can install with github repository url.
$pip3 install git+https://github.com/httprunner/httprunner.git@master
If you have installed HttpRunner before and want to upgrade to the latest version, you can use the -U option.
$ pip3 install -U httprunner
$ pip3 install -U git+https://github.com/httprunner/httprunner.git@master
常用命令
httprunner: 核心命令,可以使用 HttpRunner 的所有命令
hrun:httprunner run 命令的别名,运行 YAML/JSON/pytest 格式的测试用例
hmake:httprunner make 命令的别名,将 YAML/JSON 格式的 testcases 转换成 pytest 格式的测试用例
har2case:httprunner har2case 命令的别名,将 HAR 文件转换为 YAML/JSON 格式的测试用例
locusts: used to run load test with locust
接口测试:
1、先用fiddler抓个接口包,导出为:HTTPArchive V1.2 ,包名为:query.har
2、har2case query1.har -2y 将接口文件转换为yaml格式用例,如果转换为json格式,带参数 -2j
3、执行测试 hrun query.yml
接口性能测试:
Locust is an easy to use, scriptable and scalable performance testing tool. You define the behaviour of your users in regular Python code, instead of using a clunky UI or domain specific language. This makes Locust infinitely expandable and very developer friendly.
1、安装locust
https://github.com/locustio/locust项目地址下载zip安装包
下载解压后,在终端 cd 到项目路径,执行:python3 setup.py install
报错如下:
Traceback (most recent call last):
File "setup.py", line 7, in <module>
from setuptools import find_packages, setup
File "/usr/local/python3/lib/python3.8/site-packages/setuptools/__init__.py", line 23, in <module>
from setuptools.dist import Distribution
File "/usr/local/python3/lib/python3.8/site-packages/setuptools/dist.py", line 34, in <module>
from setuptools import windows_support
File "/usr/local/python3/lib/python3.8/site-packages/setuptools/windows_support.py", line 2, in <module>
import ctypes
..........................
换一种安装方式,使用在线安装方式如下:
#pip3 install locust
安装后,查看是否正确安装
#locust --version / locust -V
为了能Locust分布式测试,可以在本机windows上也安装同版本的Python和locust
先在windows 机器上安装Python3.8.6 (注意是64位的:https://www.python.org/ftp/python/3.8.6/python-3.8.6-amd64.exe)
在进入windows 命令行模式:pip3 install locust (可能会报SSL错误),用下面的命令,跳过SSL
pip3 install --trusted-host pypi.org --trusted-host files.pythonhosted.org locust
运行性能测试
#cd /home/cvms/testcases
#locusts -f double11.yml
浏览器打开:http://192.168.138.128:8089/
分布式运行Locust(有两种主从模式:第一种是单台机器设置Master和Slave,第二种是多台机器一台设置为Master,其他机器设置为Slave):
一旦单台机器不够模拟足够多的用户时,Locust支持运行在多台机器中进行压力测试。
为了实现这个,你应该在master模式中使用--master标记来启用一个Locust实例。这个实例将会运行你启动测试的Locust交互网站并查看实时统计数据。master节点的机器自身不会模拟任何用户。相反,你必须使用--slave标记启动一台到多台Locustslave机器节点,与标记--master-host一起使用(指出master机器的IP/hostname)。
常用的做法是在一台独立的机器中运行master,在slave机器中每个处理器内核运行一个slave实例。(slave 机器有几个CPU,就最多只能启动几个slave实例)
** master和每一台slave机器,在运行分布式测试时都必须要有locust的测试文件。**
实例:
CentOS 虚拟机192.168.138.128 (做为master)
本机笔记本做为slave机器,
现在CentOS上执行:#locusts -f double11.yml --master
再在本地笔记本上进入cmd,执行:locusts -f double11.yml --work --master-host=192.168.138.128 (可打开4个cmd,执行4个slave节点)
如下图(上面显示workers 是4,表示有4个slave在跑):
集成报表:
httprunner结合allure生成测试报告的步骤
#pip3 install allure-pytest (可能没安装,手动安装下,否则可能会报错:AttributeError: 'module' object has no attribute 'allure')
1、下载allure-commandline-2.13.0.tgz
2、解压到 /usr/local/python3/lib/python3.8/site-packages
# tar -zxvf allure-commandline-2.13.0.tgz
#mv package allure
#ln -s /usr/local/python3/lib/python3.8/site-packages/allure/dist/bin/allure /usr/bin/allure
3、添加环境变量
#For allure
PATH=$PATH:/usr/local/python3/lib/python3.8/site-packages/allure/dist/bin
export PATH
#allure --version (验证是否成功配置安装)
4、#hrun test_post_api.yml --alluredir=/home/demo1/report 如果一次要执行多个测试用例,这样写:hrun cvms_all.yml cvms_get_summary.yml cvms_get_details.yml cvms_get_pending.yml --alluredir=/home/cvms/reports/
执行过程如下图:
#allure serve /home/demo1/report
Generating report to temp directory...
Report successfully generated to /tmp/8439765027582619623/allure-report
Starting web server...
2020-11-02 18:15:55.706:INFO::main: Logging initialized @4485ms to org.eclipse.jetty.util.log.StdErrLog
Can not open browser because this capability is not supported on your platform. You can use the link below to open the report manually.
Server started at <http://3.223.115.185:39631/>. Press to exit
实际使用服务器的IP打开:http://192.168.138.133:39631/
安装HttpRunnerManager:
下载安装包:HttpRunnerManager-master.zip
解压到/opt
#pip3 install pymysql --python版本3X不支持mysqldb,要用pymysql来代替。
执行安装之前,先看下requirements.txt 会安装哪些东西:
Django == 2.0.3
PyYAML == 3.12
requests == 2.18.4
eventlet == 0.22.1
mysqlclient == 1.3.12
django-celery == 3.2.2
flower == 0.9.2
dwebsocket == 0.4.2
paramiko == 2.4.1
HttpRunner == 1.5.8
可以把mysqlclient HttpRunner 删掉,因为不支持或已经安装
修改requirements.txt下的:
Django == 2.0.3 改为 Django == 2.1.2
PyYAML == 3.12 修改为 pyyaml==5.1.2
requests == 2.18.4 修改为 requests==2.22.0
#pip3 install -r requirements.txt (下载安装时关闭fiddle,可能导致下载某些包报错)--因为已经在Linux下安装了python3和pip3,因此这里直接通过 pip3 来安装即可
安装时,可能会报这个:
Traceback (most recent call last):
File "/usr/local/python3/lib/python3.8/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher
yield
这是因为网络不行,下载超时了,多试几次。
安装完后,报如下log:
Running setup.py install for anyjson ... done
Running setup.py install for billiard ... done
Running setup.py install for django-celery ... done
Running setup.py install for flower ... done
Running setup.py install for dwebsocket ... done
ERROR: After October 2020 you may experience errors when installing or updating packages. This is because pip will change the way that it resolves dependency conflicts.
We recommend you use --use-feature=2020-resolver to test your packages with the new resolver before it becomes the default.
httprunner 3.1.4 requires pyyaml<6.0.0,>=5.1.2, but you'll have pyyaml 3.12 which is incompatible.
httprunner 3.1.4 requires requests<3.0.0,>=2.22.0, but you'll have requests 2.18.4 which is incompatible.
Successfully installed Django-2.0.3 PyYAML-3.12 amqp-1.4.9 anyjson-0.3.3 babel-2.8.0 bcrypt-3.2.0 billiard-3.3.0.23 celery-3.1.26.post2 cffi-1.14.3 cryptography-3.2.1 django-celery-3.2.2 dwebsocket-0.4.2 eventlet-0.22.1 flower-0.9.2 greenlet-0.4.17 idna-2.6 kombu-3.0.37 paramiko-2.4.1 pyasn1-0.4.8 pycparser-2.20 pynacl-1.4.0 pytz-2020.4 requests-2.18.4 tornado-6.1 urllib3-1.22
WARNING: You are using pip version 20.2.1; however, version 20.2.4 is available.
You should consider upgrading via the '/usr/local/python3/bin/python3.8 -m pip install --upgrade pip' command.
看起来是pyyaml, requests版本不兼容,重新安装这两个包
#pip3 install pyyaml==5.1.2
#pip3 install requests==2.22.0
*上面已经修改了requirements.txt文件中这两个包的版本,所以上面这两个命令应该不需要了*
创建数据库:create database hrun character set utf8 collate utf8_bin;
修复配置文件中连接数据库部分:
vim /opt/HttpRunnerManager-master/HttpRunnerManager/settings.py 的第118行开始,host 用127.0.0.1
生成数据迁移脚本:
#cd /opt/HttpRunnerManager-master
#python3 manage.py makemigrations ApiManager
报错如下:
Traceback (most recent call last):
File "/usr/local/python3/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 15, in
import MySQLdb as Database
ModuleNotFoundError: No module named 'MySQLdb'
解决方案(MySQLdb 只适用于python2.x,发现python3上的pip装不上。它在py3的替代品是:pip install PyMySQL,而django默认的还是使用MySQLdb:执行会报:):
#vim /usr/local/python3/lib/python3.8/site-packages/django/__init__.py 加两行代码如下:
from django.utils.version import get_version
import pymysql --增加的行,
pymysql.install_as_MySQLdb() -- 增加的行
增加后文件如下:
再执行命令#python3 manage.py makemigrations ApiManager
报这个(忽略)
#python3 manage.py migrate (应用到db生成数据表)
#python3 manage.py createsuperuser – 创建后台用户
输入管理员账号,密码,邮箱
#nohup python3 manage.py runserver 0.0.0.0:8000 >hrun.log 2>&1 & --启动django服务
登录后台:http://192.168.138.133:8000/admin/login/?next=/admin/
输入账号:root 密码
登录注册页面:http://192.168.138.133:8000/api/register/ 会报错如下:
ImportError at /api/project_list/1/
cann't import name logger
exception location: /opt/HttpRunnerManager-master/ApiManager/tasks.py in <module> line 16
解决方法::vim /opt/HttpRunnerManager-master/ApiManager/tasks.py 修改一行代码,注释掉16行的logger,刷新注册页面正常显示
注意:在上面的主界面中,我们发现界面的样式似乎有些不对劲,这是因为我们从Github上下载的源码有些问题,这里就需要手动修改一下了。
#vim /opt/HttpRunnerManager-master/templates/base.html 修改第23行的amazeui.org修改为:bootcss.com
Jenkins集成
1、安装jenkins
#yum install git -y
#wget -O /etc/yum.repos.d/jenkins.repo https://pkg.jenkins.io/redhat-stable/jenkins.repo (有时可能会报连接失败,多试几次)
#rpm --import https://pkg.jenkins.io/redhat-stable/jenkins.io.key
#yum install jenkins -y
2、配置
#vim /etc/sysconfig/jenkins
第29行:监听用户=root
第56行:端口=8082
3、
修改目录权限
#chown -R root:root /var/lib/jenkins
#chown -R root:root /var/cache/jenkins
#chown -R root:root /var/log/jenkins
重启
#service jenkins restart
#ps -ef | grep jenkins
启动
#systemctl start jenkins
#systemctl status jenkins 查看状态
登录:http://192.168.138.128:8082/login?from=%2F
使用Jenkins自动邮件Allure报告
Manage Jenkins -- Global Tool Configuration
配置Allure Commandline
name = allure2
installation directory = /usr/local/python3/lib/python3.8/site-packages/allure/dist
为了要触发邮件,出了要再创建的项目上按如上配置外,还需要对Jenkins做系统配置,方法如下
进入Manage Jenkins -- System Configuration,如下图:
首先确保allure在服务器上正确安排配置,参考前文,jenkins初始进入后,先安装几个必要的插件:Allure, Email Extension
1、jenkins上创建一个自由风格的项目,项目名称为:code
项目的具体配置根据实际情况会稍有不同,本次测试的配制如下:
因为要配置定时触发构建job,
【BuildTriggers】 设置Poll SCM Schedule 为: H 11 * * * (表示每天11点自动构建,为unix的cron格式)
【Build】部分Execute Shell Command为:
PATH=$PATH:/usr/local/python3/bin
export PATH=$PATH:/usr/local/python3/bin/
cd /home/auto/codetest/testcases
hrun inputone.yml code_details.yml querycode.yml --alluredir=/var/lib/jenkins/workspace/code/target/allure-results
上面两行是解决jenkins上执行报错:missing dependency tool: black ,因为Jenkins执行时没有获到python的path
【Post-build Action】段Add Allure Report,然后配置如下:
Results path = target/allure-results
JDK InherifFromJob
Report path = target/allure-report
在Jenkins的workspace路径:/var/lib/jenkins/workspace/code/target/ 下可能需要手动创建目录:allure-results,最终workspace/all 下的目录结构为(code为Jenkins中创建的项目名称):
target,下面再有目录:allure-results, allure-report
【Post-build Action】 段再Add Editable Email Notification, 基本配置如下:
Project Recipient List = $DEFAULT_RECIPIENTS,ring.zhong@icoastline.com
Project Reply-To List = $DEFAULT_REPLYTO
Content Type = HTML
Default Subject = 接口自动化测试报告
Default Content 如下:
<h1><center><font>以下是Jenkins自动发送的邮件,请勿回复!</font><center></h1>
<h3><center><font color="red">allure报告在线查看,请点击邮件中链接。or下载allure-report.zip用firefox离线查看,测试用例见附件</font><center></h3>
<br>
<hr>
<h3><font color="red">项目描述:${JOB_DESCRIPTION}</font><br></h3>
有码项目接口测试
<br><br>
<hr>
项目名称:$PROJECT_NAME<br>
构建编号:$BUILD_NUMBER<br>
构建状态:$BUILD_STATUS<br>
触发原因:${CAUSE}<br><br>
构建地址:<A HREF="${BUILD_URL}">${BUILD_URL}</A><br><br>
构建日志地址:<A HREF="${BUILD_URL}console">${BUILD_URL}console</A><br><br>
系统allure测试报告:<A HREF="${PROJECT_URL}${BUILD_NUMBER}/allure">${PROJECT_URL}${BUILD_NUMBER}/allure</a><br><br>
<hr>
${JELLY_SCRIPT}
再点右下角的:Advanced Settings 按钮,增加一个Trigger,Always,如下图
构建配置:
1.每30分钟构建一次:
H/30 * * * *
2.每2个小时构建一次
H H/2 * * *
3.每天早上8点构建一次
0 8 * * *
4.每天的8点,12点,22点,一天构建3次
0 8,12,22 * * *
网友评论