美文网首页
Cosbench对象存储的测试

Cosbench对象存储的测试

作者: 圣地亚哥_SVIP | 来源:发表于2020-09-17 09:54 被阅读0次

    Cosbench下载地址:
    https://github.com/intel-cloud/cosbench/releases/download/v0.4.0.1/0.4.0.1.zip

    Read并发大的情况会存在读异常直接退出,需要关闭MD5校验:

    • stop-all.sh 停止 cosbench 进程(controller, drivers)
    • 编辑 cosbench-start.sh 文件,找到java启动命令行参数, 增加"-Dcom.amazonaws.services.s3.disableGetObjectMD5Validation=true" 关闭S3的MD5校验功能
    • start-all.sh 启动所有的cosbench processes.

    进入目录,上传一个任务:
    ./cli.sh submit ../conf/bjf/cosbench.conf

    界面:
    http://{ip}:19088/controller

    配置用例如下:
    workflow下定义多个workstage,workstage之间是串行运行,workstage下的work并行运行。workers指定了并发数。

    <?xml version="1.0" encoding="UTF-8" ?>  
    <workload name="cosbench 64 driveer" description="64 drivers 10w ops">  
    
      <storage type="s3" config="accesskey={access-key};secretkey={secret-key};endpoint=http://{endpoint}" />  
      
      <workflow>  
        
        <workstage name="init">  
          <work type="init" workers="1" config="cprefix=cosbench;containers=r(1,1)" />  
        </workstage>  
      
        <workstage name="write">  
          <work name="write" workers="64" totalOps="100000">  
            <operation type="write" config="cprefix=cosbench;containers=r(1,1);objects=r(1,100000);sizes=c(1)MB" />  
          </work>  
        </workstage>  
          
        <workstage name="read">  
          <work name="read" workers="64" totalOps="100000">  
            <operation type="read" config="cprefix=cosbench;containers=r(1,1);objects=r(1,100000)" />  
          </work>  
        </workstage>    
      
        <workstage name="cleanup">  
          <work type="cleanup" workers="64" config="cprefix=cosbench;containers=r(1,1);objects=r(1,100000)" />  
        </workstage>  
          
        <workstage name="dispose">  
          <work type="dispose" workers="1" config="cprefix=cosbench;containers=r(1,1)" />  
        </workstage>  
          
      </workflow>  
      
    </workload>
    

    相关文章

      网友评论

          本文标题:Cosbench对象存储的测试

          本文链接:https://www.haomeiwen.com/subject/cmtlyktx.html