hadoop性能测试TestDFSIO

1.测试工具

hadoop自带的TestDFSIO

2.命令

(1)写

sudo -u hdfs hadoop jar hadoop-test-2.6.0-mr1-cdh5.14.0.jar TestDFSIO -write -nrFiles 2 -fileSize 512  -bufferSize 1000000  -resFile  /tmp/TestDFSIOresults.txt

(2)读

sudo -u hdfs hadoop jar hadoop-test-2.6.0-mr1-cdh5.14.0.jar TestDFSIO -read -nrFiles 2 -fileSize 512  -bufferSize 1000000  -resFile  /tmp/TestDFSIOresults.txt

(3)清除

sudo -u hdfs hadoop jar hadoop-test-2.6.0-mr1-cdh5.14.0.jar TestDFSIO -clean

3找到你的hadoop的jars

cd /opt/cloudera/parcels/CDH/jars/
ls | grep hadoop-test
jar包所在目录下执行读写清空命令
进行测试