HDFS

1、# 判断HDFS文件是否存在

https://blog.csdn.net/yeweiouyang/article/details/38875963

hadoop fs -test -e /hdfs_dir
if [ $? -ne 0 ]; then
echo "Directory not exists!"
fi

2、删除HDFS 文件
hdfs dfs -rm -r 绝对路径名

例如：hdfs dfs -rm -r /user/hive/warehouse/xhx_dw.db/dw_homework_question_detail_his_f_1d

3、HDFS命令
https://blog.csdn.net/tswc_byy/article/details/90577551

4、查看修复HDFS中丢失的块
http://www.voidcn.com/article/p-hswstvqs-tr.html
https://blog.csdn.net/weixin_39915358/article/details/108358315

1.检测缺失块:
hdfs fsck -list-corruptfileblocks
2.确定一下文件是否能查询的到:
hdfs dfs -get /user/hive/warehouse/test_prd.db/tdm_business_gongdan_info_mi/mi=20200831/000000_0_copy_98
3.删除文件:
hdfs fsck -delete /user/hive/warehouse/test_prd.db/tdm_business_gongdan_info_mi/mi=20200831/000000_0_copy_98

5、磁盘均衡器(diskbalancer)
https://blog.csdn.net/shudaqi2010/article/details/80165681

6、如何在CDH集群中为数据节点热插拔硬盘
https://cloud.tencent.com/developer/article/1158329

7、HDFS常用操作命令
https://www.cnblogs.com/jichui/p/10444430.html

8、