美文网首页程序员大数据开发
hadoop一直开机一直处于安全模式

hadoop一直开机一直处于安全模式

作者: 晨冉1688 | 来源:发表于2020-05-01 11:58 被阅读0次

    查询集群健康状态

    hdfs fsck 
    

    发现有1860个快损坏

    /weblog/dim_time.dat: MISSING 1 blocks of total size 601 B.Status: CORRUPT
     Total size:    27258959146 B (Total open files size: 435679 B)
     Total dirs:    1211
     Total files:   2050
     Total symlinks:        0 (Files currently being written: 1)
     Total blocks (validated):  2044 (avg. block size 13336085 B) (Total open file blocks (not validated): 1)
      ********************************
      UNDER MIN REPL'D BLOCKS:  1860 (90.99804 %)
      dfs.namenode.replication.min: 1
      CORRUPT FILES:    1860
      MISSING BLOCKS:   1860
      MISSING SIZE:     24467172505 B
      CORRUPT BLOCKS:   1860
      ********************************
     Minimally replicated blocks:   184 (9.001957 %)
     Over-replicated blocks:    0 (0.0 %)
     Under-replicated blocks:   0 (0.0 %)
     Mis-replicated blocks:     0 (0.0 %)
     Default replication factor:    3
     Average block replication: 0.27005872
     Corrupt blocks:        1860
     Missing replicas:      0 (0.0 %)
     Number of data-nodes:      3
     Number of racks:       1
    FSCK ended at Mon Mar 09 05:51:52 CST 2020 in 629 milliseconds
    
    
    The filesystem under path '/' is CORRUPT
    
    

    解决方法:

    离开安全模式(处于安全模式是无法删除损坏块的)

    hadoop dfsadmin -safemode leave
    

    删除损坏块
    如果是生产请尝试使用hdfs debug

    hdfs fsck  /  -delete
    

    相关文章

      网友评论

        本文标题:hadoop一直开机一直处于安全模式

        本文链接:https://www.haomeiwen.com/subject/lxofghtx.html