美文网首页
Hive动态分区表导入数据时报错

Hive动态分区表导入数据时报错

作者: bigdata张凯翔 | 来源:发表于2020-06-26 01:39 被阅读0次

    主要报错信息如下:
    Fatal error occurred when node tried to create too many dynamic partitions. The maximum number of dynamic partitions is controlled by hive.exec.max.dynamic.partitions and hive.exec.max.dynamic.partitions.pernode. Maximum was set to: 100

    解决方法:
    在执行插入数据到分区时,添加参数设置:
    set hive.exec.dynamic.partition=true;
    set hive.exec.dynamic.partition.mode=nonstrict;
    set hive.exec.max.dynamic.partitions.pernode=10000;
    set hive.exec.max.dynamic.partitions=10000;
    set hive.exec.max.created.files=10000;

    相关文章

      网友评论

          本文标题:Hive动态分区表导入数据时报错

          本文链接:https://www.haomeiwen.com/subject/lwkyfktx.html