美文网首页大数据Hive在简书
Hive Metastore部署方式

Hive Metastore部署方式

作者: 阿武z | 来源:发表于2018-08-03 14:55 被阅读2次

Metastore 有三种部署方式

  • embedded mode (Metastore 和 db 都运行在 Hive Service进程中)
  • local mode (Metastore 运行在 Hive Service进程中)
  • remote mode (Metastore , Hive Service, db 运行在不同的进程中)

Embedded Mode

Cloudera recommends using this mode for experimental purposes only.

Embedded mode is the default metastore deployment mode for CDH. In this mode, the metastore uses a Derby database, and both the database and the metastore service are embedded in the main HiveServer process. Both are started for you when you start the HiveServer process. This mode requires the least amount of effort to configure, but it can support only one active user at a time and is not certified for production use.

Local Mode

In Local mode, the Hive metastore service runs in the same process as the main HiveServer process, but the metastore database runs in a separate process, and can be on a separate host. The embedded metastore service communicates with the metastore database over JDBC.

Remote Mode

Cloudera recommends that you use this mode.

In Remote mode, the Hive metastore service runs in its own JVM process. HiveServer2, HCatalog, Impala, and other processes communicate with it using the Thrift network API (configured using the hive.metastore.uris property). The metastore service communicates with the metastore database over JDBC (configured using the javax.jdo.option.ConnectionURL property). The database, the HiveServer process, and the metastore service can all be on the same host, but running the HiveServer process on a separate host provides better availability and scalability.

The main advantage of Remote mode over Local mode is that Remote mode does not require the administrator to share JDBC login information for the metastore database with each Hive user. HCatalog requires this mode.

官方文档

相关文章

  • Hive Metastore部署方式

    Metastore 有三种部署方式 embedded mode (Metastore 和 db 都运行在 Hive...

  • hive学习

    1 Hive Metastore 1.1相关概念 Hive Metastore有三种配置方式,分别是: Embed...

  • Hive metastore三种存储方式

    Hive Metastore有三种配置方式,分别是: Embedded Metastore Database (D...

  • Hudi Hive sync 使用

    背景 Spark/Flink可以使用Hive的metastore,但是Hive无法通过Hive metastore...

  • spark连接Hive

    作者是通过metastore方式实现spark连接hive数据库,所以首先启动metastore: 另外需要将co...

  • hive搭建方式概览

    hive三种方式区别和搭建 Hive中metastore(元数据存储)的三种方式: a)内嵌Derby方式 b)L...

  • hive-metastore

    Hive metastore三种配置方式 | IT瘾http://itindex.net/detail/52784...

  • Metastore源码分析

    本文基于hive-1.2.2源码Metastore模块在metastore目录下 入口文件 metastore/s...

  • Hive 高可用搭建

    hive的搭建方式有三种,分别是 1、Local/Embedded Metastore Database (Der...

  • HIVE 安装笔记

    1、hive 启动报错Starting Hive Metastore Serverorg.apache.thrif...

网友评论

    本文标题:Hive Metastore部署方式

    本文链接:https://www.haomeiwen.com/subject/otnyvftx.html