美文网首页
CentOS下 Apache Doris Oracle ODBC

CentOS下 Apache Doris Oracle ODBC

作者: 张家锋 | 来源:发表于2022-01-10 09:40 被阅读0次

    1.软件环境

    1. 操作系统:CentOS 7.8

    2. Apache Doris :0.15

    3. Postgresql数据库:oracle 19c

    4. UnixODBC:2.3.1

    5. Oracle ODBC :instantclient-odbc-linux.x64-19.13.0.0.0dbru

    2.Oracle安装部署

    因为是测试没有Oracle的环境,由于安装比较繁琐耗时,所以通过Docker进行快速安装部署,下面给出各个版本的Docker镜像地址

    2.1 Oracle 21C

    # 从Docker hub下载,网络不好时,一般比较慢 
    docker pull lhrbest/oracle21c_ee_db_21.3.0.0 
    # 可以选择从阿里云下载 
    docker pull registry.cn-hangzhou.aliyuncs.com/lhrbest/oracle21c_ee_db_21.3.0.0 
    # 从阿里云下载后可以tag成如下形式 
    docker tag registry.cn-hangzhou.aliyuncs.com/lhrbest/oracle21c_ee_db_21.3.0.0 lhrbest/oracle21c_ee_db_21.3.0.0
    

    启动容器

    
    # 1、创建容器 
    docker run -d --name lhroracle21c -h lhroracle21c \
    -p 5510:5500 -p 55100:5501 -p 1530:1521  -p 3400:3389 \
    -v /sys/fs/cgroup:/sys/fs/cgroup \
    --privileged=true lhrbest/oracle21c_ee_db_21.3.0.0 \
    /usr/sbin/init 
    # 2、进入容器 
    docker exec -it lhroracle21c bash 
    # 3、启动监听和数据库 
    su - oracle 
    sas 
    startup 
    lsnrctl start
    

    2.2 Oracle 19C

    请参照:https://mp.weixin.qq.com/s/R5o3BQwj7q68OyYJg1JUjQ

    2.3 Oracle 18C

    ## 拉取镜像
    docker pull registry.cn-hangzhou.aliyuncs.com/zhengqing/oracle18c
    ## 运行容器
    docker run -d --name oracle18c -p 1521:1521 registry.cn-hangzhou.aliyuncs.com/zhengqing/oracle18c
    

    2.4 Oracle 12C

    ##拉取镜像
    docker pull quay.io/maksymbilenko/oracle-12c
    ##运行容器
    docker run -d -p 8080:8080 -p 1521:1521 -v /my/oracle/data:/u01/app/oracle quay.io/maksymbilenko/oracle-12c
    

    2.5 Oracle 11g

    ##拉取镜像
    docker pull registry.cn-hangzhou.aliyuncs.com/helowin/oracle_11g
    ##运行容器
    docker run -d -p 1521:1521 --name oracle11g registry.cn-hangzhou.aliyuncs.com/helowin/oracle_11g
    

    3.安装unixODBC驱动

    首先我们安装unixODBC驱动、这里直接给出驱动的安装命令

    yum install unixODBC unixODBC-devel libtool-ltdl libtool-ltdl-devel
    

    安装完成之后执行odbcinst -j,看到下面信息说明安装成功

    #odbcinst -j
    unixODBC 2.3.1
    DRIVERS............: /etc/odbcinst.ini
    SYSTEM DATA SOURCES: /etc/odbc.ini
    FILE DATA SOURCES..: /etc/ODBCDataSources
    USER DATA SOURCES..: /root/.odbc.ini
    SQLULEN Size.......: 8
    SQLLEN Size........: 8
    SQLSETPOSIROW Size.: 8
    

    4.安装Oracle ODBC驱动及测试

    4.1 安装驱动

    我们需要下载下面这几个安装包:

    oracle-instantclient19.13-basic-19.13.0.0.0-2.x86_64.rpm
    oracle-instantclient19.13-devel-19.13.0.0.0-2.x86_64.rpm
    oracle-instantclient19.13-odbc-19.13.0.0.0-2.x86_64.rpm
    oracle-instantclient19.13-sqlplus-19.13.0.0.0-2.x86_64.rpm
    

    下面是下载地址:

    https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-sqlplus-19.13.0.0.0-2.x86_64.rpm
    https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-devel-19.13.0.0.0-2.x86_64.rpm
    https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-odbc-19.13.0.0.0-2.x86_64.rpm
    https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-basic-19.13.0.0.0-2.x86_64.rpm
    

    然后执行安装上面四个包

    rpm -ivh  oracle-instantclient19.13-basic-19.13.0.0.0-2.x86_64.rpm
    rpm -ivh  oracle-instantclient19.13-devel-19.13.0.0.0-2.x86_64.rpm
    rpm -ivh  oracle-instantclient19.13-odbc-19.13.0.0.0-2.x86_64.rpm
    rpm -ivh  oracle-instantclient19.13-sqlplus-19.13.0.0.0-2.x86_64.rpm
    

    验证我们安装的ODBC驱动动态链接库是否正确

    root@iZbp1cq4g9n8chsy7hcafhZ:~/doris/be/conf# ldd /usr/lib/oracle/19.13/client64/lib/libsqora.so.19.1
     linux-vdso.so.1 (0x00007ffefef27000)
     libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f43e80b0000)
     libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f43e7f61000)
     libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f43e7f3e000)
     libnsl.so.1 => /lib/x86_64-linux-gnu/libnsl.so.1 (0x00007f43e7f21000)
     librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f43e7f16000)
     libaio.so.1 => /lib/x86_64-linux-gnu/libaio.so.1 (0x00007f43e7f11000)
     libresolv.so.2 => /lib/x86_64-linux-gnu/libresolv.so.2 (0x00007f43e7ef3000)
     libclntsh.so.19.1 => /usr/lib/oracle/19.13/client64/lib/libclntsh.so.19.1 (0x00007f43e3d6f000)
     libclntshcore.so.19.1 => /usr/lib/oracle/19.13/client64/lib/libclntshcore.so.19.1 (0x00007f43e37cb000)
     libodbcinst.so.2 => /usr/local/lib/libodbcinst.so.2 (0x00007f43e37b3000)
     libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f43e35c1000)
     /lib64/ld-linux-x86-64.so.2 (0x00007f43e8379000)
     libnnz19.so => /usr/lib/oracle/19.13/client64/lib/libnnz19.so (0x00007f43e2f4a000)
     libltdl.so.7 => /lib/x86_64-linux-gnu/libltdl.so.7 (0x00007f43e2f3d000)
    

    4.2 配置环境变量

    sudo vi ~/.bashrc

    加入下面的内容

    export ORACLE_HOME=/usr/lib/oracle/19.13/client64
    export TNS_ADMIN=$ORACLE_HOME/network/admin
    export LD_LIBRARY_PATH=$ORACLE_HOME/lib
    export ORACLE_SID=LEI
    export PATH=$ORACLE_HOME/bin:$PATH
    

    4.3 配置tnsnames.ora文件

    cd /usr/lib/oracle/19.13/client64
    mkdir -p network/admin
    vi tnsnames.ora 
    

    加入下面的内容(注意修改成自己的,这里是示例)

    demo =
     (DESCRIPTION =
     (ADDRESS_LIST =
     (ADDRESS = (PROTOCOL = TCP)(HOST = 172.28.7.211)(PORT = 1521))
     )
     (CONNECT_DATA =
     (  SERVICE_NAME = LEI)
     )
     )
    

    注意

    1. 将HOST、PORT换成你自己的

    2. SERVICE_NAME :这个是我们启动Oracle docker的时候设置的ORACLE_SID

    4.4 配置odbcinst.ini

    这里使用RPM包安装的额ODBC驱动动态链接库在 /usr/lib/oracle/19.13/client64/lib/目录下

    root@iZbp1cq4g9n8chsy7hcafhZ:~/instantclient_21_4# ll /usr/lib/oracle/19.13/client64/lib/
    total 236232
    drwxr-xr-x 3 root root      4096 Jan  2 11:04 ./
    drwxr-xr-x 5 root root      4096 Jan  1 19:47 ../
    -rw-r--r-- 1 root root       342 Nov 27 02:41 glogin.sql
    lrwxrwxrwx 1 root root        21 Jan  1 19:43 libclntshcore.so -> libclntshcore.so.19.1*
    -rwxr-xr-x 1 root root   8057664 Nov 27 02:39 libclntshcore.so.19.1*
    lrwxrwxrwx 1 root root        17 Jan  1 19:43 libclntsh.so -> libclntsh.so.19.1*
    lrwxrwxrwx 1 root root        17 Jan  1 19:43 libclntsh.so.10.1 -> libclntsh.so.19.1*
    lrwxrwxrwx 1 root root        17 Jan  1 19:43 libclntsh.so.11.1 -> libclntsh.so.19.1*
    lrwxrwxrwx 1 root root        17 Jan  1 19:43 libclntsh.so.12.1 -> libclntsh.so.19.1*
    lrwxrwxrwx 1 root root        17 Jan  1 19:43 libclntsh.so.18.1 -> libclntsh.so.19.1*
    -rwxr-xr-x 1 root root  81679160 Nov 27 02:39 libclntsh.so.19.1*
    -rwxr-xr-x 1 root root   3642520 Nov 27 02:39 libipc1.so*
    -rwxr-xr-x 1 root root    478728 Nov 27 02:39 libmql1.so*
    -rwxr-xr-x 1 root root   5831752 Nov 27 02:39 libnnz19.so*
    -rwxr-xr-x 1 root root   2342024 Nov 27 02:39 libocci.so.19.1*
    -rwxr-xr-x 1 root root 130543568 Nov 27 02:39 libociei.so*
    -rwxr-xr-x 1 root root    153464 Nov 27 02:39 libocijdbc19.so*
    -rwxr-xr-x 1 root root    116376 Nov 27 02:39 liboramysql19.so*
    -rwxr-xr-x 1 root root   1660776 Nov 27 02:41 libsqlplusic.so*
    -rwxr-xr-x 1 root root   1572432 Nov 27 02:41 libsqlplus.so*
    -rwxr-xr-x 1 root root   1070192 Nov 27 02:41 libsqora.so.19.1* ---这里是要使用的ODBC动态链接库
    drwxr-xr-x 3 root root      4096 Jan  1 19:43 network/
    -rw-r--r-- 1 root root   4355723 Nov 27 02:39 ojdbc8.jar
    -rw-r--r-- 1 root root    313026 Nov 27 02:41 ottclasses.zip
    -rw-r--r-- 1 root root     37519 Nov 27 02:39 xstreams.jar
    

    编辑/etc/odbcinst.ini,在最后加上下面的内容

    [Oracle 19 ODBC driver]
    Description     = Oracle ODBC driver for Oracle 19
    Driver          = /usr/lib/oracle/19.13/client64/lib/libsqora.so.19.1
    Setup           =
    FileUsage       =
    CPTimeout       =
    CPReuse         =
    

    配置odbc.ini,在最后加上下面的内容

    [oracle]
    Driver = Oracle 19 ODBC driver ---这里的名称是上面odbcinst.ini里oracle部分用[]括起来的内容
    ServerName =172.16.192.81:1521/LEI --这里是你的oracle数据ip地址,端口及SID
    UserID = C##dbuser  --这里是我们上面创建的用户名
    Password = zhangfeng   --密码
    

    验证ODBC

    isql oracle
    +---------------------------------------+
    | Connected!                            |
    |                                       |
    | sql-statement                         |
    | help [tablename]                      |
    | quit                                  |
    |                                       |
    +---------------------------------------+
    

    显示一切正常

    5.Apache Doris Oracle外表验证

    5.1 修改配置

    修改BE节点conf/odbcinst.ini文件,加入刚才/etc/odbcinst.ini添加的一样内容,并删除原先的Oracle配置,加上你刚才安装的,如下:

    [Oracle 19 ODBC driver]
    Description     = Oracle ODBC driver for Oracle 19
    Driver          = /usr/lib/oracle/19.13/client64/lib/libsqora.so.19.1
    

    5.2 验证

    创建oracle的ODBC Resource

    CREATE EXTERNAL RESOURCE `oracle_19`
     PROPERTIES (
     "host" = "172.16.192.81",
     "port" = "1521",
     "user" = "C##dbuser",
     "password" = "zhangfeng",
     "database" = "LEI", --这里是你的数据库示例名称,也就是我们在docker启动时的ORACLE_SID
     "driver" = "Oracle 19 ODBC driver",   ---这里的名称一定和你在be odbcinst.ini里的oracle部分的[]里的内容一样,重要
     "odbc_type" = "oracle",
     "type" = "odbc_catalog"
     );
    

    创建ODBC外表

    CREATE EXTERNAL TABLE `oracle_odbc` (
     person_id int,
     first_name VARCHAR(50) NOT NULL,
     last_name VARCHAR(50) NOT NULL
    ) ENGINE=ODBC
    COMMENT "ODBC"
    PROPERTIES (
     "odbc_catalog_resource" = "oracle_19", 
     "database" = "LEI",
     "table" = "persons"
    );
    

    下面我们看执行结果

    mysql>  CREATE EXTERNAL RESOURCE `oracle_19`
     ->  PROPERTIES (
     ->  "host" = "172.16.192.81",
     ->  "port" = "1521",
     ->  "user" = "C##dbuser",
     ->  "password" = "zhangfeng",
     ->  "database" = "LEI",
     ->  "driver" = "Oracle 19 ODBC driver",
     ->  "odbc_type" = "oracle",
     ->  "type" = "odbc_catalog"
     ->  );
    Query OK, 0 rows affected (0.01 sec)
    
    mysql>
    mysql>  CREATE EXTERNAL TABLE `oracle_odbc` (
     ->     person_id int,
     ->     first_name VARCHAR(50) NOT NULL,
     ->     last_name VARCHAR(50) NOT NULL
     -> ) ENGINE=ODBC
     -> COMMENT "ODBC"
     -> PROPERTIES (
     -> "odbc_catalog_resource" = "oracle_19",
     -> "database" = "LEI",
     -> "table" = "persons"
     -> );
    Query OK, 0 rows affected (0.01 sec)
    
    mysql> select * from oracle_odbc;
    +-----------+------------+-----------+
    | person_id | first_name | last_name |
    +-----------+------------+-----------+
    |         1 | zhang      | feng      |
    |         2 | 张峰       | 峰        |
    |         3 | zhangfeng  | 峰值      |
    +-----------+------------+-----------+
    3 rows in set (0.06 sec)
    

    OK一切正常,正常情况下,Oracle ODBC驱动只要你的数据库版本和你的ODBC驱动版本(大版本号对上就行)一致,就基本不会出问题。

    6.Oracle 各个版本和ODBC驱动程序的对应关系

    这个同样适用于Ubuntu操作系统下

    Oracle版本 Oracle ODBC版本
    Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production oracle-instantclient19.13-odbc-19.13.0.0.0
    Oracle Database 12c Standard Edition Release 12.2.0.1.0 - 64bit Production oracle-instantclient19.13-odbc-19.13.0.0.0
    Oracle Database 18c Enterprise Edition Release 18.0.0.0.0 - Production oracle-instantclient19.13-odbc-19.13.0.0.0
    Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production oracle-instantclient19.13-odbc-19.13.0.0.0
    Oracle Database 21c Enterprise Edition Release 21.0.0.0.0 - Production oracle-instantclient19.13-odbc-19.13.0.0.0

    Oracle ODBC驱动版本下载地址:

    https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-sqlplus-19.13.0.0.0-2.x86_64.rpm
    https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-devel-19.13.0.0.0-2.x86_64.rpm
    https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-odbc-19.13.0.0.0-2.x86_64.rpm
    

    相关文章

      网友评论

          本文标题:CentOS下 Apache Doris Oracle ODBC

          本文链接:https://www.haomeiwen.com/subject/cckmcrtx.html