BI系统套装

flink

文档
https://flink.apache.org/
下载flink包
https://dlcdn.apache.org/flink/flink-1.14.4/flink-1.14.4-bin-scala_2.12.tgz
下载驱动
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/table/jdbc/
连接器包：
https://repo.maven.apache.org/maven2/org/apache/flink/flink-connector-jdbc_2.12/1.14.4/flink-connector-jdbc_2.12-1.14.4.jar
驱动包：
https://repo.maven.apache.org/maven2/mysql/mysql-connector-java/8.0.28/mysql-connector-java-8.0.28.jar

doris

文档
https://doris.apache.org/zh-CN/downloads/downloads.html
下载
https://www.apache.org/dyn/closer.cgi/incubator/doris/1.0/1.0.0-incubating/apache-doris-1.0.0-incubating-bin.tar.gz
部署
https://doris.apache.org/zh-CN/installing/install-deploy.html#%E9%9B%86%E7%BE%A4%E9%83%A8%E7%BD%B2

编译安装connector包

下载flink-connector源码
https://doris.apache.org/zh-CN/extending-doris/flink-doris-connector.html#%E7%89%88%E6%9C%AC%E5%85%BC%E5%AE%B9
切换tag：1.14.3-2.12-1.0.2
修改一下代码

29:<version>1.14.4-2.12-1.0.2</version>
43:<tag>1.14.4-2.12-1.0.2</tag>
65:<flink.version>1.14.4</flink.version>
72:<thrift.binary>/usr/local/bin/thrift</thrift.binary>
替换 ${scala.version} -> 2.12
替换 ${flink.version} -> 1.14.4
添加
302: <scalaVersion>2.12</scalaVersion>   <!-- Scala version is detected from dependency to scala-library -->

安装
brew install thrift@0.13.0
Thrift version 0.13.0
添加：custom_env.sh

export THRIFT_BIN=/usr/local/bin/thrift
export MVN_BIN=/Users/zeal/soft/apache-maven-3.6.3/bin/mvn
export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_201.jdk/Contents/Home

打包：sh build.sh --flink 1.14.4 --scala 2.12
复制到flink lib目录

metabase

文档
https://www.metabase.com/docs/latest/operations-guide/installing-metabase.html
wget https://downloads.metabase.com/v0.42.4/metabase.jar
java -jar metabase.jar

处理数据

https://mp.weixin.qq.com/s/ssXocqCyoSVuRFBi2hzCKQ

创建docker镜像

docker commit -a "chenmingang" -m "bi" 0f618597cc58 bi:2.0
docker network create --driver bridge --subnet=172.17.0.0/16 --gateway=172.17.1.1 mynet
docker run -it -p 9030:9030 -p 8081:8081 -p 8030:8030 -p 3000:3000 --network=mynet --ip 172.17.0.3 bi:2.0