转自:http://blog.51cto.com/itdby/1980018
一、实验环境
3台centos7的主机:
master 192.168.111.131部署etcd,kube-apiserver,kube-controller-manager,kube-scheduler 4个应用。
node01 192.168.111.130 部署docker,kubelet, kube-proxy 3个应用
node02 192.168.111.129 部署docker,kubelet, kube-proxy 3个应用
二、实验步骤
1. 修改主机名和ip,三个主机网卡均设置为桥接模式,能够联网。
修改主机名:
hostnamectl set-hostname master
hostnamectl set-hostname node1
hostnamectl set-hostname node2
查看:
vi /etc/hostname
重启:
reboot
2. 分别修改/etc/hosts文件:
- Master配置
#vim /etc/hosts
![](https://img.haomeiwen.com/i2044960/5cee014322774659.png)
Node01
#scp root@192.168.111.128:/etc/hosts /etc/
Node02
#scp root@192.168.111.128:/etc/hosts /etc/
3. 三台均设置防火墙的默认区域为trusted。
![](https://img.haomeiwen.com/i2044960/d3b273c33ec28388.png)
![](https://img.haomeiwen.com/i2044960/b0e383c727342078.png)
![](https://img.haomeiwen.com/i2044960/2e8663e44f2a396e.png)
4. 三台均关闭selinux
![](https://img.haomeiwen.com/i2044960/233986b9c3efad55.png)
vi /etc/selinux/config
将SELINUX=enforcing改为SELINUX=disabled
设置后需要重启才能生效
5. 三台均安装docker,并启动。因为master之后还需要做registry仓库,所以也需要安装docker.
#yum install -y docker
![](https://img.haomeiwen.com/i2044960/2778c83e565c4bae.png)
6. 三台均开启路由转发功能:
![](https://img.haomeiwen.com/i2044960/23f3bad9ed427424.png)
7、实现node01和node02之间容器互通。
1)node01和node02新建网桥,并固定网桥ip。
node01上操作:
删除网桥docker0,新建网桥kbr0:
首先安装网桥管理工具brctl:yum install bridge-utils
![](https://img.haomeiwen.com/i2044960/e5dd234b3f65a4d3.png)
新建网桥的配置文件:
![](https://img.haomeiwen.com/i2044960/18918f9d0e7edcd4.png)
新建路由文件:route-eth0,eth0为node1上的网卡名。
![](https://img.haomeiwen.com/i2044960/245345b93344ba83.png)
修改docker配置文件,添加-b=kbr0参数
![](https://img.haomeiwen.com/i2044960/26db20a2090a28eb.png)
2)对node02做同样的设置:
新建网桥:
![](https://img.haomeiwen.com/i2044960/fe4d99eb9cf0c4f9.png)
新建网桥配置文件:
· #scp root@192.168.111.129:/etc/sysconfig/network-scripts/ifcfg-kbr0 /etc/sysconfig/network-scripts/
![](https://img.haomeiwen.com/i2044960/90bb0fe3b5c81c6a.png)
创建路由文件:
![](https://img.haomeiwen.com/i2044960/5caaa39c4a8be048.png)
修改docker 配置文件:
#vim /etc/sysconfig/docker
![](https://img.haomeiwen.com/i2044960/9a47009b9e614483.png)
3)系统启动之后,查看网卡信息和路由信息。
#ifconfig
![](https://img.haomeiwen.com/i2044960/df42963d913a7364.png)
![](https://img.haomeiwen.com/i2044960/9d439493598a5ec4.png)
4)验证两个宿主机间容器的互通性:
- node01上运行一个容器:
![](https://img.haomeiwen.com/i2044960/3b41021ed5749cfa.png)
- node02上运行一个容器:
![](https://img.haomeiwen.com/i2044960/dbce420aa0c9ad8e.png)
- 容器间互ping:
#docker run -it docker.io/centos:centos6
# yum install -y iputils 进入容器安装
![](https://img.haomeiwen.com/i2044960/d22a43e55e088edc.png)
#dcoker run -it docker.io/centos:centos6
![](https://img.haomeiwen.com/i2044960/b603412026fb9417.png)
master上部署应用:
1、安装etcd.
![](https://img.haomeiwen.com/i2044960/699d651dd66fdccb.png)
查看etcd配置文件:
![](https://img.haomeiwen.com/i2044960/d75cb73d3d89fc4f.png)
2、修改配置文件:
![](https://img.haomeiwen.com/i2044960/d642170e3d08692a.png)
![](https://img.haomeiwen.com/i2044960/e96f8f7f5e60badf.png)
![](https://img.haomeiwen.com/i2044960/b8defbb6ff0b5599.png)
4、部署k8s-master组件(apiserver+controller-manager+scheduler)
安装软件:
#yum install -y kubernetes-master
![](https://img.haomeiwen.com/i2044960/5a6859540015f7b0.png)
查看配置文件:
![](https://img.haomeiwen.com/i2044960/7208c18b286cb730.png)
5、修改配置文件:
#vim /etc/kubernetes/config
![](https://img.haomeiwen.com/i2044960/fad0376969b2aeed.png)
KUBE_LOGTOSTDERR 日志设置
KUBE_LOG_KEVEL 日志级别设置
KUBE_ALLOW_PRIV 是否允许运行特权容器
KUBE_MASTER 主节点的地址,主要为replication controller和scheduler及kubelet可以顺利找到apiserver
#vim /etc/kubernetes/apiserver
![](https://img.haomeiwen.com/i2044960/ad020c82486b747c.png)
KUBE_API_PORT="--port=8080" apiserver的监听端口,默认8080,不用修改。
KUBELET_PORT="--kubelet_port=10250" kubelet监听的端口,默认10250,无需修改
KUBE_ETCD_SERVERS //指定etcd节点的地址
KUBE_SERVICE_ADDRESSES 这个是设置今后运行Service所在的ip网段
KUBE_API_ARGS=”--secure-port=0” 默认是要求https安全通信,”--secure-port=0”则不要求https安全通信
注:这里需要注意原来KUBE_ADMISSION_CONTROL默认包含的要删掉,不然启动API server的时候会报错
6、启动服务:
![](https://img.haomeiwen.com/i2044960/319e91d229cbdf23.png)
查看服务端口:
![](https://img.haomeiwen.com/i2044960/b2f40975bdc41a61.png)
部署node主机:
1、安装kubernetes-node软件:
#yum install -y kubernetes-node
![](https://img.haomeiwen.com/i2044960/7b0f33b5283328b2.png)
2、修改配置文件:
#vim /etc/kubernetes/config
![](https://img.haomeiwen.com/i2044960/84c8267646bf5351.png)
#vim /etc/kubernetes/kubelet
![](https://img.haomeiwen.com/i2044960/f06d9664141d3e50.png)
3、启动服务:
![](https://img.haomeiwen.com/i2044960/35b6436fe91d8d7c.png)
4、在node02主机上重复上面的操作。
5、在master上检查node 状态:
![](https://img.haomeiwen.com/i2044960/7aaf81f88fd95280.png)
![](https://img.haomeiwen.com/i2044960/c41a706df96fa01d.png)
建私有仓库:
Kubernetes管理容器如果是第一次操作,可能会有一定的等待时间,这是因为第一次下载images需要一段时间。如果本地没有docker registry,要确保节点能访问互联网,所以我们可以搭建一个私有仓库,由私有仓库提供所需要的镜像,
本实验环境中用kubernetes同时作为registry。
1、导入镜像:
![](https://img.haomeiwen.com/i2044960/d02adea1f42d9e14.png)
2、基于私有仓库镜像运行容器
![](https://img.haomeiwen.com/i2044960/7e45ae396acf3888.png)
3、本地访问私有仓库:
![](https://img.haomeiwen.com/i2044960/0b8eaf405b75ba71.png)
4、上传镜像到私有仓库。
- 导入之后用到的镜像到本地
![](https://img.haomeiwen.com/i2044960/b3fd587de9aa3083.png)
- 给基础镜像打个标签:
![](https://img.haomeiwen.com/i2044960/5a67816bbbcd50de.png)
- 在三台主机上均修改docker 的配置文件,指定私有仓库的url.
![](https://img.haomeiwen.com/i2044960/87a6ed9dcbde7f89.png)
- 重启docker服务:
![](https://img.haomeiwen.com/i2044960/43de7f208d33deaa.png)
- 上传镜像到私有仓库并查看:
![](https://img.haomeiwen.com/i2044960/f1b93fb9d1ca1a81.png)
- 测试,下载刚才上传的镜像:
![](https://img.haomeiwen.com/i2044960/1f6b037231edd315.png)
![](https://img.haomeiwen.com/i2044960/a2068a33d49d7dcb.png)
部署web应用
1、为了部署pod的时候,下载镜像速度快点,把node节点主机配置文件中的pod镜像下载地址修改为本地私有仓库地址:
#vim /etc/kubernetes/kubelet
![](https://img.haomeiwen.com/i2044960/9ef1058819955a30.png)
#systemctl restart kubelet.service
2、创建apache-rc.yaml文件,根据文件内容创建rc和pod。
![](https://img.haomeiwen.com/i2044960/25f6e2f3984a644b.png)
注意:必须按照此格式编写否则会报错
#kubectl create -f apache-rc.yaml
error: error validating "apache-rc.yaml": error validating data: found invalid field spec for v1.ReplicationControllerSpec; if you choose to ignore these errors, turn validation off with --validate=false
![](https://img.haomeiwen.com/i2044960/35883fcd5142a2c9.png)
- 查看pods状态:
![](https://img.haomeiwen.com/i2044960/1d6f211991af6ceb.png)
- 查看pods详细状态:
![](https://img.haomeiwen.com/i2044960/9f0c6d6b736a13d4.png)
附:删除pod
kubectl delete pod podName
由于设置了两份副本,所以删除pod的时候,k8s会迅速起另外一个一模一样的pod以保持副本数量为2不变。
要彻底删除pod,只能删除创建它的replication controller
查看replication controller
kubectl get rc
删除replication controller
kubectl delete rc rcName
删除rc之后,其创建的pod会一并删除
3、部署节点内部可访问的apache service
Server的type有ClusterIP和 NodePort之分,缺省是ClusterIp,这种类型的service只能在集群内部访问
- 创建配置文件:
#vim apache-service-clusterip.yaml
![](https://img.haomeiwen.com/i2044960/7dcf03ccb1126b65.png)
- 创建service:
![](https://img.haomeiwen.com/i2044960/ccdd64e7ad6d2062.png)
- 查看service状态:
![](https://img.haomeiwen.com/i2044960/4326cf76dcc7b1b3.png)
- 验证apache服务:(在node节点执行)
![](https://img.haomeiwen.com/i2044960/bba60817061be634.png)
4、部署外部可访问的apache service。
创建nodeport类型的service . 这种类型的Service在集群外部是可以访问
#vim apache-nodeport-service.yaml
![](https://img.haomeiwen.com/i2044960/92283eeed89be9b2.png)
- 创建service:
![](https://img.haomeiwen.com/i2044960/3da5e01861998b7c.png)
- 查看service:
![](https://img.haomeiwen.com/i2044960/4cfdd085467bfcc7.png)
外部访问:
![](https://img.haomeiwen.com/i2044960/4dbab2c9f8fa2e1f.png)
![](https://img.haomeiwen.com/i2044960/09770742282daf31.png)
内部访问:
![](https://img.haomeiwen.com/i2044960/9a9831efb0a4d2df.png)
到此为止kubernetes 集群搭建完毕!!!
网友评论