ceph upgrade luminous to nautilu

0.1 check health

ceph osd dump | grep ^flags | grep recovery_deletes | grep purged_snapdirs \ 
&& echo health: OSD_MAP_FLAGS_OK || echo warn: OSD_MAP_FLAGS_WARN
ceph -s | grep health

0.2 upgrade to lastest luminous node by node

apt-get update
apt-get dist-upgrade -d -y   # download packages

ceph osd set noout
apt-get dist-upgrade -y  && ceph osd unset noout  # after upgrade, unset noout 
ceph -s  # check health ok, then upgrade next node
 

make sure upgrade all nodes to lastest luminous.

0.3 pre-config : download nautilus packages

wget -q -O- 'https://mirrors.aliyun.com/ceph/keys/release.asc' |  apt-key add -
test -d /etc/apt/sources.list.d && echo deb https://mirrors.aliyun.com/ceph/debian-nautilus/ $(lsb_release -sc) main | sudo tee /etc/apt/sources.list.d/ceph.list
test -d /etc/apt/sources.list.d && echo deb https://mirrors.aliyun.com/ceph/nfs-ganesha/deb-V2.7-stable/nautilus/ $(lsb_release -sc) main | sudo tee -a /etc/apt/sources.list.d/ceph.list

apt-get update
apt-get dist-upgrade -d -y   # download packages

make sure all nodes downloaded packages.

0.4 set noout

ceph osd set noout

1.1 upgrade mon node by node

apt-get install ceph-mon -y

1.2 upgrade ceph-mgr node by node

1.3 upgrade osd node by node

1.3.2 activate osd

ceph-volume simple scan
ceph-volume simple activate --all

ceph-volume simple scan /dev/xvdb1
ceph-volume simple activate 0 6bfe25d8-9487-43e5-af86-d7cdc5755484

reboot node by node, to check osd auto startup.

1.4 upgrade mds node by node

1.4.2

# mds 名称不能以数字开头，为避免创建失败，每个服务前面加上"mds-" 前缀
node1=hostname1
node2=hostname2
node3=hostname3
ceph-deploy mds create  $node1:mds-$node1 $node2:mds-$node2 $node3:mds-$node3

ceph fs set cephfs max_mds 1  # must set if running <ceph fs> 

1.5 upgrade radosgw node by node

1.6 check again

2.1 all-in-one nodes

apt-get dist-upgrade -y 

post-config

ceph mon enable-msgr2
ceph osd unset noout 

升级遇到的问题：

1. mds 运行异常
   重启后，ubuntu 系统上的 mds 都运行异常，自动退出。
   解决方法： 在 CentOS7 系统上安装了新的 mds ，就可以正常工作。。。

https://ceph.com/releases/v14-2-0-nautilus-released/