rsync的原理说明

第一步

客户端====>服务端:向服务端请求数据,发送认证用户信息,传输数据信息

第二步

服务端====>客户端:接收数据信息,审核认证用户,发送回复信息,要求密码信息

第三步

客户端====>服务端:返回密码信息

第四步

服务端====>客户端:发送确认信息

第五步

客户端====>服务端:用户携带数据,通过网络传输,需要对用户身份进行转换,转变为rsync(配置文件配置的uid)

第六步

服务端====>客户端:服务端接收数据,将数据放入属主和属组为rsync的备份目录,并将传输过来的数据的属主和属组改为rsync

rsync的参数说明

rsync -avz
-a (-rpltogD)
-r 递归复制目录
-p 保持复制数据的权限不变
-l 复制软连接文件,保持软连接文件属性不变
-t 保持文件的mtime不变
-o 保持文件的属主不变
-g 保持文件的属组不变
-D 保持块设备的属性不变
===========================================================================
-L 复制软链接文件时,复制源文件到目录中,但文件名还是软连接文件
--exclude  排除某个文件,当排除多个文件 写多个--exclude后面直接跟文件名
--exclude-from 排除某个文件里面的内容,把要排除的文件名写入--exclude-from 后面的文件里头
注意:--exclude和--exclude-from 排除文件名时,都是针对上一个目录的相对路径排除
-v 显示过程,不显示进度
-z 以gzip的方式压缩传输
-P(大写) 显示传输过程中的进度 
--bwlimit 显示磁盘的传输的IO
--password-file 指定密码文件,免交互式
=============================================================================
[root@m01 ~]# tree ~/oldboy/
/root/oldboy/
├── oldboy01
│   ├── a.txt
│   ├── b.txt
│   └── c.txt
├── oldboy02
│   ├── a.txt
│   ├── b.txt
│   └── c.txt
├── oldboy03
│   ├── a.txt
│   ├── b.txt
│   └── c.txt
└── rsync_backup@172.16.1.41
    └── oldboy01
        └── oldboy

5 directories, 10 files

例:--exclude
[root@m01 ~]# rsync -avz ~/oldboy/ --exclude=oldboy01/ --exclude=oldboy02/a.txt rsync://rsync_backup@172.16.1.41:874/backup_dbadir --password-file=/etc/rsync.password
sending incremental file list
./
oldboy02/
oldboy02/b.txt
oldboy02/c.txt
oldboy03/
oldboy03/a.txt
oldboy03/b.txt
oldboy03/c.txt
rsync_backup@172.16.1.41/
sent 468 bytes  received 138 bytes  1,212.00 bytes/sec
total size is 0  speedup is 0.00
例:--exclude-from
[root@m01 ~]# cat >>exculde.txt<<EOF
> oldboy01/
> oldboy02/a.txt
> EOF
[root@m01 ~]# rsync -avz ~/oldboy/ --exclude-from=exculde.txt rsync://rsync_backup@172.16.1.41:874/backup_dbadir --password-file=/etc/rsync.password
sending incremental file list
./
oldboy02/
oldboy02/b.txt
oldboy02/c.txt
oldboy03/
oldboy03/a.txt
oldboy03/b.txt
oldboy03/c.txt
rsync_backup@172.16.1.41/
sent 468 bytes  received 138 bytes  1,212.00 bytes/sec
total size is 0  speedup is 0.00

-P(大写)和--bwlimit

bwlimit.png

客户端部署过程

echo 123456> /etc/rsync.password
chmod 600 /etc/rsync.password
[root@m01 ~]# rsync -avzP -/opt/1G rsync://rsync_backup@172.16.1.41:874/backup_dbadir --password-file=/etc/rsync.password

守护进程企业应用

推

客户端 数据备份 服务端

拉

客户端 数据恢复 服务端

企业应用

创建守护进程多模块

第一个里程:修改配置文件

[root@backup /backup/dba_dir]# cat /etc/rsyncd.conf 
uid = rsync
gid = rsync
port = 874
fake super = yes
use chroot = no
max connections = 200
timeout = 300
pid file = /var/run/rsyncd.pid
lock file = /var/run/rsync.lock
log file = /var/log/rsyncd.log
ignore errors
read only = false
list = false
hosts allow = 172.16.1.0/24
auth users = rsync_backup
secrets file = /etc/rsync.password
exclude = oldboy01/a.txt
[backup_sadir]
comment = "backup dir by oldboy"
path = /backup/sa_dir
[backup_dbadir]
comment = "backup dir by oldboy"
path = /backup/dba_dir
[backup_devdir]
comment = "backup dir by oldboy"
path = /backup/dev_dir

第二个里程:创建目录和修改目录属主

[root@backup /backup/dba_dir]# ls /backup/
dba_dir  dev_dir  sa_dir
[root@backup /backup/dba_dir]# chown rsync.rsync -R /backup

第三个里程:重启服务

[root@backup /backup/dba_dir]# systemctl restart rsyncd

企业应用:排除功能

同上的参数的--exclude和--exclude-from

企业应用:保证存储服务器和备份服务器数据一致
--delete参数

[root@m01 ~]# rsync -avzP  --delete oldboy/  rsync://rsync_backup@172.16.1.41:874/backup_dbadir --password-file=/etc/rsync.password
sending incremental file list
deleting oldboy/rsync_backup@172.16.1.41/oldboy01/oldboy
deleting oldboy/rsync_backup@172.16.1.41/oldboy01/
deleting oldboy/rsync_backup@172.16.1.41/
deleting oldboy/oldboy03/c.txt
deleting oldboy/oldboy03/b.txt
deleting oldboy/oldboy03/a.txt
deleting oldboy/oldboy03/
deleting oldboy/oldboy02/c.txt
deleting oldboy/oldboy02/b.txt
deleting oldboy/oldboy02/a.txt
deleting oldboy/oldboy02/
deleting oldboy/oldboy01/c.txt
deleting oldboy/oldboy01/b.txt
deleting oldboy/oldboy01/a.txt
deleting oldboy/oldboy01/
deleting oldboy/
deleting 1G
./
oldboy01/
oldboy01/a.txt
              0 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=10/16)
oldboy01/b.txt
              0 100%    0.00kB/s    0:00:00 (xfr#2, to-chk=9/16)
oldboy01/c.txt
              0 100%    0.00kB/s    0:00:00 (xfr#3, to-chk=8/16)
oldboy02/a.txt
              0 100%    0.00kB/s    0:00:00 (xfr#4, to-chk=7/16)
rsync_backup@172.16.1.41/oldboy01/
rsync_backup@172.16.1.41/oldboy01/oldboy
              3 100%    0.00kB/s    0:00:00 (xfr#5, to-chk=0/16)
sent 642 bytes  received 567 bytes  2,418.00 bytes/sec
total size is 3  speedup is 0.00

企业应用:rsync的访问策略

rsync访问策略说明.jpg

注
全局配置:在模块上面的所有信息称为全局配置,会影响所有模块
局部配置:在单个模块上配置,称为局部配置,会影响单个模块
企业应用:守护进程创建子目录

 rsync -avzP  oldboy/  rsync://rsync_backup@172.16.1.41:874/backup/oldboy --password-file=/etc/rsync.password
#即在模块底下新增子目录传输

守护进程列表功能(了解)

cat /etc/rsyncd.conf
list = false    不允许列出模块列表
[root@m01 ~]# rsync rsync://rsync_backup@172.16.1.41:874
===============================================================================
cat /etc/rsyncd.conf
list = true    允许列出模块列表
[root@m01 ~]# rsync rsync://rsync_backup@172.16.1.41:874
backup          "backup dir by oldboy"
backup_sadir    "backup dir by oldboy"
backup_dbadir   "backup dir by oldboy"
backup_devdir   "backup dir by oldboy"