第一阶段:
在未上线之前,数据库的配置工作并不十分复杂,而且数据量也比较少,所以用了mysqlworkbench手工完成每个类的数据填充。
第二阶段:
为了满足上线要求,必须要将数据库和程序一起移到:服务器上,所有东西都未配置,故做了以下工作:
1)查看该vps系统:
uname -a或lsb_release -a即可查看
2)我的vps为ubuntu,所以可以解释清楚为什么有apt-get而没有yum,但是却不能用。
然后在尝试了装rpm之后意识到这不是centos,于是在同学的提醒下,对apt的源进行更新。
随后,正常安装mysql。
apt-get install mysql-client, mysql-server
(有的人说要装一个libmysqlclient-dev,但是我之前都没装,数据库运行正常,写这篇博客的时候才开始装)
3)在装完mysql后便是对用户等的一些配置:
--- > 在看有无装成功,方法很多,我直接mysql,按tab键,有补全,即装成
忘记什么时候设置密码了,中间不是很复杂
--- > 以root登录:mysql -u root -p 然后输入密码
--- > 创建新的用户,为了使权限分清,安全起见:
CREATE USER 'user1'@'%' IDENTIFIED BY 'password';
这里面大小写没关系,%代表任意位置,可以换成localhost或是指定ip,由于我们是本地程序访问,所以设置为localhost。
--- > 设置用户权限:
grant all privileges on 想授权的数据库.* to 'user1'@'%';
all可以换位其他的select,delete,update, drop, create等
--- > 更改密码:
update mysql.user set password=password('新密码') where user='user1';
这是因为用户信息在mysql下的user表中存储,而加密方式用password函数即可
第三阶段:
这个部分主要是写代码,让创建数据库等操作简单化,为了应对未来的自动化部署
下面是我的代码,很简单,解释也较清晰,我就不多废话了
# -*- coding: utf-8 -*-
# @Time : 2018/8/29 上午10:52
# @Author : shijie
# @Email : lsjfy0411@163.com
# @File : docker_mysql.py
# @Software: PyCharm
'''
为了标准化,在设计初始阶段,主要分三个模块用来测试;
这是第一个模块,即,与数据库交互的功能部分;
数据库名:fanuc
表名:session
用户名:fanuc
密码:fanuc123
session表的结构为:
请尽量按照此标准进行
'''
import pymysql
import copy
#配置信息]
config = {
'host': '127.0.0.1',
'port': 3306,
# 'db':'fanuc_docker',
'user': 'root',
'passwd': '',
# 'charset':'utf8mb4',
'cursorclass':pymysql.cursors.DictCursor
}
def changeConfig(config,dbName):
ConfigForInsert = copy.deepcopy(config)
ConfigForInsert['db'] = dbName
return ConfigForInsert
#sql语句构建
def createSql():
sql = "CREATE DATABASE IF NOT EXISTS "
#连接
def connectMysql(config):
'''
这里连接,给个config就行,不管是创建数据库还是数据表
:param config:
:return:
'''
return pymysql.connect(**config)
#新建数据库
def createDB(con,DBname):
'''
:param con: 这是针对连接的,不是针对数据表的
:param DBname: 字符串,要建的数据库名
:return:
'''
sql = "CREATE DATABASE IF NOT EXISTS " + DBname
cur = con.cursor()
try:
cur.execute(sql)
print("数据库%s创建成功"%DBname)
except:
print("已存在")
#新建数据表
def createTable(db,TableName):
'''
传入新的db类和表名
:param db:
:param TableName:
:return:
'''
sql = """CREATE TABLE %s(
request_data VARCHAR(3000) NOT NULL,
response_data VARCHAR(3000),
functions VARCHAR(45),
session_id INT(11) NOT NULL PRIMARY KEY AUTO_INCREMENT,
data DATE)"""%TableName
# print(sql)
cur = db.cursor()
try:
cur.execute(sql)
print("数据表%s插入成功"%TableName)
except:
print("失败,可能%s该表已存在"%TableName)
#插入数据
def insertDB(DB):
cur = DB.cursor()
cur.execute("")
#查询数据
#删除数据库
def dropDB(con,DBname):
sql = "DROP DATABASE IF EXISTS " + DBname
cur = con.cursor()
try:
cur.execute(sql)
print("数据库%s删除成功"%DBname)
except :
print("已删除")
#删除数据表
def dropTable(db,TableName):
sql = "DROP TABLE IF EXISTS " + TableName
cur = db.cursor()
try:
cur.execute(sql)
print("数据表%s删除成功"%TableName)
except :
print("该表已删除")
#
if __name__ == '__main__':
con = connectMysql(config)
createDB(con,"fanucdocker")
dbconfig = changeConfig(config, 'fanucdocker')
db = connectMysql(dbconfig)
createTable(db,'sessionNew')
# dropTable(db,'sessionNew')
# dropTable(db,'session')
# dropDB(con,"docker")
# dropDB(con,"fanucdocker")
# sql =
这只是一部分,还有插入的部分我再修改中,所以暂时不加进来。
第四阶段:
为了紧急上线,因为我之前的另一种思路是利用docker去规模部署的,但是时间较短,一天还没怎么学会,师兄说得抓紧,所以就在本地数据库和vps之间要做个数据库导出导入工作。
这里碰到一些坑:
-------->> 我的mac默认的编码格式为utf8m64,collation模式为utf8mb4_0900_ai_ci在导出的sql或txt文件中配置也是这么写的,但在vps-ubuntu上导入时,无法识别,出现错误。
问题解决:将导出的文件中的utf8m64替换为utf8,将utf8mb4_0900_ai_ci替换为utf8——unicode_ci。
-------->> 另一个坑是我的mac上的mysql基本配置文件my-default.cnf不见了,所以有下载了一个,重新更名为my.cnf,并放在了etc文件夹下,网上有一个配置文件,有人下了坑,反注释可能会被反连接到,所以不敢轻易尝试这么做。我放的这个文件没问题,已经检查过了。
#
# Example MySQL config file for medium systems. # # This is for a system with little memory (32M - 64M) where MySQL plays # an important part, or systems up to 128M where MySQL is used together with # other programs (such as a web server) # # MySQL programs look for option files in a set of # locations which depend on the deployment platform. # You can copy this option file to one of those # locations. For information about these locations, see: # http://dev.mysql.com/doc/mysql/en/option-files.html # # In this file, you can use all long options that a program supports. # If you want to know which options a program supports, run the program # with the "--help" option. # The following options will be passed to all MySQL clients [client] default-character-set=utf8 #password = your_password port = 3306 socket = /tmp/mysql.sock # Here follows entries for some specific programs # The MySQL server [mysqld] character-set-server=utf8 init_connect='SET NAMES utf8 port = 3306 socket = /tmp/mysql.sock skip-external-locking key_buffer_size = 16M max_allowed_packet = 1M table_open_cache = 64 sort_buffer_size = 512K net_buffer_length = 8K read_buffer_size = 256K read_rnd_buffer_size = 512K myisam_sort_buffer_size = 8M character-set-server=utf8 init_connect='SET NAMES utf8' # Don't listen on a TCP/IP port at all. This can be a security enhancement, # if all processes that need to connect to mysqld run on the same host. # All interaction with mysqld must be made via Unix sockets or named pipes. # Note that using this option without enabling named pipes on Windows # (via the "enable-named-pipe" option) will render mysqld useless! # #skip-networking # Replication Master Server (default) # binary logging is required for replication log-bin=mysql-bin # binary logging format - mixed recommended binlog_format=mixed # required unique id between 1 and 2^32 - 1 # defaults to 1 if master-host is not set # but will not function as a master if omitted server-id = 1 # Replication Slave (comment out master section to use this) # # To configure this host as a replication slave, you can choose between # two methods : # # 1) Use the CHANGE MASTER TO command (fully described in our manual) - # the syntax is: # # CHANGE MASTER TO MASTER_HOST=, MASTER_PORT=, # MASTER_USER=, MASTER_PASSWORD=; # # where you replace,,by quoted strings and #by the master's port number (3306 by default). # # Example: # # CHANGE MASTER TO MASTER_HOST='125.564.12.1', MASTER_PORT=3306, # MASTER_USER='joe', MASTER_PASSWORD='secret'; # # OR # # 2) Set the variables below. However, in case you choose this method, then # start replication for the first time (even unsuccessfully, for example # if you mistyped the password in master-password and the slave fails to # connect), the slave will create a master.info file, and any later # change in this file to the variables' values below will be ignored and # overridden by the content of the master.info file, unless you shutdown # the slave server, delete master.info and restart the slaver server. # For that reason, you may want to leave the lines below untouched # (commented) and instead use CHANGE MASTER TO (see above) # # required unique id between 2 and 2^32 - 1 # (and different from the master) # defaults to 2 if master-host is set # but will not function as a slave if omitted #server-id = 2 # # The replication master for this slave - required #master-host =# # The username the slave will use for authentication when connecting # to the master - required #master-user =# # The password the slave will authenticate with when connecting to # the master - required #master-password =# # The port the master is listening on. # optional - defaults to 3306 #master-port =
#
# binary logging - not required for slaves, but recommended
#log-bin=mysql-bin
# Uncomment the following if you are using InnoDB tables
#innodb_data_home_dir = /usr/local/mysql/data
#innodb_data_file_path = ibdata1:10M:autoextend
#innodb_log_group_home_dir = /usr/local/mysql/data
# You can set .._buffer_pool_size up to 50 - 80 %
# of RAM but beware of setting memory usage too high
#innodb_buffer_pool_size = 16M
#innodb_additional_mem_pool_size = 2M
# Set .._log_file_size to 25 % of buffer pool size
#innodb_log_file_size = 5M
#innodb_log_buffer_size = 8M
#innodb_flush_log_at_trx_commit = 1
#innodb_lock_wait_timeout = 50
[mysqldump]
quick
max_allowed_packet = 16M
[mysql]
no-auto-rehash
# Remove the next comment character if you are not familiar with SQL
#safe-updates
default-character-set=utf8
[myisamchk]
key_buffer_size = 20M
sort_buffer_size = 20M
read_buffer = 2M
write_buffer = 2M
[mysqlhotcopy]
interactive-timeout
'''
第五阶段
在上述基础之上,完成对数据的迁移,有几种方法:mysql导入、source导入和load data导入,我选择用source。
1)在新机器上创建和原mysql一样的用户名和密码及编码
刚装的mysql是不需要密码的,故更改即可,我们使用下边的命令
update user set password=PASSWORD("newpassword") where user='root';
创建DB并设置编码
create database 'db';
use 'db';
set names utf8;
最后一步,导入数据
source path
完成
网友评论