美文网首页蜜罐研究进展
Mysql在本项目中的一些坑和用法

Mysql在本项目中的一些坑和用法

作者: 某山 | 来源:发表于2018-08-30 21:34 被阅读0次

    第一阶段:

    在未上线之前,数据库的配置工作并不十分复杂,而且数据量也比较少,所以用了mysqlworkbench手工完成每个类的数据填充。

    第二阶段:

    为了满足上线要求,必须要将数据库和程序一起移到:服务器上,所有东西都未配置,故做了以下工作:

    1)查看该vps系统:

    uname -a或lsb_release -a即可查看
    

    2)我的vps为ubuntu,所以可以解释清楚为什么有apt-get而没有yum,但是却不能用。

    然后在尝试了装rpm之后意识到这不是centos,于是在同学的提醒下,对apt的源进行更新。

    随后,正常安装mysql。

    apt-get install mysql-client, mysql-server
    

    (有的人说要装一个libmysqlclient-dev,但是我之前都没装,数据库运行正常,写这篇博客的时候才开始装)

    3)在装完mysql后便是对用户等的一些配置:

    --- > 在看有无装成功,方法很多,我直接mysql,按tab键,有补全,即装成

    忘记什么时候设置密码了,中间不是很复杂

    --- > 以root登录:mysql -u root -p 然后输入密码

    --- > 创建新的用户,为了使权限分清,安全起见:

     CREATE USER 'user1'@'%' IDENTIFIED BY 'password'; 
    

    这里面大小写没关系,%代表任意位置,可以换成localhost或是指定ip,由于我们是本地程序访问,所以设置为localhost。

    --- > 设置用户权限:

    grant all privileges on 想授权的数据库.* to 'user1'@'%';

    all可以换位其他的select,delete,update, drop, create等

    --- > 更改密码:

    update mysql.user set password=password('新密码') where user='user1';

    这是因为用户信息在mysql下的user表中存储,而加密方式用password函数即可

    第三阶段:

    这个部分主要是写代码,让创建数据库等操作简单化,为了应对未来的自动化部署

    下面是我的代码,很简单,解释也较清晰,我就不多废话了

        # -*- coding: utf-8 -*-
        # @Time    : 2018/8/29 上午10:52
        # @Author  : shijie
        # @Email   : lsjfy0411@163.com
        # @File    : docker_mysql.py
        # @Software: PyCharm
        '''
        为了标准化,在设计初始阶段,主要分三个模块用来测试;
        这是第一个模块,即,与数据库交互的功能部分;
        数据库名:fanuc
        表名:session
        用户名:fanuc
        密码:fanuc123
        session表的结构为:
        请尽量按照此标准进行
        '''
    
        import pymysql
        import copy
        #配置信息]
        config = {
            'host': '127.0.0.1',
            'port': 3306,
            # 'db':'fanuc_docker',
            'user': 'root',
            'passwd': '',
            # 'charset':'utf8mb4',
            'cursorclass':pymysql.cursors.DictCursor
            }
        def changeConfig(config,dbName):
            ConfigForInsert = copy.deepcopy(config)
            ConfigForInsert['db'] = dbName
            return ConfigForInsert
    
    
        #sql语句构建
        def createSql():
            sql = "CREATE DATABASE IF NOT EXISTS "
    
        #连接
    
        def connectMysql(config):
            '''
            这里连接,给个config就行,不管是创建数据库还是数据表
            :param config:
            :return:
            '''
            return pymysql.connect(**config)
    
    
        #新建数据库
        def createDB(con,DBname):
            '''
    
            :param con: 这是针对连接的,不是针对数据表的
            :param DBname: 字符串,要建的数据库名
            :return:
            '''
            sql = "CREATE DATABASE IF NOT EXISTS " + DBname
            cur = con.cursor()
            try:
                cur.execute(sql)
                print("数据库%s创建成功"%DBname)
            except:
                print("已存在")
    
        #新建数据表
        def createTable(db,TableName):
            '''
            传入新的db类和表名
            :param db:
            :param TableName:
            :return:
            '''
            sql = """CREATE TABLE %s(
                         request_data  VARCHAR(3000) NOT NULL,
                         response_data  VARCHAR(3000),
                         functions VARCHAR(45),  
                         session_id INT(11) NOT NULL PRIMARY KEY AUTO_INCREMENT,
                         data DATE)"""%TableName
            # print(sql)
            cur = db.cursor()
            try:
                cur.execute(sql)
                print("数据表%s插入成功"%TableName)
            except:
                print("失败,可能%s该表已存在"%TableName)
        #插入数据
    
    
        def insertDB(DB):
            cur = DB.cursor()
            cur.execute("")
        #查询数据
    
    
        #删除数据库
        def dropDB(con,DBname):
            sql = "DROP DATABASE IF EXISTS " + DBname
            cur = con.cursor()
            try:
                cur.execute(sql)
                print("数据库%s删除成功"%DBname)
            except :
                print("已删除")
    
        #删除数据表
        def dropTable(db,TableName):
            sql = "DROP TABLE IF EXISTS " + TableName
            cur = db.cursor()
            try:
                cur.execute(sql)
                print("数据表%s删除成功"%TableName)
            except :
                print("该表已删除")
    
        #
        if __name__ == '__main__':
    
    
    
            con = connectMysql(config)
            createDB(con,"fanucdocker")
    
            dbconfig = changeConfig(config, 'fanucdocker')
            db = connectMysql(dbconfig)
    
            createTable(db,'sessionNew')
            # dropTable(db,'sessionNew')
            # dropTable(db,'session')
            # dropDB(con,"docker")
            # dropDB(con,"fanucdocker")
            # sql =
    

    这只是一部分,还有插入的部分我再修改中,所以暂时不加进来。

    第四阶段:

    为了紧急上线,因为我之前的另一种思路是利用docker去规模部署的,但是时间较短,一天还没怎么学会,师兄说得抓紧,所以就在本地数据库和vps之间要做个数据库导出导入工作。

    这里碰到一些坑:

    -------->> 我的mac默认的编码格式为utf8m64,collation模式为utf8mb4_0900_ai_ci在导出的sql或txt文件中配置也是这么写的,但在vps-ubuntu上导入时,无法识别,出现错误。

    问题解决:将导出的文件中的utf8m64替换为utf8,将utf8mb4_0900_ai_ci替换为utf8——unicode_ci。


    -------->> 另一个坑是我的mac上的mysql基本配置文件my-default.cnf不见了,所以有下载了一个,重新更名为my.cnf,并放在了etc文件夹下,网上有一个配置文件,有人下了坑,反注释可能会被反连接到,所以不敢轻易尝试这么做。我放的这个文件没问题,已经检查过了。

    # 
    
    # Example MySQL config file for medium systems. # # This is for a system with little memory (32M - 64M) where MySQL plays # an important part, or systems up to 128M where MySQL is used together with # other programs (such as a web server) # # MySQL programs look for option files in a set of # locations which depend on the deployment platform. # You can copy this option file to one of those # locations. For information about these locations, see: # http://dev.mysql.com/doc/mysql/en/option-files.html # # In this file, you can use all long options that a program supports. # If you want to know which options a program supports, run the program # with the "--help" option. # The following options will be passed to all MySQL clients [client] default-character-set=utf8 #password = your_password port = 3306 socket = /tmp/mysql.sock # Here follows entries for some specific programs # The MySQL server [mysqld] character-set-server=utf8 init_connect='SET NAMES utf8 port = 3306 socket      = /tmp/mysql.sock skip-external-locking key_buffer_size = 16M max_allowed_packet = 1M table_open_cache = 64 sort_buffer_size = 512K net_buffer_length = 8K read_buffer_size = 256K read_rnd_buffer_size = 512K myisam_sort_buffer_size = 8M character-set-server=utf8    init_connect='SET NAMES utf8' # Don't listen on a TCP/IP port at all. This can be a security enhancement, # if all processes that need to connect to mysqld run on the same host. # All interaction with mysqld must be made via Unix sockets or named pipes. # Note that using this option without enabling named pipes on Windows # (via the "enable-named-pipe" option) will render mysqld useless! # #skip-networking # Replication Master Server (default) # binary logging is required for replication log-bin=mysql-bin # binary logging format - mixed recommended binlog_format=mixed # required unique id between 1 and 2^32 - 1 # defaults to 1 if master-host is not set # but will not function as a master if omitted server-id = 1 # Replication Slave (comment out master section to use this) # # To configure this host as a replication slave, you can choose between # two methods : # # 1) Use the CHANGE MASTER TO command (fully described in our manual) - # the syntax is: # # CHANGE MASTER TO MASTER_HOST=, MASTER_PORT=, # MASTER_USER=, MASTER_PASSWORD=; # # where you replace,,by quoted strings and #by the master's port number (3306 by default). # # Example: # # CHANGE MASTER TO MASTER_HOST='125.564.12.1', MASTER_PORT=3306, # MASTER_USER='joe', MASTER_PASSWORD='secret'; # # OR # # 2) Set the variables below. However, in case you choose this method, then # start replication for the first time (even unsuccessfully, for example # if you mistyped the password in master-password and the slave fails to # connect), the slave will create a master.info file, and any later # change in this file to the variables' values below will be ignored and # overridden by the content of the master.info file, unless you shutdown # the slave server, delete master.info and restart the slaver server.      # For that reason, you may want to leave the lines below untouched # (commented) and instead use CHANGE MASTER TO (see above) # # required unique id between 2 and 2^32 - 1 # (and different from the master) # defaults to 2 if master-host is set # but will not function as a slave if omitted #server-id = 2 # # The replication master for this slave - required #master-host =# # The username the slave will use for authentication when connecting # to the master - required #master-user =# # The password the slave will authenticate with when connecting to # the master - required #master-password =# # The port the master is listening on. # optional - defaults to 3306 #master-port =
    
    # 
    
    # binary logging - not required for slaves, but recommended 
    
    #log-bin=mysql-bin 
    
    
    
      # Uncomment the following if you are using InnoDB tables 
    
      #innodb_data_home_dir = /usr/local/mysql/data 
    
      #innodb_data_file_path = ibdata1:10M:autoextend 
    
      #innodb_log_group_home_dir = /usr/local/mysql/data 
    
      # You can set .._buffer_pool_size up to 50 - 80 % 
    
      # of RAM but beware of setting memory usage too high 
    
      #innodb_buffer_pool_size = 16M 
    
      #innodb_additional_mem_pool_size = 2M 
    
      # Set .._log_file_size to 25 % of buffer pool size 
    
      #innodb_log_file_size = 5M 
    
      #innodb_log_buffer_size = 8M 
    
      #innodb_flush_log_at_trx_commit = 1 
    
      #innodb_lock_wait_timeout = 50 
    
    
    
        [mysqldump] 
    
        quick 
    
        max_allowed_packet = 16M 
    
    
    
          [mysql] 
    
          no-auto-rehash 
    
          # Remove the next comment character if you are not familiar with SQL 
    
          #safe-updates 
    
          default-character-set=utf8 
    
    
    
        [myisamchk] 
    
        key_buffer_size = 20M 
    
        sort_buffer_size = 20M 
    
        read_buffer = 2M 
    
        write_buffer = 2M 
    
    
    
          [mysqlhotcopy] 
    
          interactive-timeout
    

    '''

    第五阶段

    在上述基础之上,完成对数据的迁移,有几种方法:mysql导入、source导入和load data导入,我选择用source。
    1)在新机器上创建和原mysql一样的用户名和密码及编码

    刚装的mysql是不需要密码的,故更改即可,我们使用下边的命令

     update user set password=PASSWORD("newpassword") where user='root';
    

    创建DB并设置编码

    create database 'db';
    use 'db';
    set names utf8;
    

    最后一步,导入数据

    source path
    

    完成

    相关文章

      网友评论

        本文标题:Mysql在本项目中的一些坑和用法

        本文链接:https://www.haomeiwen.com/subject/exxjwftx.html