• 平台化后台运行环境配置


    目录

    平台化后台运行环境配置 2

    1. 平台化环境 2

    1.1硬件环境 2

    1.2软件环境 2

    2.平台服务简介 3

    2.1平台结构图 3

    2.2本次发布设计到的服务简介 3

    3.DockerDocker-compose安装 4

    3.1 docker安装 4

    3.2Docker-compose安装 6

    4. Docker下运行软件安装 7

    4.1 mysql5.7安装 7

    4.2 rabbitmq3.6安装 7

    4.3 redis:3.2安装 7

    4.4 docker 监控工具→portainer/portainer安装 30

    4.5 nexus3 docker 私服安装 32

    4.6 nginx安装(反向代理软件) 36

    4.7 ELK安装(日志收集) 38

    4.8 文件服务器go-fastdfs配置 39

    5. 自动发布系统环境搭建 40

    5.1 yum 安装git 40

    5.2 软件准备 41

    5.3Jenkins 启动和配置 41

    5.4自动发布任务配置 43

     

    平台化后台运行环境配置

    1. 平台化环境

    1.1硬件环境

    CPUIntel(R) Xeon(R) CPU E5-2620(推荐)

    硬盘:500G或者以上

    内存:16G或者以上

    1.2软件环境

    操作系统:CentOS release 7.5

    运行底层环境:docker 17.05.0-ce

    数据库服务:mysql:5.7.25

    消息服务:rabbitmq:3.6.16

    缓存服务:redis:3.2.12

    日志平台:elkElasticsearch , Logstash, Kibana

    2.平台服务简介

    2.1平台结构图

     

    2.2本次发布涉及到的服务简介

    eureka-server:注册中心服务(所有服务都注册到注册中心)

    config-server:配置中心服务(除了注册中心,其他服务都从配置中心读取配置)

    gateway-service:动态网关服务(所有的请求,都通过网关转发和过滤)

    uaa-service:鉴权服务(用户的权限和token从该服务获取)

    user-service:用户服务(用户相关的所有接口)

    diagbotman-service:产品服务(产品相关的所有接口)

    log-service:日志服务(收集用户需要的所有日志)

    3.DockerDocker-compose安装

    3.1 docker安装

    Docker的三大核心概念:镜像、容器、仓库

    镜像:类似虚拟机的镜像、用俗话说就是安装文件。

    容器:类似一个轻量级的沙箱,容器是从镜像创建应用运行实例,

    可以将其启动、开始、停止、删除、而这些容器都是相互隔离、互不可见的。

    仓库:类似代码仓库,是Docker集中存放镜像文件的场所。

    简单介绍一下在CentOS上安装Docker

    前置条件:

    64-bit 系统

    kernel 3.10+

    1).检查内核版本,返回的值大于3.10即可。

      $ uname -r

     

    2).使用 sudo root 权限的用户登入终端。

    3).确保yum是最新的

      $ yum update

    4).添加 yum 仓库

    tee /etc/yum.repos.d/docker.repo <<-'EOF'

    [dockerrepo]

    name=Docker Repository

    baseurl=https://yum.dockerproject.org/repo/main/centos/$releasever/

    enabled=1

    gpgcheck=1

    gpgkey=https://yum.dockerproject.org/gpg

    EOF

    5).安装 Docker

      $ yum install -y docker-engine

    安装成功后,使用docker version命令查看是否安装成功,安装成功后------如下图

     

     

    6).启动docker

      $systemctl start docker.service

    7).验证安装是否成功(clientservice两部分表示docker安装启动都成功了)

    使用docker version命令查看

     

    8).设置开机自启动

     $ sudo systemctl enable docker

     

     

    到此为止docker就完全安装好了。

    3.2Docker-compose安装

    1.安装python2.6

    #安装python

    yum install -y python

    2.安装pip

    #首先安装epel扩展源:

    yum -y install epel-release

    #更新完成之后,就可安装pip

    yum -y install python-pip

    #安装完成之后清除cache

    yum clean all

    #升级一下pip

    python2 -m pip install -U pip

    #如果pip install 出现问题可以试试命令

    pip install setuptools==33.1.1

    3.安装docker-compose

    #安装docker-compse

    pip install docker-compose

    4. Docker下运行软件安装

    4.1 mysql5.7安装

    #mysql5.7

    #打开镜像地址拉去镜像

    docker pull mysql:5.7

    #通过docker命令查看本地镜像

    docker images

    #启动mysql镜像

    docker run --restart=always --name mysql5.7 -p 3306:3306 -v /data/mysql/data:/var/lib/mysql -v /data/mysql/conf:/etc/mysql/conf.d -e MYSQL_ROOT_PASSWORD=XXX -d mysql:5.7

    MYSQL_ROOT_PASSWORD=XXX 自己设置密码

    4.2 rabbitmq3.6安装

    #rabbitmq

    #打开镜像地址拉去镜像

    docker pull rabbitmq:3.6-management

    #启动rabbitmq镜像

    docker run -d --restart=always --name rabbitmq -e RABBITMQ_DEFAULT_USER=XXX -e RABBITMQ_DEFAULT_PASS=XXXX -e RABBITMQ_VM_MEMORY_HIGH_WATERMARK=1024MiB -p 5672:5672 -p 15672:15672 -v /data/rabbitmq/log:/var/log/rabbitmq -v /data/rabbitmq/mnesia:/var/lib/rabbitmq/mnesia rabbitmq:3.6-management

    -e RABBITMQ_DEFAULT_USER=XXX -e RABBITMQ_DEFAULT_PASS=XXXX 用户名密码自己设置

    4.3 redis:3.2安装

    #redis

    docker pull redis:3.2

    docker run --name myredis  -p 6379:6379 -v /data/redis/conf/redis.conf:/etc/redis/redis.conf:ro -v /data/redis:/data:rw -d --restart=always redis:3.2 redis-server /etc/redis/redis.conf

    /data/redis/conf/redis.conf 配置一览

    ---------------------------------------------------------------------------------------------------------------------------------

    # Redis configuration file example

    # Note on units: when memory size is needed, it is possible to specify

    # it in the usual form of 1k 5GB 4M and so forth:

    #

    # 1k => 1000 bytes

    # 1kb => 1024 bytes

    # 1m => 1000000 bytes

    # 1mb => 1024*1024 bytes

    # 1g => 1000000000 bytes

    # 1gb => 1024*1024*1024 bytes

    #

    # units are case insensitive so 1GB 1Gb 1gB are all the same.

    ################################## INCLUDES ###################################

    # Include one or more other config files here.  This is useful if you

    # have a standard template that goes to all Redis servers but also need

    # to customize a few per-server settings.  Include files can include

    # other files, so use this wisely.

    #

    # Notice option "include" won't be rewritten by command "CONFIG REWRITE"

    # from admin or Redis Sentinel. Since Redis always uses the last processed

    # line as value of a configuration directive, you'd better put includes

    # at the beginning of this file to avoid overwriting config change at runtime.

    #

    # If instead you are interested in using includes to override configuration

    # options, it is better to use include as the last line.

    #

    # include .path olocal.conf

    # include c:path oother.conf

    ################################ GENERAL  #####################################

    # On Windows, daemonize and pidfile are not supported.

    # However, you can run redis as a Windows service, and specify a logfile.

    # The logfile will contain the pid.

    # Accept connections on the specified port, default is 6379.

    # If port 0 is specified Redis will not listen on a TCP socket.

    port 6379

    # TCP listen() backlog.

    #

    # In high requests-per-second environments you need an high backlog in order

    # to avoid slow clients connections issues. Note that the Linux kernel

    # will silently truncate it to the value of /proc/sys/net/core/somaxconn so

    # make sure to raise both the value of somaxconn and tcp_max_syn_backlog

    # in order to get the desired effect.

    tcp-backlog 511

    # By default Redis listens for connections from all the network interfaces

    # available on the server. It is possible to listen to just one or multiple

    # interfaces using the "bind" configuration directive, followed by one or

    # more IP addresses.

    #

    # Examples:

    #

    # bind 192.168.1.100 10.0.0.1

    # bind 127.0.0.1

    # Specify the path for the Unix socket that will be used to listen for

    # incoming connections. There is no default, so Redis will not listen

    # on a unix socket when not specified.

    #

    # unixsocket /tmp/redis.sock

    # unixsocketperm 700

    # Close the connection after a client is idle for N seconds (0 to disable)

    timeout 0

    # TCP keepalive.

    #

    # If non-zero, use SO_KEEPALIVE to send TCP ACKs to clients in absence

    # of communication. This is useful for two reasons:

    #

    # 1) Detect dead peers.

    # 2) Take the connection alive from the point of view of network

    #    equipment in the middle.

    #

    # On Linux, the specified value (in seconds) is the period used to send ACKs.

    # Note that to close the connection the double of the time is needed.

    # On other kernels the period depends on the kernel configuration.

    #

    # A reasonable value for this option is 60 seconds.

    tcp-keepalive 0

    # Specify the server verbosity level.

    # This can be one of:

    # debug (a lot of information, useful for development/testing)

    # verbose (many rarely useful info, but not a mess like the debug level)

    # notice (moderately verbose, what you want in production probably)

    # warning (only very important / critical messages are logged)

    loglevel notice

    # Specify the log file name. Also 'stdout' can be used to force

    # Redis to log on the standard output.

    logfile ""

    # To enable logging to the Windows EventLog, just set 'syslog-enabled' to

    # yes, and optionally update the other syslog parameters to suit your needs.

    # If Redis is installed and launched as a Windows Service, this will

    # automatically be enabled.

    # syslog-enabled no

    # Specify the source name of the events in the Windows Application log.

    # syslog-ident redis

    # Set the number of databases. The default database is DB 0, you can select

    # a different one on a per-connection basis using SELECT <dbid> where

    # dbid is a number between 0 and 'databases'-1

    databases 16

    ################################ SNAPSHOTTING  ################################

    #

    # Save the DB on disk:

    #

    #   save <seconds> <changes>

    #

    #   Will save the DB if both the given number of seconds and the given

    #   number of write operations against the DB occurred.

    #

    #   In the example below the behaviour will be to save:

    #   after 900 sec (15 min) if at least 1 key changed

    #   after 300 sec (5 min) if at least 10 keys changed

    #   after 60 sec if at least 10000 keys changed

    #

    #   Note: you can disable saving completely by commenting out all "save" lines.

    #

    #   It is also possible to remove all the previously configured save

    #   points by adding a save directive with a single empty string argument

    #   like in the following example:

    #

    #   save ""

    save 900 1

    save 300 10

    save 60 10000

    # By default Redis will stop accepting writes if RDB snapshots are enabled

    # (at least one save point) and the latest background save failed.

    # This will make the user aware (in a hard way) that data is not persisting

    # on disk properly, otherwise chances are that no one will notice and some

    # disaster will happen.

    #

    # If the background saving process will start working again Redis will

    # automatically allow writes again.

    #

    # However if you have setup your proper monitoring of the Redis server

    # and persistence, you may want to disable this feature so that Redis will

    # continue to work as usual even if there are problems with disk,

    # permissions, and so forth.

    stop-writes-on-bgsave-error yes

    # Compress string objects using LZF when dump .rdb databases?

    # For default that's set to 'yes' as it's almost always a win.

    # If you want to save some CPU in the saving child set it to 'no' but

    # the dataset will likely be bigger if you have compressible values or keys.

    rdbcompression yes

    # Since version 5 of RDB a CRC64 checksum is placed at the end of the file.

    # This makes the format more resistant to corruption but there is a performance

    # hit to pay (around 10%) when saving and loading RDB files, so you can disable it

    # for maximum performances.

    #

    # RDB files created with checksum disabled have a checksum of zero that will

    # tell the loading code to skip the check.

    rdbchecksum yes

    # The filename where to dump the DB

    dbfilename dump.rdb

    # The working directory.

    #

    # The DB will be written inside this directory, with the filename specified

    # above using the 'dbfilename' configuration directive.

    #

    # The Append Only File will also be created inside this directory.

    #

    # Note that you must specify a directory here, not a file name.

    dir ./

    ################################# REPLICATION #################################

    # Master-Slave replication. Use slaveof to make a Redis instance a copy of

    # another Redis server. A few things to understand ASAP about Redis replication.

    #

    # 1) Redis replication is asynchronous, but you can configure a master to

    #    stop accepting writes if it appears to be not connected with at least

    #    a given number of slaves.

    # 2) Redis slaves are able to perform a partial resynchronization with the

    #    master if the replication link is lost for a relatively small amount of

    #    time. You may want to configure the replication backlog size (see the next

    #    sections of this file) with a sensible value depending on your needs.

    # 3) Replication is automatic and does not need user intervention. After a

    #    network partition slaves automatically try to reconnect to masters

    #    and resynchronize with them.

    #

    # slaveof <masterip> <masterport>

    # If the master is password protected (using the "requirepass" configuration

    # directive below) it is possible to tell the slave to authenticate before

    # starting the replication synchronization process, otherwise the master will

    # refuse the slave request.

    #

    # masterauth <master-password>

    # When a slave loses its connection with the master, or when the replication

    # is still in progress, the slave can act in two different ways:

    #

    # 1) if slave-serve-stale-data is set to 'yes' (the default) the slave will

    #    still reply to client requests, possibly with out of date data, or the

    #    data set may just be empty if this is the first synchronization.

    #

    # 2) if slave-serve-stale-data is set to 'no' the slave will reply with

    #    an error "SYNC with master in progress" to all the kind of commands

    #    but to INFO and SLAVEOF.

    #

    slave-serve-stale-data yes

    # You can configure a slave instance to accept writes or not. Writing against

    # a slave instance may be useful to store some ephemeral data (because data

    # written on a slave will be easily deleted after resync with the master) but

    # may also cause problems if clients are writing to it because of a

    # misconfiguration.

    #

    # Since Redis 2.6 by default slaves are read-only.

    #

    # Note: read only slaves are not designed to be exposed to untrusted clients

    # on the internet. It's just a protection layer against misuse of the instance.

    # Still a read only slave exports by default all the administrative commands

    # such as CONFIG, DEBUG, and so forth. To a limited extent you can improve

    # security of read only slaves using 'rename-command' to shadow all the

    # administrative / dangerous commands.

    slave-read-only yes

    # Replication SYNC strategy: disk or socket.

    #

    # -------------------------------------------------------

    # WARNING: DISKLESS REPLICATION IS EXPERIMENTAL CURRENTLY

    # -------------------------------------------------------

    #

    # New slaves and reconnecting slaves that are not able to continue the replication

    # process just receiving differences, need to do what is called a "full

    # synchronization". An RDB file is transmitted from the master to the slaves.

    # The transmission can happen in two different ways:

    #

    # 1) Disk-backed: The Redis master creates a new process that writes the RDB

    #                 file on disk. Later the file is transferred by the parent

    #                 process to the slaves incrementally.

    # 2) Diskless: The Redis master creates a new process that directly writes the

    #              RDB file to slave sockets, without touching the disk at all.

    #

    # With disk-backed replication, while the RDB file is generated, more slaves

    # can be queued and served with the RDB file as soon as the current child producing

    # the RDB file finishes its work. With diskless replication instead once

    # the transfer starts, new slaves arriving will be queued and a new transfer

    # will start when the current one terminates.

    #

    # When diskless replication is used, the master waits a configurable amount of

    # time (in seconds) before starting the transfer in the hope that multiple slaves

    # will arrive and the transfer can be parallelized.

    #

    # With slow disks and fast (large bandwidth) networks, diskless replication

    # works better.

    repl-diskless-sync no

    # When diskless replication is enabled, it is possible to configure the delay

    # the server waits in order to spawn the child that trnasfers the RDB via socket

    # to the slaves.

    #

    # This is important since once the transfer starts, it is not possible to serve

    # new slaves arriving, that will be queued for the next RDB transfer, so the server

    # waits a delay in order to let more slaves arrive.

    #

    # The delay is specified in seconds, and by default is 5 seconds. To disable

    # it entirely just set it to 0 seconds and the transfer will start ASAP.

    repl-diskless-sync-delay 5

    # Slaves send PINGs to server in a predefined interval. It's possible to change

    # this interval with the repl_ping_slave_period option. The default value is 10

    # seconds.

    #

    # repl-ping-slave-period 10

    # The following option sets the replication timeout for:

    #

    # 1) Bulk transfer I/O during SYNC, from the point of view of slave.

    # 2) Master timeout from the point of view of slaves (data, pings).

    # 3) Slave timeout from the point of view of masters (REPLCONF ACK pings).

    #

    # It is important to make sure that this value is greater than the value

    # specified for repl-ping-slave-period otherwise a timeout will be detected

    # every time there is low traffic between the master and the slave.

    #

    # repl-timeout 60

    # Disable TCP_NODELAY on the slave socket after SYNC?

    #

    # If you select "yes" Redis will use a smaller number of TCP packets and

    # less bandwidth to send data to slaves. But this can add a delay for

    # the data to appear on the slave side, up to 40 milliseconds with

    # Linux kernels using a default configuration.

    #

    # If you select "no" the delay for data to appear on the slave side will

    # be reduced but more bandwidth will be used for replication.

    #

    # By default we optimize for low latency, but in very high traffic conditions

    # or when the master and slaves are many hops away, turning this to "yes" may

    # be a good idea.

    repl-disable-tcp-nodelay no

    # Set the replication backlog size. The backlog is a buffer that accumulates

    # slave data when slaves are disconnected for some time, so that when a slave

    # wants to reconnect again, often a full resync is not needed, but a partial

    # resync is enough, just passing the portion of data the slave missed while

    # disconnected.

    #

    # The bigger the replication backlog, the longer the time the slave can be

    # disconnected and later be able to perform a partial resynchronization.

    #

    # The backlog is only allocated once there is at least a slave connected.

    #

    # repl-backlog-size 1mb

    # After a master has no longer connected slaves for some time, the backlog

    # will be freed. The following option configures the amount of seconds that

    # need to elapse, starting from the time the last slave disconnected, for

    # the backlog buffer to be freed.

    #

    # A value of 0 means to never release the backlog.

    #

    # repl-backlog-ttl 3600

    # The slave priority is an integer number published by Redis in the INFO output.

    # It is used by Redis Sentinel in order to select a slave to promote into a

    # master if the master is no longer working correctly.

    #

    # A slave with a low priority number is considered better for promotion, so

    # for instance if there are three slaves with priority 10, 100, 25 Sentinel will

    # pick the one with priority 10, that is the lowest.

    #

    # However a special priority of 0 marks the slave as not able to perform the

    # role of master, so a slave with priority of 0 will never be selected by

    # Redis Sentinel for promotion.

    #

    # By default the priority is 100.

    slave-priority 100

    # It is possible for a master to stop accepting writes if there are less than

    # N slaves connected, having a lag less or equal than M seconds.

    #

    # The N slaves need to be in "online" state.

    #

    # The lag in seconds, that must be <= the specified value, is calculated from

    # the last ping received from the slave, that is usually sent every second.

    #

    # This option does not GUARANTEE that N replicas will accept the write, but

    # will limit the window of exposure for lost writes in case not enough slaves

    # are available, to the specified number of seconds.

    #

    # For example to require at least 3 slaves with a lag <= 10 seconds use:

    #

    # min-slaves-to-write 3

    # min-slaves-max-lag 10

    #

    # Setting one or the other to 0 disables the feature.

    #

    # By default min-slaves-to-write is set to 0 (feature disabled) and

    # min-slaves-max-lag is set to 10.

    ################################## SECURITY ###################################

    # Require clients to issue AUTH <PASSWORD> before processing any other

    # commands.  This might be useful in environments in which you do not trust

    # others with access to the host running redis-server.

    #

    # This should stay commented out for backward compatibility and because most

    # people do not need auth (e.g. they run their own servers).

    #

    # Warning: since Redis is pretty fast an outside user can try up to

    # 150k passwords per second against a good box. This means that you should

    # use a very strong password otherwise it will be very easy to break.

    #

    # requirepass foobared

    requirepass lantone

    # Command renaming.

    #

    # It is possible to change the name of dangerous commands in a shared

    # environment. For instance the CONFIG command may be renamed into something

    # hard to guess so that it will still be available for internal-use tools

    # but not available for general clients.

    #

    # Example:

    #

    # rename-command CONFIG b840fc02d524045429941cc15f59e41cb7be6c52

    #

    # It is also possible to completely kill a command by renaming it into

    # an empty string:

    #

    # rename-command CONFIG ""

    #

    # Please note that changing the name of commands that are logged into the

    # AOF file or transmitted to slaves may cause problems.

    ################################### LIMITS ####################################

    # Set the max number of connected clients at the same time. By default

    # this limit is set to 10000 clients, however if the Redis server is not

    # able to configure the process file limit to allow for the specified limit

    # the max number of allowed clients is set to the current file limit

    # minus 32 (as Redis reserves a few file descriptors for internal uses).

    #

    # Once the limit is reached Redis will close all the new connections sending

    # an error 'max number of clients reached'.

    #

    # maxclients 10000

    # If Redis is to be used as an in-memory-only cache without any kind of

    # persistence, then the fork() mechanism used by the background AOF/RDB

    # persistence is unnecessary. As an optimization, all persistence can be

    # turned off in the Windows version of Redis. This will redirect heap

    # allocations to the system heap allocator, and disable commands that would

    # otherwise cause fork() operations: BGSAVE and BGREWRITEAOF.

    # This flag may not be combined with any of the other flags that configure

    # AOF and RDB operations.

    # persistence-available [(yes)|no]

    # Don't use more memory than the specified amount of bytes.

    # When the memory limit is reached Redis will try to remove keys

    # according to the eviction policy selected (see maxmemory-policy).

    #

    # If Redis can't remove keys according to the policy, or if the policy is

    # set to 'noeviction', Redis will start to reply with errors to commands

    # that would use more memory, like SET, LPUSH, and so on, and will continue

    # to reply to read-only commands like GET.

    #

    # This option is usually useful when using Redis as an LRU cache, or to set

    # a hard memory limit for an instance (using the 'noeviction' policy).

    #

    # WARNING: If you have slaves attached to an instance with maxmemory on,

    # the size of the output buffers needed to feed the slaves are subtracted

    # from the used memory count, so that network problems / resyncs will

    # not trigger a loop where keys are evicted, and in turn the output

    # buffer of slaves is full with DELs of keys evicted triggering the deletion

    # of more keys, and so forth until the database is completely emptied.

    #

    # In short... if you have slaves attached it is suggested that you set a lower

    # limit for maxmemory so that there is some free RAM on the system for slave

    # output buffers (but this is not needed if the policy is 'noeviction').

    #

    # WARNING: not setting maxmemory will cause Redis to terminate with an

    # out-of-memory exception if the heap limit is reached.

    #

    # NOTE: since Redis uses the system paging file to allocate the heap memory,

    # the Working Set memory usage showed by the Windows Task Manager or by other

    # tools such as ProcessExplorer will not always be accurate. For example, right

    # after a background save of the RDB or the AOF files, the working set value

    # may drop significantly. In order to check the correct amount of memory used

    # by the redis-server to store the data, use the INFO client command. The INFO

    # command shows only the memory used to store the redis data, not the extra

    # memory used by the Windows process for its own requirements. Th3 extra amount

    # of memory not reported by the INFO command can be calculated subtracting the

    # Peak Working Set reported by the Windows Task Manager and the used_memory_peak

    # reported by the INFO command.

    #

    # maxmemory <bytes>

    # MAXMEMORY POLICY: how Redis will select what to remove when maxmemory

    # is reached. You can select among five behaviors:

    #

    # volatile-lru -> remove the key with an expire set using an LRU algorithm

    # allkeys-lru -> remove any key according to the LRU algorithm

    # volatile-random -> remove a random key with an expire set

    # allkeys-random -> remove a random key, any key

    # volatile-ttl -> remove the key with the nearest expire time (minor TTL)

    # noeviction -> don't expire at all, just return an error on write operations

    #

    # Note: with any of the above policies, Redis will return an error on write

    #       operations, when there are no suitable keys for eviction.

    #

    #       At the date of writing these commands are: set setnx setex append

    #       incr decr rpush lpush rpushx lpushx linsert lset rpoplpush sadd

    #       sinter sinterstore sunion sunionstore sdiff sdiffstore zadd zincrby

    #       zunionstore zinterstore hset hsetnx hmset hincrby incrby decrby

    #       getset mset msetnx exec sort

    #

    # The default is:

    #

    # maxmemory-policy volatile-lru

    # LRU and minimal TTL algorithms are not precise algorithms but approximated

    # algorithms (in order to save memory), so you can select as well the sample

    # size to check. For instance for default Redis will check three keys and

    # pick the one that was used less recently, you can change the sample size

    # using the following configuration directive.

    #

    # maxmemory-samples 3

    ############################## APPEND ONLY MODE ###############################

    # By default Redis asynchronously dumps the dataset on disk. This mode is

    # good enough in many applications, but an issue with the Redis process or

    # a power outage may result into a few minutes of writes lost (depending on

    # the configured save points).

    #

    # The Append Only File is an alternative persistence mode that provides

    # much better durability. For instance using the default data fsync policy

    # (see later in the config file) Redis can lose just one second of writes in a

    # dramatic event like a server power outage, or a single write if something

    # wrong with the Redis process itself happens, but the operating system is

    # still running correctly.

    #

    # AOF and RDB persistence can be enabled at the same time without problems.

    # If the AOF is enabled on startup Redis will load the AOF, that is the file

    # with the better durability guarantees.

    #

    # Please check http://redis.io/topics/persistence for more information.

    appendonly no

    # The name of the append only file (default: "appendonly.aof")

    appendfilename "appendonly.aof"

    # The fsync() call tells the Operating System to actually write data on disk

    # instead of waiting for more data in the output buffer. Some OS will really flush

    # data on disk, some other OS will just try to do it ASAP.

    #

    # Redis supports three different modes:

    #

    # no: don't fsync, just let the OS flush the data when it wants. Faster.

    # always: fsync after every write to the append only log . Slow, Safest.

    # everysec: fsync only one time every second. Compromise.

    #

    # The default is "everysec", as that's usually the right compromise between

    # speed and data safety. It's up to you to understand if you can relax this to

    # "no" that will let the operating system flush the output buffer when

    # it wants, for better performances (but if you can live with the idea of

    # some data loss consider the default persistence mode that's snapshotting),

    # or on the contrary, use "always" that's very slow but a bit safer than

    # everysec.

    #

    # More details please check the following article:

    # http://antirez.com/post/redis-persistence-demystified.html

    #

    # If unsure, use "everysec".

    # appendfsync always

    appendfsync everysec

    # appendfsync no

    # When the AOF fsync policy is set to always or everysec, and a background

    # saving process (a background save or AOF log background rewriting) is

    # performing a lot of I/O against the disk, in some Linux configurations

    # Redis may block too long on the fsync() call. Note that there is no fix for

    # this currently, as even performing fsync in a different thread will block

    # our synchronous write(2) call.

    #

    # In order to mitigate this problem it's possible to use the following option

    # that will prevent fsync() from being called in the main process while a

    # BGSAVE or BGREWRITEAOF is in progress.

    #

    # This means that while another child is saving, the durability of Redis is

    # the same as "appendfsync none". In practical terms, this means that it is

    # possible to lose up to 30 seconds of log in the worst scenario (with the

    # default Linux settings).

    #

    # If you have latency problems turn this to "yes". Otherwise leave it as

    # "no" that is the safest pick from the point of view of durability.

    no-appendfsync-on-rewrite no

    # Automatic rewrite of the append only file.

    # Redis is able to automatically rewrite the log file implicitly calling

    # BGREWRITEAOF when the AOF log size grows by the specified percentage.

    #

    # This is how it works: Redis remembers the size of the AOF file after the

    # latest rewrite (if no rewrite has happened since the restart, the size of

    # the AOF at startup is used).

    #

    # This base size is compared to the current size. If the current size is

    # bigger than the specified percentage, the rewrite is triggered. Also

    # you need to specify a minimal size for the AOF file to be rewritten, this

    # is useful to avoid rewriting the AOF file even if the percentage increase

    # is reached but it is still pretty small.

    #

    # Specify a percentage of zero in order to disable the automatic AOF

    # rewrite feature.

    auto-aof-rewrite-percentage 100

    auto-aof-rewrite-min-size 64mb

    # An AOF file may be found to be truncated at the end during the Redis

    # startup process, when the AOF data gets loaded back into memory.

    # This may happen when the system where Redis is running

    # crashes, especially when an ext4 filesystem is mounted without the

    # data=ordered option (however this can't happen when Redis itself

    # crashes or aborts but the operating system still works correctly).

    #

    # Redis can either exit with an error when this happens, or load as much

    # data as possible (the default now) and start if the AOF file is found

    # to be truncated at the end. The following option controls this behavior.

    #

    # If aof-load-truncated is set to yes, a truncated AOF file is loaded and

    # the Redis server starts emitting a log to inform the user of the event.

    # Otherwise if the option is set to no, the server aborts with an error

    # and refuses to start. When the option is set to no, the user requires

    # to fix the AOF file using the "redis-check-aof" utility before to restart

    # the server.

    #

    # Note that if the AOF file will be found to be corrupted in the middle

    # the server will still exit with an error. This option only applies when

    # Redis will try to read more data from the AOF file but not enough bytes

    # will be found.

    aof-load-truncated yes

    ################################ LUA SCRIPTING  ###############################

    # Max execution time of a Lua script in milliseconds.

    #

    # If the maximum execution time is reached Redis will log that a script is

    # still in execution after the maximum allowed time and will start to

    # reply to queries with an error.

    #

    # When a long running script exceeds the maximum execution time only the

    # SCRIPT KILL and SHUTDOWN NOSAVE commands are available. The first can be

    # used to stop a script that did not yet called write commands. The second

    # is the only way to shut down the server in the case a write command was

    # already issued by the script but the user doesn't want to wait for the natural

    # termination of the script.

    #

    # Set it to 0 or a negative value for unlimited execution without warnings.

    lua-time-limit 5000

    ################################ REDIS CLUSTER  ###############################

    #

    # ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

    # WARNING EXPERIMENTAL: Redis Cluster is considered to be stable code, however

    # in order to mark it as "mature" we need to wait for a non trivial percentage

    # of users to deploy it in production.

    # ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

    #

    # Normal Redis instances can't be part of a Redis Cluster; only nodes that are

    # started as cluster nodes can. In order to start a Redis instance as a

    # cluster node enable the cluster support uncommenting the following:

    #

    # cluster-enabled yes

    # Every cluster node has a cluster configuration file. This file is not

    # intended to be edited by hand. It is created and updated by Redis nodes.

    # Every Redis Cluster node requires a different cluster configuration file.

    # Make sure that instances running in the same system do not have

    # overlapping cluster configuration file names.

    #

    # cluster-config-file nodes-6379.conf

    # Cluster node timeout is the amount of milliseconds a node must be unreachable

    # for it to be considered in failure state.

    # Most other internal time limits are multiple of the node timeout.

    #

    # cluster-node-timeout 15000

    # A slave of a failing master will avoid to start a failover if its data

    # looks too old.

    #

    # There is no simple way for a slave to actually have a exact measure of

    # its "data age", so the following two checks are performed:

    #

    # 1) If there are multiple slaves able to failover, they exchange messages

    #    in order to try to give an advantage to the slave with the best

    #    replication offset (more data from the master processed).

    #    Slaves will try to get their rank by offset, and apply to the start

    #    of the failover a delay proportional to their rank.

    #

    # 2) Every single slave computes the time of the last interaction with

    #    its master. This can be the last ping or command received (if the master

    #    is still in the "connected" state), or the time that elapsed since the

    #    disconnection with the master (if the replication link is currently down).

    #    If the last interaction is too old, the slave will not try to failover

    #    at all.

    #

    # The point "2" can be tuned by user. Specifically a slave will not perform

    # the failover if, since the last interaction with the master, the time

    # elapsed is greater than:

    #

    #   (node-timeout * slave-validity-factor) + repl-ping-slave-period

    #

    # So for example if node-timeout is 30 seconds, and the slave-validity-factor

    # is 10, and assuming a default repl-ping-slave-period of 10 seconds, the

    # slave will not try to failover if it was not able to talk with the master

    # for longer than 310 seconds.

    #

    # A large slave-validity-factor may allow slaves with too old data to failover

    # a master, while a too small value may prevent the cluster from being able to

    # elect a slave at all.

    #

    # For maximum availability, it is possible to set the slave-validity-factor

    # to a value of 0, which means, that slaves will always try to failover the

    # master regardless of the last time they interacted with the master.

    # (However they'll always try to apply a delay proportional to their

    # offset rank).

    #

    # Zero is the only value able to guarantee that when all the partitions heal

    # the cluster will always be able to continue.

    #

    # cluster-slave-validity-factor 10

    # Cluster slaves are able to migrate to orphaned masters, that are masters

    # that are left without working slaves. This improves the cluster ability

    # to resist to failures as otherwise an orphaned master can't be failed over

    # in case of failure if it has no working slaves.

    #

    # Slaves migrate to orphaned masters only if there are still at least a

    # given number of other working slaves for their old master. This number

    # is the "migration barrier". A migration barrier of 1 means that a slave

    # will migrate only if there is at least 1 other working slave for its master

    # and so forth. It usually reflects the number of slaves you want for every

    # master in your cluster.

    #

    # Default is 1 (slaves migrate only if their masters remain with at least

    # one slave). To disable migration just set it to a very large value.

    # A value of 0 can be set but is useful only for debugging and dangerous

    # in production.

    #

    # cluster-migration-barrier 1

    # By default Redis Cluster nodes stop accepting queries if they detect there

    # is at least an hash slot uncovered (no available node is serving it).

    # This way if the cluster is partially down (for example a range of hash slots

    # are no longer covered) all the cluster becomes, eventually, unavailable.

    # It automatically returns available as soon as all the slots are covered again.

    #

    # However sometimes you want the subset of the cluster which is working,

    # to continue to accept queries for the part of the key space that is still

    # covered. In order to do so, just set the cluster-require-full-coverage

    # option to no.

    #

    # cluster-require-full-coverage yes

    # In order to setup your cluster make sure to read the documentation

    # available at http://redis.io web site.

    ################################## SLOW LOG ###################################

    # The Redis Slow Log is a system to log queries that exceeded a specified

    # execution time. The execution time does not include the I/O operations

    # like talking with the client, sending the reply and so forth,

    # but just the time needed to actually execute the command (this is the only

    # stage of command execution where the thread is blocked and can not serve

    # other requests in the meantime).

    #

    # You can configure the slow log with two parameters: one tells Redis

    # what is the execution time, in microseconds, to exceed in order for the

    # command to get logged, and the other parameter is the length of the

    # slow log. When a new command is logged the oldest one is removed from the

    # queue of logged commands.

    # The following time is expressed in microseconds, so 1000000 is equivalent

    # to one second. Note that a negative number disables the slow log, while

    # a value of zero forces the logging of every command.

    slowlog-log-slower-than 10000

    # There is no limit to this length. Just be aware that it will consume memory.

    # You can reclaim memory used by the slow log with SLOWLOG RESET.

    slowlog-max-len 128

    ################################ LATENCY MONITOR ##############################

    # The Redis latency monitoring subsystem samples different operations

    # at runtime in order to collect data related to possible sources of

    # latency of a Redis instance.

    #

    # Via the LATENCY command this information is available to the user that can

    # print graphs and obtain reports.

    #

    # The system only logs operations that were performed in a time equal or

    # greater than the amount of milliseconds specified via the

    # latency-monitor-threshold configuration directive. When its value is set

    # to zero, the latency monitor is turned off.

    #

    # By default latency monitoring is disabled since it is mostly not needed

    # if you don't have latency issues, and collecting data has a performance

    # impact, that while very small, can be measured under big load. Latency

    # monitoring can easily be enalbed at runtime using the command

    # "CONFIG SET latency-monitor-threshold <milliseconds>" if needed.

    latency-monitor-threshold 0

    ############################# Event notification ##############################

    # Redis can notify Pub/Sub clients about events happening in the key space.

    # This feature is documented at http://redis.io/topics/notifications

    #

    # For instance if keyspace events notification is enabled, and a client

    # performs a DEL operation on key "foo" stored in the Database 0, two

    # messages will be published via Pub/Sub:

    #

    # PUBLISH __keyspace@0__:foo del

    # PUBLISH __keyevent@0__:del foo

    #

    # It is possible to select the events that Redis will notify among a set

    # of classes. Every class is identified by a single character:

    #

    #  K     Keyspace events, published with __keyspace@<db>__ prefix.

    #  E     Keyevent events, published with __keyevent@<db>__ prefix.

    #  g     Generic commands (non-type specific) like DEL, EXPIRE, RENAME, ...

    #  $     String commands

    #  l     List commands

    #  s     Set commands

    #  h     Hash commands

    #  z     Sorted set commands

    #  x     Expired events (events generated every time a key expires)

    #  e     Evicted events (events generated when a key is evicted for maxmemory)

    #  A     Alias for g$lshzxe, so that the "AKE" string means all the events.

    #

    #  The "notify-keyspace-events" takes as argument a string that is composed

    #  of zero or multiple characters. The empty string means that notifications

    #  are disabled.

    #

    #  Example: to enable list and generic events, from the point of view of the

    #           event name, use:

    #

    #  notify-keyspace-events Elg

    #

    #  Example 2: to get the stream of the expired keys subscribing to channel

    #             name __keyevent@0__:expired use:

    #

    #  notify-keyspace-events Ex

    #

    #  By default all notifications are disabled because most users don't need

    #  this feature and the feature has some overhead. Note that if you don't

    #  specify at least one of K or E, no events will be delivered.

    notify-keyspace-events ""

    ############################### ADVANCED CONFIG ###############################

    # Hashes are encoded using a memory efficient data structure when they have a

    # small number of entries, and the biggest entry does not exceed a given

    # threshold. These thresholds can be configured using the following directives.

    hash-max-ziplist-entries 512

    hash-max-ziplist-value 64

    # Similarly to hashes, small lists are also encoded in a special way in order

    # to save a lot of space. The special representation is only used when

    # you are under the following limits:

    list-max-ziplist-entries 512

    list-max-ziplist-value 64

    # Sets have a special encoding in just one case: when a set is composed

    # of just strings that happen to be integers in radix 10 in the range

    # of 64 bit signed integers.

    # The following configuration setting sets the limit in the size of the

    # set in order to use this special memory saving encoding.

    set-max-intset-entries 512

    # Similarly to hashes and lists, sorted sets are also specially encoded in

    # order to save a lot of space. This encoding is only used when the length and

    # elements of a sorted set are below the following limits:

    zset-max-ziplist-entries 128

    zset-max-ziplist-value 64

    # HyperLogLog sparse representation bytes limit. The limit includes the

    # 16 bytes header. When an HyperLogLog using the sparse representation crosses

    # this limit, it is converted into the dense representation.

    #

    # A value greater than 16000 is totally useless, since at that point the

    # dense representation is more memory efficient.

    #

    # The suggested value is ~ 3000 in order to have the benefits of

    # the space efficient encoding without slowing down too much PFADD,

    # which is O(N) with the sparse encoding. The value can be raised to

    # ~ 10000 when CPU is not a concern, but space is, and the data set is

    # composed of many HyperLogLogs with cardinality in the 0 - 15000 range.

    hll-sparse-max-bytes 3000

    # Active rehashing uses 1 millisecond every 100 milliseconds of CPU time in

    # order to help rehashing the main Redis hash table (the one mapping top-level

    # keys to values). The hash table implementation Redis uses (see dict.c)

    # performs a lazy rehashing: the more operation you run into a hash table

    # that is rehashing, the more rehashing "steps" are performed, so if the

    # server is idle the rehashing is never complete and some more memory is used

    # by the hash table.

    #

    # The default is to use this millisecond 10 times every second in order to

    # actively rehash the main dictionaries, freeing memory when possible.

    #

    # If unsure:

    # use "activerehashing no" if you have hard latency requirements and it is

    # not a good thing in your environment that Redis can reply from time to time

    # to queries with 2 milliseconds delay.

    #

    # use "activerehashing yes" if you don't have such hard requirements but

    # want to free memory asap when possible.

    activerehashing yes

    # The client output buffer limits can be used to force disconnection of clients

    # that are not reading data from the server fast enough for some reason (a

    # common reason is that a Pub/Sub client can't consume messages as fast as the

    # publisher can produce them).

    #

    # The limit can be set differently for the three different classes of clients:

    #

    # normal -> normal clients including MONITOR clients

    # slave  -> slave clients

    # pubsub -> clients subscribed to at least one pubsub channel or pattern

    #

    # The syntax of every client-output-buffer-limit directive is the following:

    #

    # client-output-buffer-limit <class> <hard limit> <soft limit> <soft seconds>

    #

    # A client is immediately disconnected once the hard limit is reached, or if

    # the soft limit is reached and remains reached for the specified number of

    # seconds (continuously).

    # So for instance if the hard limit is 32 megabytes and the soft limit is

    # 16 megabytes / 10 seconds, the client will get disconnected immediately

    # if the size of the output buffers reach 32 megabytes, but will also get

    # disconnected if the client reaches 16 megabytes and continuously overcomes

    # the limit for 10 seconds.

    #

    # By default normal clients are not limited because they don't receive data

    # without asking (in a push way), but just after a request, so only

    # asynchronous clients may create a scenario where data is requested faster

    # than it can read.

    #

    # Instead there is a default limit for pubsub and slave clients, since

    # subscribers and slaves receive data in a push fashion.

    #

    # Both the hard or the soft limit can be disabled by setting them to zero.

    client-output-buffer-limit normal 0 0 0

    client-output-buffer-limit slave 256mb 64mb 60

    client-output-buffer-limit pubsub 32mb 8mb 60

    # Redis calls an internal function to perform many background tasks, like

    # closing connections of clients in timeot, purging expired keys that are

    # never requested, and so forth.

    #

    # Not all tasks are perforemd with the same frequency, but Redis checks for

    # tasks to perform according to the specified "hz" value.

    #

    # By default "hz" is set to 10. Raising the value will use more CPU when

    # Redis is idle, but at the same time will make Redis more responsive when

    # there are many keys expiring at the same time, and timeouts may be

    # handled with more precision.

    #

    # The range is between 1 and 500, however a value over 100 is usually not

    # a good idea. Most users should use the default of 10 and raise this up to

    # 100 only in environments where very low latency is required.

    hz 10

    # When a child rewrites the AOF file, if the following option is enabled

    # the file will be fsync-ed every 32 MB of data generated. This is useful

    # in order to commit the file to the disk more incrementally and avoid

    # big latency spikes.

    aof-rewrite-incremental-fsync yes

    ################################## INCLUDES ###################################

    # Include one or more other config files here.  This is useful if you

    # have a standard template that goes to all Redis server but also need

    # to customize a few per-server settings.  Include files can include

    # other files, so use this wisely.

    #

    # include /path/to/local.conf

    # include /path/to/other.conf

    4.4 docker 监控工具→portainer/portainer安装

    #docker 监控工具→portainer/portainer

    #下载官方镜像

    docker pull portainer/portainer

    #运行容器

    docker run -d  --restart=always -p 9000:9000 -v /var/run/docker.sock:/var/run/docker.sock -v /data/portainer_data:/data portainer/portainer

    ·访问方式:http://IP:9000 ,首次登录需要注册用户,给用户admin设置密码

    ·单机版本选择“Local",点击Connect即可连接到本地docker,如下图:

     

    注意:从上图可以看出,有提示需要挂载本地 /var/run/docker.socker与容器内的/var/run/docker.socker连接。因此,在启动时必须指定该挂载文件。

    进入后可以对容器、镜像、网络、数据卷等进行管理,如下图:

     

    4.5 nexus3 docker 私服安装

    使用容器安装Nexus3

    1.下载nexus3的镜像:

    docker pull sonatype/nexus3

    2.使用镜像启动一个容器:

    docker run -d --name nexus  --restart=always -p 5000:5000 -p 8081:8081 sonatype/nexus3

    注:5000端口是用于镜像仓库的服务端口   8081 端口是nexus的服务端口

    3.启动之后我们就可以通过http://服务器IP:8081访问。

    默认账号密码为admin/admin123

     

    创建Docker私有仓库

    通过浏览器访问Nexus 
    http://服务器IP:8081

    点击右上角进行登录,通过初始用户名和密码进行登录(admin/admin123):

     

     

    点击设置界面,选择Repositories,点击Create repository,如下图所示: 

     

     

    选择仓库类型,这里Docker有三种类型,分别是grouphostedproxy。这里只演示hosted类型,所以选择docker(hosted),如下图: 

     

    注:Docker镜像仓库类型含义解释如下:
      hosted : 本地存储,即同docker官方仓库一样提供本地私服功能

      proxy : 提供代理其他仓库的类型,如docker中央仓库

      group : 组类型,实质作用是组合多个仓库为一个地址

    指定docker仓库的名称、指定一个端口用来通过http的方式进行访问仓库、勾选是否支持docker API V1,然后create repository

    因为我们测试的时候不是使用加密的HTTPS进行访问,所以这里需要增加一个docker的启动参数,给他指定私库的地址,如下:

    编辑/etc/docker/daemon.json 增加如下内容,当然也可通过启动参数增加

    {

       "insecure-registries":["http://172.17.9.81:5000"]

    }

    重启docker进程: systemctl restart docker

    查看docker信息: docker info ,有如下输出即正常

     

    登录私库

    要使用私库进行上传下载需要进行登录连接到Nexus

      docker login http://172.17.9.81:5000/repository/docker-assoft/

    Docker上传镜像到私库

    使用docker tag 对镜像进行管理(必须进行此项操作)

      docker tag使用格式:

        docker tag SOURCE_IMAGE[:TAG]  TARGET_IMAGE[:TAG]

      docker tag portainer-temlates-new:latest 172.17.9.81:5000/portainer-templates:v1

      docker push 172.17.9.81:5000/portainer-templates:v1

    图例:使用tag进行打标,正常上传的结果

     

    图例:不进行tag打标,会出现denied: requested access to the resource is denied报错

     

     

    上传完成后,在nexus中对应的docker库中,即可看到此镜像

     

     

    下载私库中的镜像

    1、删除本地上例实验中的镜像(docker rmi 172.17.9.81:5000/portainer-templates:v1)

     

    2docker pull 172.17.9.81:5000/portainer-templates:v1

     

    4.6 nginx安装(反向代理软件)

    docker pull nginx

    docker run -d  --restart=always  --name myNginx  -p 80:80   -v /data/myNginx/html:/usr/share/nginx/html:rw -v /data/myNginx/nginx.conf:/etc/nginx/nginx.conf -v /data/myNginx/conf.d/default.conf:/etc/nginx/conf.d/default.conf -v /data/myNginx/logs:/var/log/nginx/:rw nginx

    配置文件

    /data/myNginx/conf.d/default.conf

    文件内容设置为空

    /data/myNginx/nginx.conf

    文件内容如下:

    ---------------------------------------------------------------------------------------------------------------------------------

    #运行nginx的用户

    #user  nginx;

    #启动进程设置成和CPU数量相等

    worker_processes  1;

    #全局错误日志及PID文件的位置

    #error_log  /var/log/nginx/error.log warn;

    #pid        /var/run/nginx.pid;

    #工作模式及连接数上限

    events {

        #单个后台work进程最大并发数设置为1024

        worker_connections  1024;

    }

    http {

        #设定mime类型

        include       mime.types;

        default_type  application/octet-stream;

        #设定日志格式

        log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '

                          '$status $body_bytes_sent "$http_referer" '

                          '"$http_user_agent" "$http_x_forwarded_for"';

        access_log  /var/log/nginx/access.log  main;

        sendfile        on;

        #tcp_nopush     on;

        #设置连接超时的事件

    keepalive_timeout  65;

    client_max_body_size 50m;

        #开启GZIP压缩

        #gzip  on;

    upstream diagbotgateway {

          server 192.168.2.236:5050;

    }

    server {

    listen    80;       #侦听80端口,如果强制所有的访问都必须是HTTPs的,这行需要注销掉

    server_name  localhost; #域名

    #charset koi8-r;

    #access_log  /var/log/nginx/host.access.log  main;

    # 定义首页索引目录和名称

    location / {

               include uwsgi_params;

                proxy_pass http://diagbotgateway;

                proxy_set_header Host $host:$server_port;

                proxy_set_header X-Real-IP $remote_addr;

                proxy_set_header REMOTE-HOST $remote_addr;

                proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

                client_max_body_size    2000m;

    }

    #定义错误提示页面

    #error_page  404              /404.html;

    #重定向错误页面到 /50x.html

    error_page   500 502 503 504  /50x.html;

    location = /50x.html {

    root   /usr/share/nginx/html;

    }

    }

    }

    server 192.168.2.236:5050; 根据自己的服务修改

    4.7 ELK安装(日志收集)

    #安装ELK

    关于ELK

    ELK实际上是Elasticsearch+Logstash+Kibana的缩写,关于三个组件的详细介绍,请自己查看各大网站文章,这里就不再描述。

    最近都在研究Docker,出于快速安装方法,本文使用的是ELK For Docker

    sudo docker pull sebp/elk

    运行ELK镜像需要vm.max_map_count至少需要262144内存

    vi /etc/sysctl.conf

    在尾行添加以下内容

    vm.max_map_count=262144

    /etc/sysctl.conf 立即生效

    /sbin/sysctl -p

    运行ELK镜像

    docker run -p 5601:5601 -p 9200:9200 -p 5044:5044 -e ES_MIN_MEM=128m  -e ES_MAX_MEM=1024m -d --restart=always -v /data/elasticsearch:/var/lib/elasticsearch  -v /data/logstash:/etc/logstash -v /etc/localtime:/etc/localtime --name elk sebp/elk

    如无意外打开浏览器即可以访问 http://ip:5601 是不是感受到Docker带来更捷

    配置文件

    /data/logstash/conf.d/logstash-springboot.conf

    --------------------------------------------------------------------------------------------------------------------------------

    input {

        tcp {

            port => 5044

    codec => "json"

        }

    }

    output {

        elasticsearch {

    action => "index"

            hosts => ["127.0.0.1:9200"]

    index => "%{[appname]}"

        }

    stdout {

    codec => rubydebug

    }

    }

    4.8 文件服务器go-fastdfs配置

    关于用go-fastdfs替换现在的fastdfs的理由:

    1. 传输和下载速度均比fastdfs
    2. go-fastdfs配置比fastdfs简单很多,只需要配置一个文件
    3. go-fastdfswindowlinux版本方便部署

    #0.第一次移除原来fastdfs3docker服务

    fastdfs_nginx_1

    fastdfs_tracker_1

    fastdfs_storage_1

    #1.安装go-fastdfs文件服务器(可以从2.236服务器上面下)

    docker pull sjqzhang/go-fastdfs

    #2.运行容器

    docker run -d --restart=always --name gofastdfs -v /data/gofastdfs:/data -p 82:8080 -e GO_FASTDFS_DIR=/data sjqzhang/go-fastdfs

    #2.第一次运行时,文件迁移

    知识库文件目录下的文件移动:

    /data/fastdfs/store_path0/data/ 移到 /data/gofastdfs/files/M00/

    智能预问诊用户上传的文件移动:

    /data/fastdfs/store_path1/data/ 移到 /data/gofastdfs/files/M01/

    智能预问诊知识库填写单文件移动:

    /data/fastdfs/store_path2/data/ 移到 /data/gofastdfs/files/M02/

    #3.修改配置文件

    配置文件位置 /data/gofastdfs/conf/cfg.json

    "是否自动重命名": "默认不自动重命名,使用原文件名",

    "rename_file": true,

    "文件是否去重": "默认去重",

    "enable_distinct_file": false,

    "默认是否下载": "默认下载",

    "default_download": false,

    #4.重启go-fastdfs服务

    #5.图片文件拷贝如果有更新需要拷贝,第一版一定要拷贝

    2.121下面目录下的文件全部拷贝到配置的服务器。

    2.121用户名密码另附

    知识库文件目录地址:

    /data/gofastdfs/files/M00/

    智能预问诊用户上传的文件地址(用户的业务数据可以不用拷贝):

    /data/gofastdfs/files/M01/

    智能预问诊知识库填写单文件地址:

    /data/gofastdfs/files/M02/

    5. 自动发布系统环境搭建

    5.1 yum 安装git

    1.查看系统是否已经安装git

    git --version

    2.CentOS7 yum 安装git

    yum install -y git

    3.安装成功

    5.2 软件准备

    准备一下软件

    1)apache-maven-3.3.9

    2)apache-tomcat-8.0.24

    3)jdk1.8.0_77

    4)下载jenkins.war jenkins官网下载

    https://jenkins.io/download/

    5.3Jenkins 启动和配置

    1)jenkins.war放到apache-tomcat-8.0.24/webapps/ 目录启动Tomcat

    2)打开http://ip:8080/jenkins/

    3)下载必要的插件

    4)jenkins系统设置

    5)jenkins 全局工具设置

    5.4自动发布任务配置

    图片里面的命令文字版

    clean package -U -DskipTests docker:build

    图片里面的命令文字版

    cd /opt/diagbotcloud/dev/

    docker-compose up -d

    docker images|grep none|awk '{print $3}'|xargs docker rmi

    docker-compose脚本参考

    /opt/diagbotcloud/dev/docker-compose.yml

    ------------------------------------------------------------------------------------------------------------------------

    version: "3"

    services:

      eureka1:

        image: 192.168.2.236:5000/diagbotcloud/eureka-server:0.0.1-SNAPSHOT

        hostname: eureka1

        ports:

          - "8761:8761"

        volumes:

        - "/etc/localtime:/etc/localtime:ro"

    #      - "data/diagbotcloud/logs:/logs"

        environment:

          - spring.profiles.active=dev

        restart: always

      config1:

        image: 192.168.2.236:5000/diagbotcloud/config-server:0.0.1-SNAPSHOT

        hostname: config1

    #    ports:

    #      - "8769:8769"

        volumes:

        - "/etc/localtime:/etc/localtime:ro"

    #      - "data/diagbotcloud/logs:/logs"

        environment:

          - myuri=eureka1

    #      - spring.rabbitmq.host=192.168.2.236

    #      - spring.rabbitmq.username=lantone

    #      - spring.rabbitmq.password=lantone

        depends_on:

          - eureka1

        restart: always

      uaa-service:

        image: 192.168.2.236:5000/diagbotcloud/uaa-service:0.0.1-SNAPSHOT

        depends_on:

          - config1

          - eureka1

        volumes:

        - "/etc/localtime:/etc/localtime:ro"

    #      - "data/diagbotcloud/logs:/logs"

        environment:

          - spring.profiles.active=dev

          - myuri=eureka1

        restart: always

      user-service:

        image: 192.168.2.236:5000/diagbotcloud/user-service:0.0.1-SNAPSHOT

        depends_on:

          - config1

          - eureka1

        volumes:

        - "/etc/localtime:/etc/localtime:ro"

    #      - "data/diagbotcloud/logs:/logs"

        environment:

          - spring.profiles.active=dev

          - myuri=eureka1

        restart: always

      diagbotman-service:

        image: 192.168.2.236:5000/diagbotcloud/diagbotman-service:0.0.1-SNAPSHOT

        depends_on:

          - config1

          - eureka1

        volumes:

        - "/etc/localtime:/etc/localtime:ro"

    #      - "data/diagbotcloud/logs:/logs"

        environment:

          - spring.profiles.active=dev

          - myuri=eureka1

        restart: always

      log-service:

        image: 192.168.2.236:5000/diagbotcloud/log-service:0.0.1-SNAPSHOT

        depends_on:

          - config1

          - eureka1

        volumes:

        - "/etc/localtime:/etc/localtime:ro"

    #      - "data/diagbotcloud/logs:/logs"

        environment:

          - spring.profiles.active=dev

          - myuri=eureka1

        restart: always

    #  monitor-service:

    #    image: 192.168.2.236:5000/diagbotcloud/monitor-service:0.0.1-SNAPSHOT

    #    depends_on:

    #      - config1

    #      - eureka1

    ##      - user-service

    ##      - log-service

    #    volumes:

    #    - "/etc/localtime:/etc/localtime:ro"

    ##      - "data/diagbotcloud/logs:/logs"

    #    ports:

    #      - "8766:8766"

    #    environment:

    #      - spring.profiles.active=dev

    #      - myuri=eureka1

    #    restart: always

    #  admin-service:

    #    image: 192.168.2.236:5000/diagbotcloud/admin-service:0.0.1-SNAPSHOT

    #    depends_on:

    #      - config1

    #      - eureka1

    #    volumes:

    #    - "/etc/localtime:/etc/localtime:ro"

    ##      - "data/diagbotcloud/logs:/logs"

    #    ports:

    #      - "9998:9998"

    #    environment:

    #      - spring.profiles.active=dev

    #      - myuri=eureka1

    #    restart: always

      gateway-service:

        image: 192.168.2.236:5000/diagbotcloud/gateway-service:0.0.1-SNAPSHOT

        depends_on:

          - config1

    #      - user-service

    #      - log-service

        volumes:

        - "/etc/localtime:/etc/localtime:ro"

    #      - "data/diagbotcloud/logs:/logs"

        ports:

          - "5050:5050"

        environment:

          - spring.profiles.active=dev

          - myuri=eureka1

        restart: always

  • 相关阅读:
    ORACLE PL/SQL编程总结(二)
    ORACLE PL/SQL基础编程
    Linux centos7环境下安装Nginx
    namespace 实例命名空间 及 应用命名空间 问题
    python 2.7 的django项目
    django项目 导出 和 安装 依赖包
    windows 2012 安装apache
    FX-玩列表
    记录pycharm快捷键出错的其中一个原因
    Django 安装配置
  • 原文地址:https://www.cnblogs.com/kwzblog/p/14212698.html
Copyright © 2020-2023  润新知