第一章 文档概述
本文描述适用于Greenplum4.0以上版本的安装操作。所涉及到的操作系统相关参数调整，主要针对Redhat Linux操作系统。
第二章 安装介质
操作系统：CentOS release 6.5 (Final)。
Greenplum安装版本：greenplum-db-4.3.8.1-build-2-RHEL5-x86_64.zip
第三章 安装前准备
3.1、网络规划
建议在Greenplum数据库系统安装之前，把网络配置规划好
3.2、存储空间规划
首先，需要评估目标数据库数据所需要的空间容量。建议了解客户搭建Greenplum数据库的具体应用。
举例：估计数据库所需空间为U，数据库需要启用Mirror，磁盘阵列总可用空间为D（Raid之后）。空间规划服务和如下公式：
2 * U + U / 3 = D * 70%
磁盘空间D平均分配到各个Segment服务器上。
Master需要相应的空间。使用服务器内置硬盘的计算方式类似。
3.3、数据库实例规划
规划每个Segment服务器上建立的数据库实例的数量（instance数量），通常建议每2个CPU内核（core）对应一个数据库实例
第四章 操作系统设置
4.1 、设置主机名
修改各台主机的主机名称。一般建议的命名规则如下：
Master：mdw
Standby Master：smdw
Segment Host：sdw1、sdw2……sdwn
修改操作：
1、hostname mdw 2、修改 /etc/sysconfig/network 配置文件中的hostname
4.2 、设置hosts解析(所有节点，Master和Segments)
通常Master和Standby Master主机都配置外部IP和内部IP。Segment主机可只配置内部IP。所有主机的hosts文件内容必须保持一致
127.0.0.1 mdw localhost localhost.localdomain localhost4 localhost4.localdomain4 192.168.1.201 mdw 192.168.1.202 sdw1 192.168.1.203 sdw2
4.3、安装依赖软件(所有节点，Master和Segments)
yum -y install ed rsync coreutils glib2 lrzsz sysstat e4fsprogs xfsprogs ntp readline-devel zlib zlib-devel openssl openssl-devel pam-devel libxml2-devel libxslt-devel python-devel tcl-devel gcc make smartmontools flex bison OpenIPMI-tools openldap openldap-devel logrotate python-py gcc-c++ apr-devel libcurl-devel bzip2-devel libyaml-devel openssh-clients
【涉及机器】：所有服务器关闭防火墙
service iptables stop
chkconfig iptables off
service ip6tables stop
chkconfig ip6tables off
4.4、配置NTP时间同步(所有节点)
使用root用户进行操作，涉及所有服务器。
Greenplum推荐使用NTP（Network Time Protocol）同步各台主机的时钟。建议设置一台独立的时钟服务器。例如时钟服务器IP为10.6.220.20
4.4.1、Master服务器配置与时钟服务器同步。
修改配置文件/etc/ntp.conf后，启动ntpd服务。举例：配置文件增加：
server 10.6.220.20
启动NTP服务：
service ntpd start;chkconfig ntpd on
#如果没有独立的时钟服务器，则应该以Master服务器做内部的时钟服务器，Master就可以不用修改ntp.conf配置文件，直接启动ntpd服务即可。
4.4.2、所有Segment服务器优先与Master服务器同步，其次与Standby Master服务器同步。
修改配置文件/etc/ntp.conf后，重启ntpd服务。配置文件增加：
server mdw prefer
server smdw
启动服务：
service ntpd start;chkconfig ntpd on
4.4.3、Standby Master服务器优先与Master服务器，其次与始终服务器同步。
修改配置文件/etc/ntp.conf后，重启ntpd服务。配置文件增加：
server mdw prefer server 10.6.220.20
启动服务：
service ntpd start;chkconfig ntpd on
#如果没有独立的时钟服务器，第二行不用配置。
4.5 修改系统参数（Redhat）
【涉及机器】：所有服务器；使用root用户进行修改，重启后生效。
4.5.1、修改系统参数/etc/sysctl.conf
kernel.shmmax = 500000000 kernel.shmmni = 4096 kernel.shmall = 4000000000 kernel.sem = 250 512000 100 2048 kernel.sysrq = 1 kernel.core_uses_pid = 1 kernel.msgmnb = 65536 kernel.msgmax = 65536 net.ipv4.tcp_syncookies = 1 net.ipv4.ip_forward = 0 net.ipv4.conf.default.accept_source_route = 0 net.ipv4.tcp_tw_recycle = 1 net.ipv4.tcp_max_syn_backlog = 4096 net.ipv4.conf.all.arp_filter = 1 net.ipv4.conf.default.arp_filter = 1 net.core.netdev_max_backlog = 10000 vm.overcommit_memory = 2 kernel.msgmni = 2048 net.ipv4.ip_local_port_range = 1025 65535
4.5.2、修改系统参数/etc/security/limits.conf
Linux PAM中 pam_limits.so 的配置文件
* soft nofile 65536 * hard nofile 65536 * soft nproc 131072 * hard nproc 131072
4.5.3、修改磁盘预读参数(所有节点，Master和Segments)
通过修改预读扇区数，可以有效磁盘的读性能，特别是顺序读，GPDB数据库要求最小磁盘扇区数为16384，建议设置为65535。
在参数文件/etc/rc.d/rc.local中增加；
blockdev --setra 65535 /dev/sd
4.5.4、修改配置/boot/grub/menu.lst
Linux默认的I/O调度模式是CFQ，通常需要修改I/O调度策略为deadline，可以通过下面的命令查看I/O调度策略。
cat /sys/block/sda/queue/scheduler
#临时修改
echo deadline > /sys/block/sda/queue/scheduler
如果永久修改I/O调度策略，则需要修改/boot/grub/menu.lst文件，在“kernel*”行后面增加elevator=deadline。
4.5.5、修改配置/etc/sysconfig/i18n
增加RC_LANG=en_US.UTF-8
4.6、启动IPMI服务
（IPMI（Intelligent Platform Management Interface）即智能平台管理接口是使硬件管理具备“智能化”的新一代通用接口标准。如果没有安装相关服务，建议安装）
service ipmi start;chkconfig ipmi on
第五章 配置用户和数据目录
5.1、创建gpadmin用户(所有节点，Master和Segments)
[root@mdw ~]# groupadd -g 520 gpadmin [root@mdw ~]# useradd -u 520 -g gpadmin gpadmin [root@mdw ~]# passwd gpadmin Changing password for user gpadmin. New password: BAD PASSWORD: is too simple Retype new password: passwd: all authentication tokens updated successfully.
5.2、创建软件安装目录(所有节点，Master和Segments)
[root@mdw ~]# mkdir -p /gpdb/app
[root@mdw ~]# chown -R gpadmin:gpadmin /gpdb/
/gpdb目录为GPDB的BASE目录，/gpdb/app为GPDB的HOME目录。
第六章 安装Greenplum
6.1、上传并解压GPDB安装文件（仅Master节点）
[gpadmin@mdw gpdb]$ unzip greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.zip Archive: greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.zip inflating: README_INSTALL inflating: greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.bin [gpadmin@mdw gpdb]$ ll total 278668 drwxr-xr-x. 2 gpadmin gpadmin 4096 Mar 29 00:07 app -rwxr-xr-x. 1 gpadmin gpadmin 143791566 Apr 20 2016 greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.bin -rw-r--r--. 1 gpadmin gpadmin 141547878 Mar 28 16:02 greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.zip -rw-r--r--. 1 gpadmin gpadmin 6997 Apr 20 2016 README_INSTALL
6.2、运行安装文件
gpadmin@mdw gpdb]$ ./greenplum-db-4.3.8.1-build-1-RHEL5-x86_64.bin 下面是许可信息后面的内容 ******************************************************************************** You must read and accept the Pivotal Database license agreement before installing ******************************************************************************** *** IMPORTANT INFORMATION - PLEASE READ CAREFULLY *** PIVOTAL GREENPLUM DATABASE END USER LICENSE AGREEMENT IMPORTANT - READ CAREFULLY: This Software contains computer programs and other proprietary material and information, the use of which is subject to and expressly conditioned upon acceptance of this End User License Agreement ("EULA"). This EULA is a legally binding document between you (meaning the person or the entity that obtained the Software under the terms and conditions of this EULA, is agreeing to be bound by the terms and conditions of this EULA, and is referred to below as "You" or "Customer") and Pivotal (meaning (i) Pivotal Software, Inc., if Customer is located in the United States; and (ii) the local Pivotal sales subsidiary, if Customer is located in a country outside the United States in which Pivotal has a local sales subsidiary; and (iii) GoPivotal International Limited, if Customer is located in a country outside the United States in which Pivotal does not have a local sales subsidiary (in each case, referred to herein as "Pivotal"). Unless Customer has entered into a written and separately signed agreement with Pivotal that is currently in effect with respect to the license of the Software and provision of Support Services and Subscription Services, this EULA governs Customer's use of the Software and the provision of Support Services and Subscription Services. Capitalized terms have the meaning stated in the EULA. ............ 必须输入YES才可继续安装。 ******************************************************************************** Do you accept the Pivotal Database license agreement? [yes|no] ******************************************************************************** yes 默认GPDB的安装路径为/usr/local/greenplum-db-**，确认需要输入YES，如果需要安装到其他路径，直接输入要按照的路径即可 ******************************************************************************** Provide the installation path for Greenplum Database or press ENTER to accept the default installation path: /usr/local/greenplum-db-4.3.8.1 ******************************************************************************** /gpdb/app ******************************************************************************** Install Greenplum Database into </gpdb/app>? [yes|no] ******************************************************************************** yes Extracting product to /gpdb/app
安装完成;安装完成会在/gpdb/app目录下生成以下文件。
[gpadmin@mdw gpdb]$ cd app [gpadmin@mdw app]$ ll total 276 drwxr-xr-x. 4 gpadmin gpadmin 4096 Apr 20 2016 bin drwxr-xr-x. 2 gpadmin gpadmin 4096 Apr 20 2016 demo drwxr-xr-x. 5 gpadmin gpadmin 4096 Apr 20 2016 docs drwxr-xr-x. 2 gpadmin gpadmin 4096 Apr 20 2016 etc drwxr-xr-x. 3 gpadmin gpadmin 4096 Apr 20 2016 ext -rw-r--r--. 1 gpadmin gpadmin 43025 Apr 20 2016 GPDB-LICENSE.txt -rw-rw-r--. 1 gpadmin gpadmin 713 Mar 29 00:12 greenplum_path.sh drwxr-xr-x. 6 gpadmin gpadmin 4096 Apr 20 2016 include drwxr-xr-x. 9 gpadmin gpadmin 4096 Apr 20 2016 lib -rw-r--r--. 1 gpadmin gpadmin 192912 Apr 20 2016 LICENSE.thirdparty drwxr-xr-x. 2 gpadmin gpadmin 4096 Apr 20 2016 sbin drwxr-xr-x. 4 gpadmin gpadmin 4096 Apr 20 2016 share
6.3、设置GPDB环境变量(仅Master节点)
安装完成后修改gpadmin用户home的~/.bashrc配置文件，增加
source /gpdb/app/greenplum_path.sh
6.4、配置hostname文件（用于建立多机信任）
编辑节点信息文件(仅Master节点)。为了管理方便，在app目录下创建config文件夹，将节点信息文件存放在该目录下。需要创建两个文件，其中一个文件(hostlist)存放所有节点信息，seg_host文件只存放segment节点信息
[gpadmin@mdw app]$ mkdir config
[gpadmin@mdw app]$ cd config
[gpadmin@mdw config]$ cat hostlist
mdw
sdw1
sdw2
[gpadmin@mdw config]$ cat seg_host
sdw1
sdw2
6.5、打通所有节点直接的互信(仅Master节点)
GreenPlum数据库提供gpssh-exkeys工具来打开所有节点直接的互信关系，非常方便
[gpadmin@mdw config]$ gpssh-exkeys -f hostlist [STEP 1 of 5] create local ID and authorize on local host ... /home/gpadmin/.ssh/id_rsa file exists ... key generation skipped [STEP 2 of 5] keyscan all hosts and update known_hosts file [STEP 3 of 5] authorize current user on remote hosts ... send to mdw ... send to sdw1 *** *** Enter password for sdw1: ... send to sdw2 [STEP 4 of 5] determine common authentication file content [STEP 5 of 5] copy authentication files to all remote hosts ... finished key exchange with mdw ... finished key exchange with sdw1 ... finished key exchange with sdw2 [INFO] completed successfully
互信配置完成后，可以通过gpssh工具来验证互信是否成功配置，-e参数后面的是远程登录节点后执行的命令。通过gpssh工具可以在所有节点运行同一命令，非常方便(后续会用到)。
[gpadmin@mdw config]$ gpssh -f /gpdb/app/config/hostlist -e 'pwd' [ mdw] pwd [ mdw] /home/gpadmin [sdw2] pwd [sdw2] /home/gpadmin [sdw1] pwd [sdw1] /home/gpadmin
6.6、Segment节点安装GreenPlum软件(仅Master节点)
通过gpseginstall命令安装segment软件，使用-u参数指定安装用户，-p参数指定安装用户的密码，这样将不再需要交互式输入密码。
[gpadmin@mdw config]$ gpseginstall -f hostlist -u gpadmin -p li0924 20180329:00:16:00:018760 gpseginstall:mdw:gpadmin-[INFO]:-Installation Info: link_name greenplum-db binary_path /gpdb/app binary_dir_location /gpdb binary_dir_name app 20180329:00:16:00:018760 gpseginstall:mdw:gpadmin-[INFO]:-check cluster password access 20180329:00:16:00:018760 gpseginstall:mdw:gpadmin-[INFO]:-de-duplicate hostnames 20180329:00:16:00:018760 gpseginstall:mdw:gpadmin-[INFO]:-master hostname: mdw 20180329:00:16:01:018760 gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar; rm -f /gpdb/app.tar.gz 20180329:00:16:01:018760 gpseginstall:mdw:gpadmin-[INFO]:-cd /gpdb; tar cf app.tar app 20180329:00:16:10:018760 gpseginstall:mdw:gpadmin-[INFO]:-gzip /gpdb/app.tar 20180329:00:16:35:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: mkdir -p /gpdb 20180329:00:16:35:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -rf /gpdb/app 20180329:00:16:35:018760 gpseginstall:mdw:gpadmin-[INFO]:-scp software to remote location 20180329:00:16:39:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: gzip -f -d /gpdb/app.tar.gz 20180329:00:16:58:018760 gpseginstall:mdw:gpadmin-[INFO]:-md5 check on remote location 20180329:00:17:02:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; tar xf app.tar 20180329:00:17:10:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: rm -f /gpdb/app.tar 20180329:00:17:12:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: cd /gpdb; rm -f greenplum-db; ln -fs app greenplum-db 20180329:00:17:13:018760 gpseginstall:mdw:gpadmin-[INFO]:-rm -f /gpdb/app.tar.gz 20180329:00:17:13:018760 gpseginstall:mdw:gpadmin-[INFO]:-version string on master: gpssh version 4.3.8.1 build 1 20180329:00:17:13:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/greenplum-db/./greenplum_path.sh; /gpdb/greenplum-db/./bin/gpssh --version 20180329:00:17:13:018760 gpseginstall:mdw:gpadmin-[INFO]:-remote command: . /gpdb/app/greenplum_path.sh; /gpdb/app/bin/gpssh --version 20180329:00:17:19:018760 gpseginstall:mdw:gpadmin-[INFO]:-SUCCESS -- Requested commands completed
Segment节点会根据Master节点的安装路径安装GreenPlum软件，目录结构和Master一模一样。
6.7、 Segment节点配置环境变量(所有Segment节点)
修改gpadmin用户home的~/.bashrc配置文件，增加
source /gpdb/app/greenplum_path.sh
第七章 数据库的初始化
7.1、创建数据文件存放目录(所有节点)
[root@mdw ~]# mkdir -p /data/gpdata/master [root@mdw ~]# chown -R gpadmin:gpadmin /data [root@sdw1 ~]# mkdir -p /data/gpdata/primary [root@sdw1 ~]# mkdir -p /data/gpdata/mirror [root@sdw1 ~]# chown -R gpadmin:gpadmin /data
本案例Master节点的数据文件存放在/data/gpdata/master目录,Segment节点的主数据文件存放在/data/gpdata/primary目录；镜像数据文件放在/data/gpdata/mirror目录
7.2、配置时间同步(所有节点)
本案例Master节点的服务器配置为NTP的服务端，Segment节点为NTP的客户端。Master节点使用root用户通过gpssh工具批量调用date命令对比各服务器的时间是否一致。
[gpadmin@mdw ~]$ gpssh -f /gpdb/app/config/hostlist Note: command history unsupported on this machine ... => date [sdw1] Wed Mar 28 17:51:36 CST 2018 [ mdw] Wed Mar 28 17:51:36 CST 2018 [sdw2] Wed Mar 28 17:51:36 CST 2018
7.3、系统检查(仅Master节点)
在初始化数据库之前，需要进行先决条件检查，主要检查磁盘I/O能力、网络带宽、内核参数、limit等条件是否满足GreenPlum数据库的要求。
参数配置检查
[gpadmin@mdw ~]$ gpcheck -f /gpdb/app/config/hostlist -m mdw 20180328:17:58:36:001300 gpcheck:mdw:gpadmin-[INFO]:-dedupe hostnames 20180328:17:58:37:001300 gpcheck:mdw:gpadmin-[INFO]:-Detected platform: Generic Linux Cluster 20180328:17:58:37:001300 gpcheck:mdw:gpadmin-[INFO]:-generate data on servers 20180328:17:58:38:001300 gpcheck:mdw:gpadmin-[INFO]:-copy data files from servers 20180328:17:58:39:001300 gpcheck:mdw:gpadmin-[INFO]:-delete remote tmp files 20180328:17:58:39:001300 gpcheck:mdw:gpadmin-[INFO]:-Using gpcheck config file: /gpdb/greenplum-db/./etc/gpcheck.cnf 20180328:17:58:39:001300 gpcheck:mdw:gpadmin-[ERROR]:-GPCHECK_ERROR host(None): utility will not check all settings when run as non-root user 20180328:17:58:39:001300 gpcheck:mdw:gpadmin-[INFO]:-gpcheck completing...
参数性能检查
1 参数配置检查 gpcheck -f /gpdb/app/config/hostlist -m mdw -s smdw 核对并修改下你感应系统参数。 2 性能检查 2.1 网络性能检查 gpcheckperf -f /gpdb/app/config/hostlist -r N -d /tmp > checknetwork.out 2.2 磁盘性能检查 gpcheckperf -f /gpdb/app/config/hostlist -r ds -D -d /data/gpdata/primary -d /data/gpdata/mirror r > checkio.out 检查磁盘IO的目标目录是数据库的数据文件目录，测试工具会写入系统内存的两倍大小的数据量。
7.4、创建GreenPlum数据库的参数文件(仅Master节点)
在$GPHOME/docs目录下，存在一些参数文件的模版，可以通过这些模版快速配置一些常用的参数文件。比如GreenPlum数据库的参数文件可以参考$GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config文件。
[gpadmin@mdw ~]$ cp $GPHOME/docs/cli_help/gpconfigs/gpinitsystem_config /gpdb/app/config/gpinitsystem_config
配置参数文件gpinitsystem_config
[gpadmin@mdw config]$ cat gpinitsystem_config # FILE NAME: gpinitsystem_config # Configuration file needed by the gpinitsystem ################################################ #### REQUIRED PARAMETERS ################################################ #### Name of this Greenplum system enclosed in quotes. ARRAY_NAME="EMC Greenplum DW" #### Naming convention for utility-generated data directories. SEG_PREFIX=gpseg #### Base number by which primary segment port numbers #### are calculated. PORT_BASE=40000 #### File system location(s) where primary segment data directories #### will be created. The number of locations in the list dictate #### the number of primary segments that will get created per #### physical host (if multiple addresses for a host are listed in #### the hostfile, the number of segments will be spread evenly across #### the specified interface addresses). declare -a DATA_DIRECTORY=(/data/gpdata/primary) #### OS-configured hostname or IP address of the master host. MASTER_HOSTNAME=mdw #### File system location where the master data directory #### will be created. MASTER_DIRECTORY=/data/gpdata/master #### Port number for the master instance. MASTER_PORT=5432 #### Shell utility used to connect to remote hosts. TRUSTED_SHELL=ssh #### Maximum log file segments between automatic WAL checkpoints. CHECK_POINT_SEGMENTS=8 #### Default server-side character set encoding. ENCODING=UNICODE ################################################ #### OPTIONAL MIRROR PARAMETERS ################################################ #### Base number by which mirror segment port numbers #### are calculated. #MIRROR_PORT_BASE=50000 #### Base number by which primary file replication port #### numbers are calculated. #REPLICATION_PORT_BASE=41000 #### Base number by which mirror file replication port #### numbers are calculated. #MIRROR_REPLICATION_PORT_BASE=51000 #### File system location(s) where mirror segment data directories #### will be created. The number of mirror locations must equal the #### number of primary locations as specified in the #### DATA_DIRECTORY parameter. #declare -a MIRROR_DATA_DIRECTORY=(/data/gpdata/mirror) ################################################ #### OTHER OPTIONAL PARAMETERS ################################################ #### Create a database of this name after initialization. #DATABASE_NAME=name_of_database #### Specify the location of the host address file here instead of #### with the the -h option of gpinitsystem. #MACHINE_LIST_FILE=/home/gpadmin/gpconfigs/hostfile_gpinitsystem
7.5、GreenPlum数据库初始化(仅Master节点)
接下来就可以使用gpinitsystem工具初始化数据库了，一些参数文件中没有设置的重要参数，在初始化数据库时会被使用默认值，可以在初始化之后根据需求及主机的配置进行设置。GreenPlum数据库的参数也分为静态参数和动态参数，静态参数需重启数据库才能生效，动态参数不需要重启数据库即可生效。
若需要standby master；可以-s 主机名即可；也可以后续使用gpinitsystem添加。这个后续文章讲解
[gpadmin@mdw config]$ gpinitsystem -c gpinitsystem_config -h seg_host 20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, please wait... 20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Reading Greenplum configuration file gpinitsystem_config 20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Locale has not been set in gpinitsystem_config, will set to default value 20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Locale set to en_US.utf8 20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates 20180329:18:18:42:001126 gpinitsystem:mdw:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value 250 20180329:18:18:43:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking configuration parameters, Completed 20180329:18:18:43:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, please wait... .. 20180329:18:18:44:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Configuring build for standard array 20180329:18:18:44:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Commencing multi-home checks, Completed 20180329:18:18:44:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Building primary segment instance array, please wait... .. 20180329:18:18:45:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking Master host 20180329:18:18:45:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, please wait... .20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:----------------------------------------------------------- 20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw1 is assigned as localhost in /etc/hosts 20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures 20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw1 from local host line in /etc/hosts 20180329:18:18:50:001126 gpinitsystem:mdw:gpadmin-[WARN]:----------------------------------------------------------- .20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:----------------------------------------------------------- 20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Host sdw2 is assigned as localhost in /etc/hosts 20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:-This will cause segment->master communication failures 20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Remove sdw2 from local host line in /etc/hosts 20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[WARN]:----------------------------------------------------------- 20180329:18:18:51:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checking new segment hosts, Completed 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database Creation Parameters 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:--------------------------------------- 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master Configuration 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:--------------------------------------- 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master instance name = EMC Greenplum DW 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master hostname = mdw 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master port = 5432 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master instance dir = /data/gpdata/master/gpseg-1 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master LOCALE = en_US.utf8 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum segment prefix = gpseg 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master Database = 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master connections = 250 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master buffers = 128000kB 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Segment connections = 750 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Segment buffers = 128000kB 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Checkpoint segments = 8 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Encoding = UNICODE 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Postgres param file = Off 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Initdb to be used = /gpdb/greenplum-db/./bin/initdb 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /gpdb/greenplum-db/./lib 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Ulimit check = Passed 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Array host connect type = Single hostname per node 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [1] = ::1 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [2] = 192.168.1.201 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Master IP address [3] = fe80::20c:29ff:fe30:f99e 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Standby Master = Not Configured 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Primary segment # = 1 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Total Database segments = 2 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Trusted shell = ssh 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Number segment hosts = 2 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Mirroring config = OFF 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------- 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Primary Segment Configuration 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:---------------------------------------- 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-sdw1 /data/gpdata/primary/gpseg0 40000 2 0 20180329:18:18:52:001126 gpinitsystem:mdw:gpadmin-[INFO]:-sdw2 /data/gpdata/primary/gpseg1 40000 3 1 Continue with Greenplum creation Yy/Nn> y 20180329:18:19:05:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Building the Master instance database, please wait... 20180329:18:19:19:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Starting the Master in admin mode 20180329:18:19:25:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Commencing parallel build of primary segment instances 20180329:18:19:25:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Spawning parallel processes batch [1], please wait... .. 20180329:18:19:25:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Waiting for parallel processes batch [1], please wait... ............................. 20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------ 20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Parallel process exit status 20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------ 20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as completed = 2 20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as killed = 0 20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Total processes marked as failed = 0 20180329:18:19:54:001126 gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------ 20180329:18:19:55:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Deleting distributed backout files 20180329:18:19:55:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Removing back out file 20180329:18:19:55:001126 gpinitsystem:mdw:gpadmin-[INFO]:-No errors generated from parallel processes 20180329:18:19:55:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Restarting the Greenplum instance in production mode 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Starting gpstop with args: -a -i -m -d /data/gpdata/master/gpseg-1 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Gathering information and validating the environment... 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Obtaining Segment details from master... 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Greenplum Version: 'postgres (Greenplum Database) 4.3.8.1 build 1' 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-There are 0 connections to the database 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate' 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Master host=mdw 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate 20180329:18:19:55:011745 gpstop:mdw:gpadmin-[INFO]:-Master segment instance directory=/data/gpdata/master/gpseg-1 20180329:18:19:56:011745 gpstop:mdw:gpadmin-[INFO]:-Attempting forceful termination of any leftover master process 20180329:18:19:56:011745 gpstop:mdw:gpadmin-[INFO]:-Terminating processes for segment /data/gpdata/master/gpseg-1 20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Starting gpstart with args: -a -d /data/gpdata/master/gpseg-1 20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Gathering information and validating the environment... 20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Greenplum Binary Version: 'postgres (Greenplum Database) 4.3.8.1 build 1' 20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Greenplum Catalog Version: '201310150' 20180329:18:19:57:011832 gpstart:mdw:gpadmin-[INFO]:-Starting Master instance in admin mode 20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information 20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Obtaining Segment details from master... 20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Setting new master era 20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Master Started... 20180329:18:19:58:011832 gpstart:mdw:gpadmin-[INFO]:-Shutting down master 20180329:18:19:59:011832 gpstart:mdw:gpadmin-[INFO]:-Commencing parallel segment instance startup, please wait... .... 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-Process results... 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:----------------------------------------------------- 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:- Successful segment starts = 2 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:- Failed segment starts = 0 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) = 0 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:----------------------------------------------------- 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:- 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-Successfully started 2 of 2 segment instances 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:----------------------------------------------------- 20180329:18:20:03:011832 gpstart:mdw:gpadmin-[INFO]:-Starting Master instance mdw directory /data/gpdata/master/gpseg-1 20180329:18:20:04:011832 gpstart:mdw:gpadmin-[INFO]:-Command pg_ctl reports Master mdw instance active 20180329:18:20:04:011832 gpstart:mdw:gpadmin-[INFO]:-No standby master configured. skipping... 20180329:18:20:04:011832 gpstart:mdw:gpadmin-[INFO]:-Database successfully started 20180329:18:20:04:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode 20180329:18:20:04:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Loading gp_toolkit... 20180329:18:20:05:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Scanning utility log file for any warning messages 20180329:18:20:05:001126 gpinitsystem:mdw:gpadmin-[WARN]:-******************************************************* 20180329:18:20:05:001126 gpinitsystem:mdw:gpadmin-[WARN]:-Scan of log file indicates that some warnings or errors 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[WARN]:-were generated during the array creation 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Please review contents of log file 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-/home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-To determine level of criticality 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-These messages could be from a previous run of the utility 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-that was called today! 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[WARN]:-******************************************************* 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Greenplum Database instance successfully created 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------------- 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-To complete the environment configuration, please 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-update gpadmin .bashrc file with the following 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-1. Ensure that the greenplum_path.sh file is sourced 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-2. Add "export MASTER_DATA_DIRECTORY=/data/gpdata/master/gpseg-1" 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:- to access the Greenplum scripts for this instance: 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:- or, use -d /data/gpdata/master/gpseg-1 option for the Greenplum scripts 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:- Example gpstate -d /data/gpdata/master/gpseg-1 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Script log file = /home/gpadmin/gpAdminLogs/gpinitsystem_20180329.log 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-To remove instance, run gpdeletesystem utility 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-To initialize a Standby Master Segment for this Greenplum instance 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Review options for gpinitstandby 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:------------------------------------------------------- 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-The Master /data/gpdata/master/gpseg-1/pg_hba.conf post gpinitsystem 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-has been configured to allow all hosts within this new 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-array to intercommunicate. Any hosts external to this 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-new array must be explicitly added to this file 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-Refer to the Greenplum Admin support guide which is 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-located in the /gpdb/greenplum-db/./docs directory 20180329:18:20:06:001126 gpinitsystem:mdw:gpadmin-[INFO]:-------------------------------------------------------