一、安装过程
1.1 登录
1.2 接受许可协议
1.3 选择免费版本
1.4 选择下一步
1.5 选择当前管理的主机
1.6 选择使用Parcel安装，选择CDH版本，点击继续
1.7 等待安装
此处安装需要等待一段时间，请耐心等待，安装过程可能需要30分钟时间，这和物理机器的磁盘读写速度和机器性能有关，如果中断请继续之前的步骤重新操作，下图是安装成功界面
1.8 集群检测
检测全部通过
1.9 选择自定义服务，选择要安装的组件
1.10 分配角色
1.11 数据库设置
选择对应的数据库，点击测试连接，通过之后，继续
1.12 集群设置
使用默认设置即可
1.13 首次安装组件
1.14 安装Spark报错
查看stderr查看报错信息，发现找不到JAVA_HOME
解决方法：需要每个节点都操作
在以下文件中手工添加JAVA_HOME
[root@master soft]# cd /opt/cloudera-manager/cm-5.9.3/lib64/cmf/service/client/ [root@master client]# vi deploy-cc.sh
保存之后
[root@master client]# cat /etc/environment
点击重试
1.15 安装Hive报错
查看stderr查看报错信息，发现hive初始化失败
处理过程：
（1） 拷贝jdbc驱动包
[root@master ~]# cp /root/soft/mysql-connector-java-5.1.26-bin.jar /opt/cloudera/parcels/CDH-5.9.3-1.cdh5.9.3.p0.4/lib/hive/lib/
点击重试，仍旧报错
点击查看完整日志
点击链接
在搜索框中搜索hive.metastore.schema.verification，把勾选去掉，保存更改，返回安装界面点击重试
继续报错，查看完整日志
1 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 2 Java HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release 3 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 4 javax.jdo.JDOUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 5 at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:549) 6 at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:732) 7 at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752) 8 at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317) 9 at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211) 10 at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186) 11 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 12 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 13 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 14 at java.lang.reflect.Method.invoke(Method.java:498) 15 at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103) 16 at com.sun.proxy.$Proxy6.verifySchema(Unknown Source) 17 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627) 18 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679) 19 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484) 20 at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78) 21 at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) 22 at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950) 23 at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945) 24 at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197) 25 at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122) 26 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 27 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 28 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 29 at java.lang.reflect.Method.invoke(Method.java:498) 30 at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 31 at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 32 NestedThrowablesStackTrace: 33 Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 34 org.datanucleus.exceptions.NucleusUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 35 at org.datanucleus.store.rdbms.valuegenerator.TableGenerator.createRepository(TableGenerator.java:261) 36 at org.datanucleus.store.rdbms.valuegenerator.AbstractRDBMSGenerator.obtainGenerationBlock(AbstractRDBMSGenerator.java:162) 37 at org.datanucleus.store.valuegenerator.AbstractGenerator.obtainGenerationBlock(AbstractGenerator.java:197) 38 at org.datanucleus.store.valuegenerator.AbstractGenerator.next(AbstractGenerator.java:105) 39 at org.datanucleus.store.rdbms.RDBMSStoreManager.getStrategyValueForGenerator(RDBMSStoreManager.java:2005) 40 at org.datanucleus.store.AbstractStoreManager.getStrategyValue(AbstractStoreManager.java:1386) 41 at org.datanucleus.ExecutionContextImpl.newObjectId(ExecutionContextImpl.java:3827) 42 at org.datanucleus.state.JDOStateManager.setIdentity(JDOStateManager.java:2571) 43 at org.datanucleus.state.JDOStateManager.initialiseForPersistentNew(JDOStateManager.java:513) 44 at org.datanucleus.state.ObjectProviderFactoryImpl.newForPersistentNew(ObjectProviderFactoryImpl.java:232) 45 at org.datanucleus.ExecutionContextImpl.newObjectProviderForPersistentNew(ExecutionContextImpl.java:1414) 46 at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:2218) 47 at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:2065) 48 at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:1913) 49 at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:217) 50 at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:727) 51 at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752) 52 at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317) 53 at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211) 54 at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186) 55 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 56 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 57 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 58 at java.lang.reflect.Method.invoke(Method.java:498) 59 at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103) 60 at com.sun.proxy.$Proxy6.verifySchema(Unknown Source) 61 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627) 62 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679) 63 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484) 64 at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78) 65 at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) 66 at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950) 67 at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945) 68 at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197) 69 at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122) 70 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 71 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 72 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 73 at java.lang.reflect.Method.invoke(Method.java:498) 74 at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 75 at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 76 Exception in thread "main" javax.jdo.JDOUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 77 at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:549) 78 at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:732) 79 at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752) 80 at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317) 81 at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211) 82 at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186) 83 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 84 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 85 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 86 at java.lang.reflect.Method.invoke(Method.java:498) 87 at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103) 88 at com.sun.proxy.$Proxy6.verifySchema(Unknown Source) 89 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627) 90 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679) 91 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484) 92 at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78) 93 at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) 94 at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950) 95 at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945) 96 at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197) 97 at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122) 98 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 99 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 100 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 101 at java.lang.reflect.Method.invoke(Method.java:498) 102 at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 103 at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 104 NestedThrowablesStackTrace: 105 Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 106 org.datanucleus.exceptions.NucleusUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 107 at org.datanucleus.store.rdbms.valuegenerator.TableGenerator.createRepository(TableGenerator.java:261) 108 at org.datanucleus.store.rdbms.valuegenerator.AbstractRDBMSGenerator.obtainGenerationBlock(AbstractRDBMSGenerator.java:162) 109 at org.datanucleus.store.valuegenerator.AbstractGenerator.obtainGenerationBlock(AbstractGenerator.java:197) 110 at org.datanucleus.store.valuegenerator.AbstractGenerator.next(AbstractGenerator.java:105) 111 at org.datanucleus.store.rdbms.RDBMSStoreManager.getStrategyValueForGenerator(RDBMSStoreManager.java:2005) 112 at org.datanucleus.store.AbstractStoreManager.getStrategyValue(AbstractStoreManager.java:1386) 113 at org.datanucleus.ExecutionContextImpl.newObjectId(ExecutionContextImpl.java:3827) 114 at org.datanucleus.state.JDOStateManager.setIdentity(JDOStateManager.java:2571) 115 at org.datanucleus.state.JDOStateManager.initialiseForPersistentNew(JDOStateManager.java:513) 116 at org.datanucleus.state.ObjectProviderFactoryImpl.newForPersistentNew(ObjectProviderFactoryImpl.java:232) 117 at org.datanucleus.ExecutionContextImpl.newObjectProviderForPersistentNew(ExecutionContextImpl.java:1414) 118 at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:2218) 119 at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:2065) 120 at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:1913) 121 at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:217) 122 at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:727) 123 at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752) 124 at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317) 125 at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211) 126 at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186) 127 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 128 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 129 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 130 at java.lang.reflect.Method.invoke(Method.java:498) 131 at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103) 132 at com.sun.proxy.$Proxy6.verifySchema(Unknown Source) 133 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627) 134 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679) 135 at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484) 136 at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78) 137 at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) 138 at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950) 139 at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945) 140 at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197) 141 at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122) 142 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 143 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 144 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 145 at java.lang.reflect.Method.invoke(Method.java:498) 146 at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 147 at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
报错原因：
mysql数据库的binlog_format参数设置不正确，原来设置的是STATEMENT，修改为MIXED，修改方法，在/usr/my.cnf文件中加上binlog_format=MIXED
然后重启mysql数据库,再次点击重试，全部通过。点击继续
1.16 完成安装
二、调试
2.1 安装完成
2.2 HDFS配置报警告
点击黄色的扳手，查看是NameNode的Java堆栈大小
修改为4吉字节点击保存，框中全部改为4吉字节
重启过时服务
2.2 启用HDFS的高可用
