• 在Windows下MyEclipse运行JAVA程序连接HBASE读取数据出错


    运行环境:Hadoop-2.5.0+Hbase-0.98.6

    问题描述:

    15/06/11 15:35:50 ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
    java.io.IOException: Could not locate executable nullinwinutils.exe in the Hadoop binaries.
        at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:356)
        at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:371)
        at org.apache.hadoop.util.Shell.<clinit>(Shell.java:364)
        at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80)
        at org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:611)
        at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:272)
        at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:260)
        at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:790)
        at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:760)
        at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:633)
        at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2001)
        at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2001)
        at scala.Option.getOrElse(Option.scala:120)
        at org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2001)
        at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:207)
        at org.apache.spark.SparkEnv$.create(SparkEnv.scala:218)
        at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:163)
        at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:269)
        at org.apache.spark.SparkContext.<init>(SparkContext.scala:272)
        at org.apache.spark.SparkContext.<init>(SparkContext.scala:154)
        at SparkFromHbase$.main(SparkFromHbase.scala:15)
        at SparkFromHbase.main(SparkFromHbase.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)
     
    解答:参考http://www.cnblogs.com/hyl8218/p/5492450.html
    问题解决,输出结果:

    17/08/26 22:44:32 INFO client.HConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x15e1ee0ec4c000e
    colfam1:q1 ->value-1
    17/08/26 22:44:32 INFO zookeeper.ZooKeeper: Session: 0x15e1ee0ec4c000e closed
    17/08/26 22:44:32 INFO zookeeper.ClientCnxn: EventThread shut down

    windows64位平台的hadoop2 5 0版本以上插件包 hadoop dll winutils exe 下载地址:http://download.csdn.net/download/lwf2510/8676209

  • 相关阅读:
    sshd
    eclipse运行报java.lang.OutOfMemoryError: PermGen space解决方法
    项目之间依赖
    shell-
    部署记录
    mysql index使用
    GitHub上搭建私人hexo博客操作教程
    关于Vue实例的生命周期(2)
    JS中的五种去重方法
    Vue入门教程(2)
  • 原文地址:https://www.cnblogs.com/rrttp/p/7436641.html
Copyright © 2020-2023  润新知