• Rhadoop安装


    1.ubuntu,hadoop,R,jdk安装好

    2.下载Rhadoop项目的的三个包,rmr,hdfs,rHBase存放到Downloads/R。

    3.切换到root

    4.安装依赖的库

    ~R CMD javareconf

    ~R

    >install.packages("rJava")

    reshape2,Rcpp,iterators,itertools,digest,RJSONIO,functional

    5.安装rhdfs库

    环境变量

     export JAVA_HOME=/home/csf/Downloads/jdk1.8.0_31
    HADOOP_CMD=/home/csf/Downloads/hadoop/bin/hadoop
    HADOOP_STREAMING=/home/csf/Downloads/hadoop/share/hadoop/tools/lib/hadoop-streaming-2.2.0.jar

    6.

    csf@ubuntu:~/Downloads/hadoop$ . /etc/environment
    csf@ubuntu:~/Downloads/hadoop$ cd ..
    csf@ubuntu:~/Downloads$ R CMD INSTALL /R/rhdfs_1.0.8.tar.gz
    Warning: invalid package ‘/R/rhdfs_1.0.8.tar.gz’
    Error: ERROR: no packages specified
    csf@ubuntu:~/Downloads$ R CMD INSTALL /R/rhdfs_1.0.8.tar.gz
    Warning: invalid package ‘/R/rhdfs_1.0.8.tar.gz’
    Error: ERROR: no packages specified
    csf@ubuntu:~/Downloads$ R CMD INSTALL R/rhdfs_1.0.8.tar.gz
    * installing to library ‘/usr/local/lib/R/site-library’
    Error: ERROR: no permission to install to directory ‘/usr/local/lib/R/site-library’
    csf@ubuntu:~/Downloads$ sudo su
    [sudo] password for csf:
    root@ubuntu:/home/csf/Downloads# R CMD INSTALL R/rhdfs_1.0.8.tar.gz
    * installing to library ‘/usr/local/lib/R/site-library’
    * installing *source* package ‘rhdfs’ ...
    ** R
    ** inst
    ** preparing package for lazy loading
    ** help
    *** installing help indices
    ** building package indices
    ** testing if installed package can be loaded
    * DONE (rhdfs)
    root@ubuntu:/home/csf/Downloads# ^C
    root@ubuntu:/home/csf/Downloads#

    7.确保安装所有的库

    这里Rcpp没有安装成功,折腾了半天,

    使用下面这个命令删除了Rcpp的相关文件夹

    http://zhidao.baidu.com/link?url=czeXx5lWhQc-ATAfgDN3YFaIsftg0D6KskzphiUi6s2a3uA4tbtN82365wo1_1LvwsQi--dY75GpquUYrgDana

    8.重新安装plyr,reshape2等

    9.

    > library(rhdfs)
    Loading required package: rJava

    HADOOP_CMD=/home/csf/Downloads/hadoop/bin/hadoop

    Be sure to run hdfs.init()
    > hdfs.init()
    15/03/11 21:55:50 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    >

     

    
    
  • 相关阅读:
    git回滚分支版本到指定版本
    java的垃圾回收
    java对象模型
    java内存模型
    偏向锁浅析
    maven打包报错:在类路径或引导类路径中找不到程序包 java.lang
    《microsoft sql server 2008技术内幕 t-sql语言基础》
    《SQL基础教程》
    内连接,外链接(左连接、右连接、全连接),交叉连接大总结+附SQL JOINS图解[转]
    《大型网站技术架构》1.大型网站架构演练
  • 原文地址:https://www.cnblogs.com/cdsj/p/4331737.html
Copyright © 2020-2023  润新知