• 公司hadoop客户端试用


    今天用了一下公司的hadoop客户端,从外面下载的客户端不能用,只能用这个wiki里面提供的:link

    装在了 tc-cm-201511novam12x12n0.tc 目录 /home/work/vip/hadoop-client/hadoop/bin

    命令

    $./hadoop fs -D fs.default.name=afs://pegasus.afs.baidu.com:9902 -D hadoop.job.ugi=nuomi-c-vip,密码 -put abc afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip
    
    16/11/28 14:50:22 INFO fs.LibdfsLoader: Trying to load the libdfs library...
    16/11/28 14:50:22 INFO fs.LibdfsLoader: Loaded the libdfs library
    16/11/28 14:50:22 INFO fs.DFileSystem: Loaded the libdfs library
    
    
    $ ./hadoop fs -D fs.default.name=afs://pegasus.afs.baidu.com:9902 -D hadoop.job.ugi=nuomi-c-vip,密码 -ls afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip
    
    16/11/28 14:50:29 INFO fs.LibdfsLoader: Trying to load the libdfs library...
    16/11/28 14:50:29 INFO fs.LibdfsLoader: Loaded the libdfs library
    16/11/28 14:50:29 INFO fs.DFileSystem: Loaded the libdfs library
    Found 1 items
    -rwxrwxrwx   3 nuomi-c-vip nuomi-c-vip          4 2016-11-28 14:50 /app/nuomi/c-vip/abc

    然后再把这个文件删掉吧:

    $ ./hadoop fs -D fs.default.name=afs://pegasus.afs.baidu.com:9902 -D hadoop.job.ugi=nuomi-c-vip,密码 -rm afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip/abc
    
    16/11/28 14:54:36 INFO fs.LibdfsLoader: Trying to load the libdfs library...
    16/11/28 14:54:36 INFO fs.LibdfsLoader: Loaded the libdfs library
    16/11/28 14:54:36 INFO fs.DFileSystem: Loaded the libdfs library
    Deleted afs://pegasus.afs.baidu.com:9902/app/nuomi/c-vip/abc

    支持的命令包括:

    Usage: java FsShell
               [-ls <path>]
               [-lsr <path>]
               [-du <path>]
               [-dus <path>]
               [-count[-q] <path>]
               [-mv <src> <dst>]
               [-cp <src> <dst>]
               [-ln <src> <dst>]
               [-rm <path>]
               [-rmr <path>]
               [-expunge]
               [-put <localsrc> ... <dst>]
               [-copyFromLocal <localsrc> ... <dst>]
               [-moveFromLocal <localsrc> ... <dst>]
               [-get [-ignoreCrc] [-crc] [-repair] <src> <localdst>]
               [-getmerge [-addnl] <src> <localdst> | -getmerge <src> <localdst> [addnl]]
               [-cat <src>]
               [-text <src>]
               [-copyToLocal [-ignoreCrc] [-crc] [-repair] <src> <localdst>]
               [-copySeqFileToLocal [-ignoreLen] <srcFile> <localDstFile>]
               [-moveToLocal [-crc] <src> <localdst>]
               [-mkdir <path>]
               [-setrep [-R] [-w] [-d] <rep> <path/file>]
               [-setAcl <user> <path> <permission>]
               [-getAcl [-u <user>] [-p <path>] ]
               [-removeAcl [-u <user>] [-p <path>] ]
               [-touchz <path>]
               [-test -[ezd] <path>]
               [-stat [format] <path>]
               [-tail [-f] <file>]
               [-chmod [-R] <MODE[,MODE]... | OCTALMODE> PATH...]
               [-chown [-R] [OWNER][:[GROUP]] PATH...]
               [-chgrp [-R] GROUP PATH...]
               [-help [cmd]]
  • 相关阅读:
    删除MSSQL危险存储过程的代码
    给年轻工程师的十大忠告[转贴]
    HTML中利用堆栈方式对Table进行行排序
    年轻人宣言:青春符号
    刘亦菲小龙女绝美剧照
    精巧完整的日历程序
    XSLT快速参考
    酒吧里经典的英文歌曲专集(4CD)
    检测系统颜色与使用字体
    SQL Server实用操作小技巧集合
  • 原文地址:https://www.cnblogs.com/charlesblc/p/6109540.html
Copyright © 2020-2023  润新知