• Hive Cli相关操作


    landen@Master:~/UntarFile/hive-0.10.0$ bin/hive --database 'stuchoosecourse' -e 'select * from hiddenipinfo'
    WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
    Logging initialized using configuration in jar:file:/home/landen/UntarFile/hive-0.10.0/lib/hive-common-0.10.0.jar!/hive-log4j.properties
    Hive history file=/home/landen/UntarFile/hive-0.10.0/logs/hive_job_log_landen_201312091443_1939478442.txt
    OK
    Time taken: 2.704 seconds
    OK
    ip    countrycode    countryname    region    regionname    city    latitude    longitude    timezone
    221.12.10.218    CN    China    02    Zhejiang    Hangzhou    30.293594    120.16141    Asia/Shanghai
    60.180.248.201    CN    China    02    Zhejiang    Wenzhou    27.999405    120.66681    Asia/Shanghai
    125.111.251.118    CN    China    02    Zhejiang    Ningbo    29.878204    121.5495    Asia/Shanghai
    Time taken: 0.813 seconds


    testSql.q内容如下:

    select IP4Tocc(ipadress,'./GeoLiteCity.dat') from ipidentifier;
    select * from hiddenipinfo;

    landen@Master:~/UntarFile/hive-0.10.0$ bin/hive --database 'stuchoosecourse' -f '/home/landen/文档/testSql.q'(执行SQL文件)
    WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
    Logging initialized using configuration in jar:file:/home/landen/UntarFile/hive-0.10.0/lib/hive-common-0.10.0.jar!/hive-log4j.properties
    Hive history file=/home/landen/UntarFile/hive-0.10.0/logs/hive_job_log_landen_201312091450_505292945.txt
    OK
    Time taken: 4.939 seconds
    Total MapReduce jobs = 1
    Launching Job 1 out of 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201312042044_0024, Tracking URL = http://Master:50030/jobdetails.jsp?jobid=job_201312042044_0024
    Kill Command = /home/landen/UntarFile/hadoop-1.0.4/libexec/../bin/hadoop job  -kill job_201312042044_0024
    Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
    2013-12-09 14:51:19,055 Stage-1 map = 0%,  reduce = 0%
    2013-12-09 14:51:25,127 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 1.21 sec
    2013-12-09 14:51:26,133 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 1.21 sec
    2013-12-09 14:51:27,156 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 1.21 sec
    2013-12-09 14:51:28,160 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 1.21 sec
    2013-12-09 14:51:29,164 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 1.21 sec
    2013-12-09 14:51:30,168 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 1.21 sec
    2013-12-09 14:51:31,172 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 1.21 sec
    MapReduce Total cumulative CPU time: 1 seconds 210 msec
    Ended Job = job_201312042044_0024
    MapReduce Jobs Launched:
    Job 0: Map: 1   Cumulative CPU: 1.21 sec   HDFS Read: 306 HDFS Write: 188 SUCCESS
    Total MapReduce CPU Time Spent: 1 seconds 210 msec
    OK
    _c0
    CN    China    02    Zhejiang    Hangzhou    30.293594    120.16141    Asia/Shanghai
    CN    China    02    Zhejiang    Wenzhou    27.999405    120.66681    Asia/Shanghai
    CN    China    02    Zhejiang    Ningbo    29.878204    121.5495    Asia/Shanghai
    Time taken: 47.517 seconds
    OK
    ip    countrycode    countryname    region    regionname    city    latitude    longitude    timezone
    221.12.10.218    CN    China    02    Zhejiang    Hangzhou    30.293594    120.16141    Asia/Shanghai
    60.180.248.201    CN    China    02    Zhejiang    Wenzhou    27.999405    120.66681    Asia/Shanghai
    125.111.251.118    CN    China    02    Zhejiang    Ningbo    29.878204    121.5495    Asia/Shanghai
    Time taken: 0.441 seconds
    landen@Master:~/UntarFile/hive-0.10.0$

    hive (stuchoosecourse)> source /home/landen/文档/testSql.q(执行SQL文件);
    Total MapReduce jobs = 1
    Launching Job 1 out of 1
    Number of reduce tasks is set to 0 since there's no reduce operator
    Starting Job = job_201312042044_0025, Tracking URL = http://Master:50030/jobdetails.jsp?jobid=job_201312042044_0025
    Kill Command = /home/landen/UntarFile/hadoop-1.0.4/libexec/../bin/hadoop job  -kill job_201312042044_0025
    Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
    2013-12-09 15:04:16,330 Stage-1 map = 0%,  reduce = 0%
    2013-12-09 15:04:25,390 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 2.39 sec
    2013-12-09 15:04:26,420 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 2.39 sec
    2013-12-09 15:04:27,455 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 2.39 sec
    2013-12-09 15:04:28,467 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 2.39 sec
    2013-12-09 15:04:29,470 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 2.39 sec
    2013-12-09 15:04:30,479 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 2.39 sec
    2013-12-09 15:04:31,485 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 2.39 sec
    MapReduce Total cumulative CPU time: 2 seconds 390 msec
    Ended Job = job_201312042044_0025
    MapReduce Jobs Launched:
    Job 0: Map: 1   Cumulative CPU: 2.39 sec   HDFS Read: 306 HDFS Write: 188 SUCCESS
    Total MapReduce CPU Time Spent: 2 seconds 390 msec
    OK
    _c0
    CN    China    02    Zhejiang    Hangzhou    30.293594    120.16141    Asia/Shanghai
    CN    China    02    Zhejiang    Wenzhou    27.999405    120.66681    Asia/Shanghai
    CN    China    02    Zhejiang    Ningbo    29.878204    121.5495    Asia/Shanghai
    Time taken: 72.463 seconds
    OK
    ip    countrycode    countryname    region    regionname    city    latitude    longitude    timezone
    221.12.10.218    CN    China    02    Zhejiang    Hangzhou    30.293594    120.16141    Asia/Shanghai
    60.180.248.201    CN    China    02    Zhejiang    Wenzhou    27.999405    120.66681    Asia/Shanghai
    125.111.251.118    CN    China    02    Zhejiang    Ningbo    29.878204    121.5495    Asia/Shanghai
    Time taken: 0.133 seconds

    hive (default)> add file /home/landen/UntarFile/GeoIP/GeoLiteCity.dat;
    Added resource: /home/landen/UntarFile/GeoIP/GeoLiteCity.dat
    hive (default)> add jar /home/landen/UntarFile/hive-0.10.0/lib/IPTocc.jar jar1 jar2 ...;
    Added /home/landen/UntarFile/hive-0.10.0/lib/IPTocc.jar to class path
    Added resource: /home/landen/UntarFile/hive-0.10.0/lib/IPTocc.jar
    hive (default)> create temporary function IP4Tocc as 'org.hadoop.hive.additionalUDF.IPToCC';

    hive (stuchoosecourse)> list jars;
    /home/landen/UntarFile/hive-0.10.0/lib/IPTocc.jar
    file:/home/landen/UntarFile/hive-0.10.0/lib/hive-builtins-0.10.0.jar
    hive (stuchoosecourse)> show tables '*ip*';
    OK
    tab_name
    hiddenipinfo
    ipidentifier
    Time taken: 3.727 seconds
    hive (stuchoosecourse)>

    其它相关hive cli操作:http://www.cnblogs.com/tangtianfly/archive/2012/11/02/2751815.html

  • 相关阅读:
    取2个日期间的天数
    C#代码与JAVASCRIPT函数的相互调用
    ASP.NET验证码(3种)
    VS2008自带SQL 2005如何使用
    文本框默认有一个值,然后鼠标点上去那个值就清空
    远程桌面连接会话超时或者被限制改组策略也没用的时候就这么解决
    关于CComboBox的使用,编辑项的文字
    vc 剪切板 unicode
    Linux 防火墙、SELinux 的开启和关闭
    MSSQLSERVER服务不能启动
  • 原文地址:https://www.cnblogs.com/likai198981/p/3465461.html
Copyright © 2020-2023  润新知