• Hive扩展功能(八)--表的索引


    软件环境:

    linux系统: CentOS6.7
    Hadoop版本: 2.6.5
    zookeeper版本: 3.4.8
    

    ##主机配置: #####一共m1, m2, m3这三部机, 每部主机的用户名都为centos ``` 192.168.179.201: m1 192.168.179.202: m2 192.168.179.203: m3

    m1: Zookeeper, Namenode, DataNode, ResourceManager, NodeManager, Master, Worker
    m2: Zookeeper, Namenode, DataNode, ResourceManager, NodeManager, Worker
    m3: Zookeeper, DataNode, NodeManager, Worker

    
    
    
    
    ####资料
    

    官方资料:
    https://cwiki.apache.org/confluence/display/Hive/IndexDev
    https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-Create/Drop/AlterIndex

    
    
    ---
    <br>
    <br>
    ####一. 编辑hive-site.xml文件
    
    hive.optimize.index.filter true hive.optimize.index.groupby true hive.index.compact.file.ignore.hdfs true ```




    ####二. 创建Hive表索引 ``` 官方资料: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Indexing ```

    1.创建/构造, 显示, 删除索引:

    create index table01_index on table table01 (column2) as 'compact';
    show index on table01;
    drop index table01_index on table01;
    

    2.创建时重构, 格式化显示 (with column names), 删除索引:

    create index table02_index on table table02 (column3) as 'compact' with deferred rebuild;
    alter index table02_index on table2 rebuild;
    show formatted index on table02;
    drop index table02_index on table02;
    

    3.创建索引视图, 构建, 显示, 删除:

    create index table03_index on table table03 (column4) as 'bitmap' with deferred rebuild;
    alter index table03_index on table03 rebuild;
    show formatted index on table03;
    drop index table03_index on table03;
    

    4.在新表中创建索引:

    create index table04_index on table table04 (column5) as 'compact' with deferred rebuild in table table04_index_table;
    

    5.创建索引以RCFile的存储格式:

    create index table05_index on table table05 (column6) as 'compact' stored as RCFile;
    

    6.创建索引以TextFile的存储格式:

    create index table06_index on table table06 (column7) as 'compact' row format delimited fields terminated by '	' stored as textFile;
    

    7.创建索引和索引的属性:

    create index table07_index on table table07 (column8) as 'COMPACT' idxproperties ("prop1"="value1", "prop2"="value2");
    

    8.创建索引和表的属性:

    create index table08_index on table table08 (column9) as 'compact' tblproperties ("prop3"="value3", "prop4"="value4");
    

    9.索引如果存在则删除:

    drop index if exists table09_index on table09;
    

    10.重构一个分区的数据:

    alter index table10_index on table10 partition (columnX='valueQ', columnY='valueR') rebuild;
    





  • 相关阅读:
    最小生成树之prim算法
    洛谷P1443 马的遍历【BFS】
    (四)学习CSS之position、bottom、left、right和top属性
    (三)学习CSS之opacity 属性
    (二)学习CSS之cursor属性
    (一)学习CSS之z-index属性
    (八)学习MVC之三级联动
    (七)学习MVC之CodeFirst迁移更新数据库
    (六)学习MVC之标签a提交页面
    (四)学习MVC之修改个人资料和身份验证登陆
  • 原文地址:https://www.cnblogs.com/qifengle-2446/p/6424601.html
Copyright © 2020-2023  润新知