• 【原创】大数据基础之Hive(4)hive元数据库核心表结构


    1 dbs

    +-------+-----------------------+----------------------------------------------+------------+------------+------------+
    | DB_ID | DESC | DB_LOCATION_URI | NAME | OWNER_NAME | OWNER_TYPE |
    +-------+-----------------------+----------------------------------------------+------------+------------+------------+
    key columns:DB_ID

    1.1 database_params

    2 tbls

    +--------+-------------+-------+------------------+-----------+-----------+-------+---------------------------+----------------+--------------------+--------------------+--------------------+
    | TBL_ID | CREATE_TIME | DB_ID | LAST_ACCESS_TIME | OWNER | RETENTION | SD_ID | TBL_NAME | TBL_TYPE | VIEW_EXPANDED_TEXT | VIEW_ORIGINAL_TEXT | IS_REWRITE_ENABLED |
    +--------+-------------+-------+------------------+-----------+-----------+-------+---------------------------+----------------+--------------------+--------------------+--------------------+
    key columns:TBL_ID, DB_ID, SD_ID

    2.1 table_params

    +--------+-----------------------------+-------------+
    | TBL_ID | PARAM_KEY | PARAM_VALUE |
    +--------+-----------------------------+-------------+

    3 partitions

    +---------+-------------+------------------+-------------+-------+--------+
    | PART_ID | CREATE_TIME | LAST_ACCESS_TIME | PART_NAME | SD_ID | TBL_ID |
    +---------+-------------+------------------+-------------+-------+--------+
    key columns:PART_ID, SD_ID, TBL_ID

    3.1 partition_params

    4 sds

    +-------+-------+--------------------------------------------------+---------------+---------------------------+-----------------------------------------------------------------+-------------+------------------------------------------------------------+----------+
    | SD_ID | CD_ID | INPUT_FORMAT | IS_COMPRESSED | IS_STOREDASSUBDIRECTORIES | LOCATION | NUM_BUCKETS | OUTPUT_FORMAT | SERDE_ID |
    +-------+-------+--------------------------------------------------+---------------+---------------------------+-----------------------------------------------------------------+-------------+------------------------------------------------------------+----------+
    key columns:SD_ID, CD_ID, SERDE_ID

    4.1 sd_params

    5 serdes

    +----------+------+----------------------------------------------------+
    | SERDE_ID | NAME | SLIB |
    +----------+------+----------------------------------------------------+
    key columns:SERDE_ID

    5.1 serde_params

    6 cds

    +-------+
    | CD_ID |
    +-------+
    key columns:CD_ID

    7 column2_v2

    +-------+---------+-------------+-----------+-------------+
    | CD_ID | COMMENT | COLUMN_NAME | TYPE_NAME | INTEGER_IDX |
    +-------+---------+-------------+-----------+-------------+
    key columns:CD_ID

    8 version

    +--------+----------------+---------------------------------------+
    | VER_ID | SCHEMA_VERSION | VERSION_COMMENT |
    +--------+----------------+---------------------------------------+

    9 all tables

    +--------------------------------+
    | aux_table |
    | bucketing_cols |
    | cds |
    | columns_v2 |
    | compaction_queue |
    | completed_compactions |
    | completed_txn_components |
    | database_params |
    | db_privs |
    | dbs |
    | delegation_tokens |
    | func_ru |
    | funcs |
    | global_privs |
    | hadoopfslsr |
    | hive_locks |
    | idxs |
    | index_params |
    | key_constraints |
    | master_keys |
    | next_compaction_queue_id |
    | next_lock_id |
    | next_txn_id |
    | notification_log |
    | notification_sequence |
    | nucleus_tables |
    | part_col_privs |
    | part_col_stats |
    | part_privs |
    | partition_events |
    | partition_key_vals |
    | partition_keys |
    | partition_params |
    | partitions |
    | role_map |
    | roles |
    | sd_params |
    | sds |
    | sequence_table |
    | serde_params |
    | serdes |
    | skewed_col_names |
    | skewed_col_value_loc_map |
    | skewed_string_list |
    | skewed_string_list_values |
    | skewed_values |
    | sort_cols |
    | tab_col_stats |
    | table_params |
    | tbl_col_privs |
    | tbl_privs |
    | tbls |
    | txn_components |
    | txns |
    | type_fields |
    | types |
    | v_du_sh |
    | version |
    | write_set |
    +--------------------------------+

  • 相关阅读:
    Python爬虫入门教程 43-100 百思不得姐APP数据-手机APP爬虫部分
    也谈PostgreSQL的Vacuum机制及其最佳实践
    django.core.exceptions.ImproperlyConfigured: Requested setting INSTALLED_APPS
    Error: Invalid CSS after
    win32-x64-64inding.node is not a valid Win32 application
    Error: Module did not self-register
    数据分析|如何利用BI工具,探索各商品的潜在关联价值
    Python爬虫入门教程 42-100 爬取儿歌多多APP数据-手机APP爬虫部分
    Retrofit的文件上传和进度提示
    Retrofit的文件上传和进度提示
  • 原文地址:https://www.cnblogs.com/barneywill/p/10435737.html
Copyright © 2020-2023  润新知