• Hadoop中Writable和WritableComparable区别


    Hadoop的key和value的传递序列化需要涉及两个重要的接口Writable和WritableComparable

    1> Writable:

    Java代码
    1. void write(DataOutput out) throws IOException; 
    2. void readFields(DataInput in) throws IOException; 

    也就是读数据和写数据的方式

    2> WritableComparable:

    Java代码
    1. WritableComparable<T> extends Writable, Comparable<T> 
    Java代码
    1. publicinterface Comparable<T> { 
    2.     publicint compareTo(T o); 

          也就是比Writable多了一个compareTo方法,这个的用途是是为了确定是不是相同的key,因此得出如下结论:

    hadoop为Key的数据类型必须实现WritableComparable,而Value的数据类型只需要实现Writable即可,能做Key的一定可以做Value,能做Value的未必能做Key.

    常用的WritableComparable实现如下:

    Java代码
    1. org.apache.hadoop.io.NullWritable; 
    2. org.apache.hadoop.io.BooleanWritable; 
    3. org.apache.hadoop.io.BytesWritable; 
    4. org.apache.hadoop.io.DoubleWritable; 
    5. org.apache.hadoop.io.FloatWritable; 
    6. org.apache.hadoop.io.IntWritable; 
    7. org.apache.hadoop.io.LongWritable; 
    8. org.apache.hadoop.io.MD5Hash; 
    9. org.apache.hadoop.io.Text; 
    10. org.apache.hadoop.io.UTF8; 
    11. org.apache.hadoop.io.VIntWritable; 
    12. org.apache.hadoop.io.VLongWritable; 

    常用的Writable实现如下(除了上述的):

    Java代码
    1. org.apache.hadoop.io.TwoDArrayWritable; 
    2. org.apache.hadoop.io.SortedMapWritable; 
    3. org.apache.hadoop.io.ObjectWritable; 
    4. org.apache.hadoop.io.MapWritable; 
    5. org.apache.hadoop.io.ArrayWritable;
  • 相关阅读:
    初探diskstats
    JVM参数简述
    304 Not Modified 简述
    vmstat命令
    iostat 工具分析I/O性能
    git添加公钥后报错sign_and_send_pubkey: signing failed: agent refused operation
    Mysql ibdata1简述
    Mysql 事务日志(Ib_logfile)
    django项目一:基于django2.2可重用登录与注册模块-前端页面配置
    django项目一:基于django2.2可重用登录与注册模块-url路由和视图
  • 原文地址:https://www.cnblogs.com/likai198981/p/3112531.html
Copyright © 2020-2023  润新知