• Hadoop 从URL中读取数据


    package com.hadoop;
    
    import java.io.IOException;
    import java.io.InputStream;
    import java.net.URL;
    
    import org.apache.hadoop.fs.FsUrlStreamHandlerFactory;
    import org.apache.hadoop.io.IOUtils;
    
    public class URLCat {
    
    	static {
    		URL.setURLStreamHandlerFactory(new FsUrlStreamHandlerFactory());
    	}
    	
    	public static void main(String[] args) throws Exception, IOException {
    		
    		InputStream in = null;
    		try {
    			in = new URL(args[0]).openStream();
    			IOUtils.copyBytes(in, System.out, 4096,false);
    		} finally {
    			IOUtils.closeStream(in);
    		}
    	}
    }
    

     hadoop中运行:

     

  • 相关阅读:
    day06
    day05
    day04
    day03
    day02
    day01
    python-study-42
    OI 知识总览 算法篇 之 图论
    OI 知识总览 算法篇 之 基础算法
    [CSP2019-JX] 散步 解题报告
  • 原文地址:https://www.cnblogs.com/yixiwenwen/p/5587906.html
Copyright © 2020-2023  润新知