• Java / Android H基于ttp多线程下载的实现


    转载请注明出处:http://blog.csdn.net/lmj623565791/article/details/26994463

    有个朋友须要个多线程如今的样例,就帮忙实现了。在此分享下~

    先说下原理,原理明确了,事实上非常easy:

    a、对于网络上的一个资源,首先发送一个请求,从返回的Content-Length中回去须要下载文件的大小。然后依据文件大小创建一个文件。

    this.fileSize = conn.getContentLength();// 依据响应获取文件大小
    File dir = new File(dirStr);
    this.localFile = new File(dir, filename);
    RandomAccessFile raf = new RandomAccessFile(this.localFile, "rw");
    raf.setLength(fileSize);
    raf.close();

    b、依据线程数和文件大小。为每一个线程分配下载的字节区间,然后每一个线程向server发送请求。获取这段字节区间的文件内容。

    conn.setRequestProperty("Range", "bytes=" + startPos + "-"
    						+ endPos);// 设置获取实体数据的范围

    c、利用RandomAccessFile的seek方法,多线程同一时候往一个文件里写入字节。

    raf.seek(startPos);
    while ((len = is.read(buf)) != -1)
    {
    	raf.write(buf, 0, len);
    }
    分析完了原理就非常easy了。我封装了一个类,利用这个类的实例进行下载。所需參数:下载资源的URI, 本地文件路径,线程的数量。

    package com.zhy.mutilthread_download;
    
    import java.io.File;
    import java.io.IOException;
    import java.io.InputStream;
    import java.io.RandomAccessFile;
    import java.net.HttpURLConnection;
    import java.net.URL;
    
    public class MultipartThreadDownloador
    {
    
    	/**
    	 * 须要下载资源的地址
    	 */
    	private String urlStr;
    	/**
    	 * 下载的文件
    	 */
    	private File localFile;
    	/**
    	 * 须要下载文件的存放的本地目录路径
    	 */
    	private String dirStr;
    	/**
    	 * 存储到本地的文件名称
    	 */
    	private String filename;
    
    	/**
    	 * 开启的线程数量
    	 */
    	private int threadCount;
    	/**
    	 * 下载文件的大小
    	 */
    	private long fileSize;
    
    	public MultipartThreadDownloador(String urlStr, String dirStr,
    			String filename, int threadCount)
    	{
    		this.urlStr = urlStr;
    		this.dirStr = dirStr;
    		this.filename = filename;
    		this.threadCount = threadCount;
    	}
    
    	public void download() throws IOException
    	{
    		createFileByUrl();
    
    		/**
    		 * 计算每一个线程须要下载的数据长度
    		 */
    		long block = fileSize % threadCount == 0 ? fileSize / threadCount
    				: fileSize / threadCount + 1;
    
    		for (int i = 0; i < threadCount; i++)
    		{
    			long start = i * block;
    			long end = start + block >= fileSize ? fileSize : start + block - 1;
    
    			new DownloadThread(new URL(urlStr), localFile, start, end).start();
    		}
    
    	}
    
    	/**
    	 * 依据资源的URL获取资源的大小,以及在本地创建文件
    	 */
    	public void createFileByUrl() throws IOException
    	{
    		URL url = new URL(urlStr);
    		HttpURLConnection conn = (HttpURLConnection) url.openConnection();
    		conn.setConnectTimeout(15 * 1000);
    		conn.setRequestMethod("GET");
    		conn.setRequestProperty(
    				"Accept",
    				"image/gif, image/jpeg, image/pjpeg, image/pjpeg, application/x-shockwave-flash, application/xaml+xml, application/vnd.ms-xpsdocument, application/x-ms-xbap, application/x-ms-application, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, */*");
    		conn.setRequestProperty("Accept-Language", "zh-CN");
    		conn.setRequestProperty("Referer", urlStr);
    		conn.setRequestProperty("Charset", "UTF-8");
    		conn.setRequestProperty(
    				"User-Agent",
    				"Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.2; Trident/4.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)");
    		conn.setRequestProperty("Connection", "Keep-Alive");
    		conn.connect();
    
    		if (conn.getResponseCode() == 200)
    		{
    			this.fileSize = conn.getContentLength();// 依据响应获取文件大小
    			if (fileSize <= 0)
    				throw new RuntimeException(
    						"the file that you download has a wrong size ... ");
    			File dir = new File(dirStr);
    			if (!dir.exists())
    				dir.mkdirs();
    			this.localFile = new File(dir, filename);
    			RandomAccessFile raf = new RandomAccessFile(this.localFile, "rw");
    			raf.setLength(fileSize);
    			raf.close();
    
    			System.out.println("须要下载的文件大小为 :" + this.fileSize + " , 存储位置为: "
    					+ dirStr + "/" + filename);
    
    		} else
    		{
    			throw new RuntimeException("url that you conneted has error ...");
    		}
    	}
    
    	private class DownloadThread extends Thread
    	{
    		/**
    		 * 下载文件的URI
    		 */
    		private URL url;
    		/**
    		 * 存的本地路径
    		 */
    		private File localFile;
    		/**
    		 * 是否结束
    		 */
    		private boolean isFinish;
    		/**
    		 * 開始的位置
    		 */
    		private Long startPos;
    		/**
    		 * 结束位置
    		 */
    		private Long endPos;
    
    		public DownloadThread(URL url, File savefile, Long startPos, Long endPos)
    		{
    			this.url = url;
    			this.localFile = savefile;
    			this.startPos = startPos;
    			this.endPos = endPos;
    		}
    
    		@Override
    		public void run()
    		{
    			System.out.println(Thread.currentThread().getName() + "開始下载...");
    			try
    			{
    				HttpURLConnection conn = (HttpURLConnection) url
    						.openConnection();
    				conn.setConnectTimeout(15 * 1000);
    				conn.setRequestMethod("GET");
    				conn.setRequestProperty(
    						"Accept",
    						"image/gif, image/jpeg, image/pjpeg, image/pjpeg, application/x-shockwave-flash, application/xaml+xml, application/vnd.ms-xpsdocument, application/x-ms-xbap, application/x-ms-application, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, */*");
    				conn.setRequestProperty("Accept-Language", "zh-CN");
    				conn.setRequestProperty("Referer", url.toString());
    				conn.setRequestProperty("Charset", "UTF-8");
    				conn.setRequestProperty("Range", "bytes=" + startPos + "-"
    						+ endPos);// 设置获取实体数据的范围
    
    				conn.setRequestProperty(
    						"User-Agent",
    						"Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.2; Trident/4.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)");
    				conn.setRequestProperty("Connection", "Keep-Alive");
    				conn.connect();
    
    				/**
    				 * 代表server已经成功处理了部分GET请求
    				 */
    				if (conn.getResponseCode() == 206)
    				{
    					InputStream is = conn.getInputStream();
    					int len = 0;
    					byte[] buf = new byte[1024];
    
    					RandomAccessFile raf = new RandomAccessFile(localFile,
    							"rwd");
    					raf.seek(startPos);
    					while ((len = is.read(buf)) != -1)
    					{
    						raf.write(buf, 0, len);
    					}
    					raf.close();
    					is.close();
    					System.out.println(Thread.currentThread().getName()
    							+ "完毕下载  : " + startPos + " -- " + endPos);
    					this.isFinish = true;
    				} else
    				{
    					throw new RuntimeException(
    							"url that you conneted has error ...");
    				}
    			} catch (IOException e)
    			{
    				e.printStackTrace();
    			}
    		}
    
    	}
    
    	
    
    }
    

    createFileByUrl方法,就是我们上述的原理的步骤1。得到文件大小和创建本地文件。

    我在程序使用了一个内部类DownloadThread继承Thread,专门负责下载。download()方法,依据线程数量和文件大小计算每一个线程须要下载的字节区间。然后开启线程去下载。

    server端:我就扔了几个文件在Tomcat根文件夹做实验,以下是測试代码:

    package com.zhy.mutilthread_download;
    
    import java.io.IOException;
    
    public class Test
    {
    
    	public static void main(String[] args)
    	{
    		try
    		{
    			new MultipartThreadDownloador("http://localhost:8080/nexus.zip",
    					"f:/backup/nexus", "nexus.zip", 2).download();
    		} catch (IOException e)
    		{
    			e.printStackTrace();
    		}
    
    	}
    }
    

    输出结果:

    须要下载的文件大小为 :31143237 , 存储位置为: f:/backup/nexus/nexus.zip
    Thread-1開始下载...
    Thread-2開始下载...
    Thread-3開始下载...
    Thread-4開始下载...
    Thread-4完毕下载  : 23357430 -- 31143237
    Thread-2完毕下载  : 7785810 -- 15571619
    Thread-1完毕下载  : 0 -- 7785809
    Thread-3完毕下载  : 15571620 -- 23357429
    

    截图:



    ok,多线程下载介绍完成,假设代码设计不合理,以及方法使用错误。欢迎各位留言。。。



    源代码点击下载



    版权声明:本文博主原创文章,博客,未经同意不得转载。

  • 相关阅读:
    (暂时弃坑)(半成品)ACM数论之旅18---反演定理 第二回 Mobius反演(莫比乌斯反演)((づ ̄3 ̄)づ天才第一步,雀。。。。)
    ACM数论之旅17---反演定理 第一回 二项式反演(神说要有光 于是就有了光(´・ω・`))
    ACM数论之旅16---母函数(又名生成函数)(痛并快乐着(╭ ̄3 ̄)╭)
    (暂时弃坑)ACM数论之旅15---置换群与Polya定理(我把标题看成poi了,poipoipoi(*≧▽≦)ツ)
    ACM数论之旅14---抽屉原理,鸽巢原理,球盒原理(叫法不一又有什么关系呢╮(╯▽╰)╭)
    ACM数论之旅13---容斥原理(一切都是命运石之门的选择(=゚ω゚)ノ)
    ACM数论之旅12---康托展开((*゚▽゚*)装甲展开,主推进器启动,倒计时3,2,1......)
    还有哪些东西要写눈_눈
    ACM数论之旅11---浅谈指数与对数(长篇)(今天休息,不学太难的数论> 3<)
    ACM数论之旅10---大组合数-卢卡斯定理(在下卢卡斯,你是我的Master吗?(。-`ω´-) )
  • 原文地址:https://www.cnblogs.com/hrhguanli/p/4853098.html
Copyright © 2020-2023  润新知