有时候,我们须要读取一些数据,而无论这数据来源于磁盘上的数据文件,还是来源于网络上的数据。于是。就有了以下的 StringExtensions.cs:
1 using System; 2 using System.IO; 3 using System.Net; 4 5 namespace Skyiv 6 { 7 public static class StringExtensions 8 { 9 public static Stream GetInputStream(this string fileNameOrUri, string user = null, string password = null) 10 { 11 if (!Uri.IsWellFormedUriString(fileNameOrUri, UriKind.Absolute)) return File.OpenRead(fileNameOrUri); 12 var uri = new Uri(fileNameOrUri); 13 if (uri.Scheme == Uri.UriSchemeHttp || uri.Scheme == Uri.UriSchemeHttps) return uri.GetHttpStream(); 14 if (uri.Scheme == Uri.UriSchemeFtp) return uri.GetFtpStream(user, password); 15 if (uri.Scheme == Uri.UriSchemeFile) return uri.GetFileStream(); 16 throw new NotSupportedException("Notsupported uri scheme: " + uri.Scheme); 17 } 18 19 static Stream GetFtpStream(this Uri uri, string user = null, string password = null) 20 { 21 var ftp = (FtpWebRequest)WebRequest.Create(uri); 22 if (user != null && user != "anonymous" && user != "ftp") 23 ftp.Credentials = new NetworkCredential(user, password); 24 ftp.Method = WebRequestMethods.Ftp.DownloadFile; 25 return ((FtpWebResponse)ftp.GetResponse()).GetResponseStream(); 26 } 27 28 static Stream GetHttpStream(this Uri uri) 29 { 30 return ((HttpWebResponse)((HttpWebRequest)WebRequest.Create(uri)).GetResponse()).GetResponseStream(); 31 } 32 33 static Stream GetFileStream(this Uri uri) 34 { 35 return ((FileWebResponse)((FileWebRequest)WebRequest.Create(uri)).GetResponse()).GetResponseStream(); 36 } 37 } 38 }
上述程序中:
- 第 9 到 17 行的 GetInputStream 扩展方法返回来读取的数据的输入流。
- 第 11 行调用 Uri 类的静态方法 IsWellFormedUriString 推断是否从网络上读取数据。如不是。则直接调用 File 类的静态方法 OpenRead 得到输入流。
- 第 12 行构造一个 Uri 类的实例。
- 第 13 行处理输入使用 http 或者 https 协议的情况。
- 第 14 行处理输入使用 ftp 协议的情况。
- 第 15 行处理输入使用 file 协议的情况。
- 第 16 行处理其它协议。就是直接抛出一个 NotSupportedException 异常。表示我们仅仅支持上述四种协议。
- 第 19 到 26 行的 GetFtpStream 扩展方法用于获得 FTP server上发送的响应数据的输入流。能够是匿名的。也能够是非匿名的。
- 第 28 到 31 行的 GetHttpStream 扩展方法用于获得使用 http 或者 https 协议的网络流。
- 第 33 到 36 行的 GetFileStream 扩展方法用于获得使用 file 协议的本地磁盘文件系统的数据流。
以下就是測试用的 CopyTester.cs:
1 using System.IO; 2 3 namespace Skyiv.Test 4 { 5 static class CopyTester 6 { 7 static void Main(string[] args) 8 { 9 args[0].GetInputStream().CopyTo(File.Create(args[1])); 10 } 11 } 12 }
这个測试程序的功能就是拷贝数据,须要两个命令行參数:
- 第一个命令行參数指定数据来源,能够是本地磁盘文件。也能够是网络数据,支持 https、http、ftp 和 file 协议,当然,file 协议实际上还是读取本地磁盘文件。
- 第二个命令行參数指定将要复制到的本地磁盘文件的名称。
上述測试程序实质内容就是第 9 行的语句:
- 使用第一个命令行參数 args[0] 调用 String 类的 GetInputStream 扩展方法得到输入流。
- 调用 Stream 类的 CopyTo 方法将输入流复制到输出流。
- 输出流是使用 File 类的静态方法 Create 得到的。
在 Windows 操作系统中编译和执行:
E:work> csc CopyTester.cs StringExtensions.cs Microsoft(R) Visual C# 2010 编译器 4.0.30319.1 版 版权全部(C) Microsoft Corporation。保留全部权利。 E:work> CopyTester https://github.com/mono/xsp/zipball/master mono-xsp.zip E:work> CopyTester http://mysql.ntu.edu.tw/Downloads/Connector-Net/mysql-connector-net-6.5.4-noinstall.zip mysql-connector.zip E:work> CopyTester ftp://ftp.ntu.edu.tw/pub/MySQL/Downloads/Connector-Net/mysql-connector-net-6.5.4-noinstall.zip mysql-connector.2.zip E:work> CopyTester file:///E:/work/mysql-connector.zip mysql-connector.3.zip E:work> CopyTester mysql-connector.zip mysql-connector.4.zip E:work> dir *.zip 2012/03/11 09:35 468,024 mono-xsp.zip 2012/03/11 09:37 4,176,361 mysql-connector.2.zip 2012/03/11 09:38 4,176,361 mysql-connector.3.zip 2012/03/11 09:38 4,176,361 mysql-connector.4.zip 2012/03/11 09:36 4,176,361 mysql-connector.zip
上面分别測试了以 https、http、ftp、file 协议读取网络数据,以及从本地磁盘上读取数据。注意。file 协议实际上还是从本地磁盘读取数据。
在 Linux 操作系统中编译和执行:
ben@vbox:~/work> dmcs CopyTester.cs StringExtensions.cs ben@vbox:~/work> mono CopyTester.exe http://mysql.ntu.edu.tw/Downloads/Connector-Net/mysql-connector-net-6.5.4-noinstall.zip mysql-connector.zip ben@vbox:~/work> mono CopyTester.exe ftp://ftp.ntu.edu.tw/pub/MySQL/Downloads/Connector-Net/mysql-connector-net-6.5.4-noinstall.zip mysql-connector.2.zip ben@vbox:~/work> mono CopyTester.exe file:///home/ben/work/mysql-connector.zip mysql-connector.3.zip ben@vbox:~/work> mono CopyTester.exe mysql-connector.zip mysql-connector.4.zip ben@vbox:~/work> ls -l *.zip -rw-r--r-- 1 ben users 4176361 Mar 11 09:54 mysql-connector.2.zip -rw-r--r-- 1 ben users 4176361 Mar 11 10:01 mysql-connector.3.zip -rw-r--r-- 1 ben users 4176361 Mar 11 10:01 mysql-connector.4.zip -rw-r--r-- 1 ben users 4176361 Mar 11 09:53 mysql-connector.zip
在 Windows 操作系统能够正常读取网络上的 https 数据流,在 Linux 操作系统中会失败:
ben@vbox:~/work> mono CopyTester.exe https://github.com/mono/xsp/zipball/master mono-xsp.zip Unhandled Exception: System.Net.WebException: Error getting response stream (Write: The authentication or decryption has failed.): SendFailure ---> System.IO.IOException: The authentication or decryption has failed. ---> Mono.Security.Protocol.Tls.TlsException: Invalid certificate received from server. Error code: 0xffffffff800b010a at Mono.Security.Protocol.Tls.Handshake.Client.TlsServerCertificate.validateCertificates (Mono.Security.X509.X509CertificateCollection certificates) [0x00000] in :0 at Mono.Security.Protocol.Tls.Handshake.Client.TlsServerCertificate.ProcessAsTls1 () [0x00000] in :0 at Mono.Security.Protocol.Tls.Handshake.HandshakeMessage.Process () [0x00000] in :0 at (wrapper remoting-invoke-with-check) Mono.Security.Protocol.Tls.Handshake.HandshakeMessage:Process () at Mono.Security.Protocol.Tls.ClientRecordProtocol.ProcessHandshakeMessage (Mono.Security.Protocol.Tls.TlsStream handMsg) [0x00000] in :0 at Mono.Security.Protocol.Tls.RecordProtocol.InternalReceiveRecordCallback (IAsyncResult asyncResult) [0x00000] in :0 --- End of inner exception stack trace --- at Mono.Security.Protocol.Tls.SslStreamBase.AsyncHandshakeCallback (IAsyncResult asyncResult) [0x00000] in :0 --- End of inner exception stack trace --- at System.Net.HttpWebRequest.EndGetResponse (IAsyncResult asyncResult) [0x00000] in :0 at System.Net.HttpWebRequest.GetResponse () [0x00000] in :0 at Skyiv.StringExtensions.GetHttpStream (System.Uri uri) [0x00000] in :0 at Skyiv.StringExtensions.GetInputStream (System.String fileNameOrUri, System.String user, System.String password) [0x00000] in :0 at Skyiv.Test.CopyTester.Main (System.String[] args) [0x00000] in :0 [ERROR] FATAL UNHANDLED EXCEPTION: System.Net.WebException: Error getting response stream (Write: The authentication or decryption has failed.): SendFailure ---> System.IO.IOException: The authentication or decryption has failed. ---> Mono.Security.Protocol.Tls.TlsException: Invalid certificate received from server. Error code: 0xffffffff800b010a at Mono.Security.Protocol.Tls.Handshake.Client.TlsServerCertificate.validateCertificates (Mono.Security.X509.X509CertificateCollection certificates) [0x00000] in :0 at Mono.Security.Protocol.Tls.Handshake.Client.TlsServerCertificate.ProcessAsTls1 () [0x00000] in :0 at Mono.Security.Protocol.Tls.Handshake.HandshakeMessage.Process () [0x00000] in :0 at (wrapper remoting-invoke-with-check) Mono.Security.Protocol.Tls.Handshake.HandshakeMessage:Process () at Mono.Security.Protocol.Tls.ClientRecordProtocol.ProcessHandshakeMessage (Mono.Security.Protocol.Tls.TlsStream handMsg) [0x00000] in :0 at Mono.Security.Protocol.Tls.RecordProtocol.InternalReceiveRecordCallback (IAsyncResult asyncResult) [0x00000] in :0 --- End of inner exception stack trace --- at Mono.Security.Protocol.Tls.SslStreamBase.AsyncHandshakeCallback (IAsyncResult asyncResult) [0x00000] in :0 --- End of inner exception stack trace --- at System.Net.HttpWebRequest.EndGetResponse (IAsyncResult asyncResult) [0x00000] in :0 at System.Net.HttpWebRequest.GetResponse () [0x00000] in :0 at Skyiv.StringExtensions.GetHttpStream (System.Uri uri) [0x00000] in :0 at Skyiv.StringExtensions.GetInputStream (System.String fileNameOrUri, System.String user, System.String password) [0x00000] in :0 at Skyiv.Test.CopyTester.Main (System.String[] args) [0x00000] in :0
不知道是不是我的 openSUSE 12.1 操作系统或者是 Mono 2.10.6 执行环境还须要进行一些配置,以便满足 https 的安全验证要求。可是我在 Windows 操作系统中也没有进行特别的配置。并且在 Linux 操作系统中使用 wget 命令也可下面载 https 协议的数据:
ben@vbox:~/work> wget https://github.com/mono/xsp/zipball/master asking libproxy about url 'https://github.com/mono/xsp/zipball/master' libproxy suggest to use 'direct://' --2012-03-11 13:48:32-- https://github.com/mono/xsp/zipball/master Resolving github.com (github.com)... 207.97.227.239 Connecting to github.com (github.com)|207.97.227.239|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://nodeload.github.com/mono/xsp/zipball/master [following] asking libproxy about url 'https://nodeload.github.com/mono/xsp/zipball/master' libproxy suggest to use 'direct://' --2012-03-11 13:48:34-- https://nodeload.github.com/mono/xsp/zipball/master Resolving nodeload.github.com (nodeload.github.com)... 207.97.227.252 Connecting to nodeload.github.com (nodeload.github.com)|207.97.227.252|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 468024 (457K) [application/octet-stream] Saving to: `master' 100%[======================================>] 468,024 46.5K/s in 17s 2012-03-11 13:48:54 (27.0 KB/s) - `master' saved [468024/468024] ben@vbox:~/work> mv master mono-xsp.zip
这样看来。Mono 环境的 HttpWebRequest 类可能须要进行一些设置才干读取 https 协议的数据。
假设有哪位园友知道的话,请在本文的评论里告诉我,谢谢。