【问题标题】:C# code to GZip and upload a string to Amazon S3C# 代码到 GZip 并将字符串上传到 Amazon S3
【发布时间】:2011-02-17 09:56:30
【问题描述】:

我目前使用以下代码从 Amazon C# 中检索和解压缩字符串数据:

GetObjectRequest getObjectRequest = new GetObjectRequest().WithBucketName(bucketName).WithKey(key);

using (S3Response getObjectResponse = client.GetObject(getObjectRequest))
{    
    using (Stream s = getObjectResponse.ResponseStream)
    {
        using (GZipStream gzipStream = new GZipStream(s, CompressionMode.Decompress))
        {
            StreamReader Reader = new StreamReader(gzipStream, Encoding.Default);    
            string Html = Reader.ReadToEnd();
            parseFile(Html);
        }    
    }
}

我想反转此代码,以便我可以压缩字符串数据并将其上传到 S3,而无需写入磁盘。我尝试了以下方法,但出现异常:

using (AmazonS3 client = Amazon.AWSClientFactory.CreateAmazonS3Client(AWSAccessKeyID, AWSSecretAccessKeyID))
{
    string awsPath = AWSS3PrefixPath + "/" + keyName+ ".htm.gz";

    byte[] buffer = Encoding.UTF8.GetBytes(content);
    using (MemoryStream ms = new MemoryStream())
    {
        using (GZipStream zip = new GZipStream(ms, CompressionMode.Compress))
        {
            zip.Write(buffer, 0, buffer.Length);

            PutObjectRequest request = new PutObjectRequest();
            request.InputStream = ms;
            request.Key = awsPath;
            request.BucketName = AWSS3BuckenName;

            using (S3Response putResponse = client.PutObject(request))
            {
                //process response
            }
        }
    }
}

我得到的例外是:

无法访问已关闭的 Stream。

我做错了什么?

编辑:

使用 (GZipStream zip

的右括号出现异常

堆栈跟踪:

在 System.IO.MemoryStream.Write(字节[] 缓冲区,Int32 偏移量,Int32 计数)
在 System.IO.Compression.DeflateStream.Dispose(布尔值 处置)在 System.IO.Stream.Close() 在 System.IO.Compression.GZipStream.Dispose(布尔值 处置)在 System.IO.Stream.Close()

【问题讨论】:

  • 异常发生在哪里?你能添加完整的堆栈跟踪吗?
  • 谢谢。我还发布了异常详细信息

标签: c# amazon-s3 amazon-web-services


【解决方案1】:

在将其用作请求的输入之前,您需要刷新并关闭 GZipStream 并将 MemoryStream 的 Position 重置为 0:

MemoryStream ms = new MemoryStream();

using (GZipStream zip = new GZipStream(ms, CompressionMode.Compress, true))
{
    byte[] buffer = Encoding.UTF8.GetBytes(content);
    zip.Write(buffer, 0, buffer.Length);
    zip.Flush();
}

ms.Position = 0;

PutObjectRequest request = new PutObjectRequest();
request.InputStream = ms;
request.Key = AWSS3PrefixPath + "/" + keyName+ ".htm.gz";
request.BucketName = AWSS3BuckenName;

using (AmazonS3 client = Amazon.AWSClientFactory.CreateAmazonS3Client(
                             AWSAccessKeyID, AWSSecretAccessKeyID))
using (S3Response putResponse = client.PutObject(request))
{
    //process response
}

如果您先用数据填充 MemoryStream,也可以使用 GZipStream 作为输入,但我还没有尝试过。

【讨论】:

  • zip.Flush() 应该不是必需的。
猜你喜欢
  • 1970-01-01
  • 2019-06-13
  • 1970-01-01
  • 2017-01-06
  • 2016-08-24
  • 2014-06-10
  • 1970-01-01
  • 1970-01-01
  • 2016-09-28
相关资源
最近更新 更多