[ { "Id": "251833", "ThreadId": "73661", "Html": "

Hi guys!

\r\n

I have a problem while trying to use DeflateStream. If I do it in the way suggested in one of your examples it works fine.  Though if I change file stream to memory stream creating a DeflateStream object I get some problems. Code below is just slightly modified sample from DeflateStream.cs

\r\n

 

\r\n
    string fileToCompress = @"d:\\d1.doc";
\r\n
    using (System.IO.Stream input = System.IO.File.OpenRead(fileToCompress))
\r\n
    {
\r\n
         using (var raw = System.IO.File.Create(fileToCompress + ".zip"))
\r\n
         {
\r\n
/*             using (DeflaterOutputStream deflaterStream = new DeflaterOutputStream(raw))
\r\n
             {
\r\n
                 MiscUtil.CopyStream(input, deflaterStream);
\r\n
                 deflaterStream.Finish();
\r\n
             }*/
\r\n
             // Stream compressor = new DeflateStream(raw, CompressionMode.Compress);
\r\n
             MemoryStream ms = new MemoryStream();
\r\n
             
\r\n
             using (Stream compressor = new DeflateStream(ms, CompressionMode.Compress))
\r\n
             {
\r\n
                 byte[] buffer = new byte[4096];
\r\n
                 int n;
\r\n
                 while ((n = input.Read(buffer, 0, buffer.Length)) != 0)
\r\n
                 {
\r\n
                     compressor.Write(buffer, 0, n);
\r\n
                 }
\r\n
                 MiscUtil.CopyStream(ms, raw);
\r\n
             }
\r\n
             /*     MemoryStream ms = new MemoryStream();
\r\n
             ZipUtil.Deflate(input, ms);
\r\n
             MiscUtil.CopyStream(ms, raw);*/
\r\n
         }
\r\n
     }
\r\n

 

\r\n

    string fileToCompress = @"d:\\d1.doc";

\r\n

    using (System.IO.Stream input = System.IO.File.OpenRead(fileToCompress))

\r\n

    {

\r\n

         using (var raw = System.IO.File.Create(fileToCompress + ".zip"))

\r\n

         {

\r\n

             MemoryStream ms = new MemoryStream();

\r\n

             using (Stream compressor = new DeflateStream(ms, CompressionMode.Compress))

\r\n

             {

\r\n

                 byte[] buffer = new byte[4096];

\r\n

                 int n;

\r\n

                 while ((n = input.Read(buffer, 0, buffer.Length)) != 0)

\r\n

                 {

\r\n

                     compressor.Write(buffer, 0, n);

\r\n

                 }

\r\n

                 MiscUtil.CopyStream(ms, raw);  // this is just a stream to stream copy utility function

\r\n

             }

\r\n

         }

\r\n

     }

\r\n
I set a break on MiscUtil.CopyStream(ms, raw) and found that ms.Length = ms.Position = 0. Could you please comment if this is the real issue or I just do something wrong?
\r\n
Thanks in advance,
\r\n
Alex
\r\n

 

\r\n

 

", "PostedDate": "2009-10-30T18:14:40.9-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "251871", "ThreadId": "73661", "Html": "

I don't know what the specific problem might be but I have some comments.

\r\n
    \r\n
  1. If I thought my code had written to a stream, and yet the Position and Length on the stream were both 0, I would first verify that the stream write actually occurred.
    2. \r\n
  2. I don't know what CopyStream does, but if you do a ms.Read() in there, you will want to call ms.Seek(0, SeekOrigin.Begin) before doing so. 
    3. \r\n
  3. Why do you write to a MemoryStream when you really want to put it into the filesystem file?  Why not write directly to the filestream?   what are you trying to accomplish?
    4. \r\n
  4. The file you are creating, with the .zip extension, is not a zip file.  Anything that comes out of DeflateStream is not a .zip file.  You are inviting confusion by naming it that way.  
    5. \r\n
\r\n

Good luck!

", "PostedDate": "2009-10-30T23:32:18.723-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "251900", "ThreadId": "73661", "Html": "

Thank you for quick reply.

\r\n

1. Before going to debug the dotnetzip code I wanted to check if it's not a feature of the library.

\r\n

2. I am not sure that it is really necessary in this case but ok, i will try. Though in all other code this function works fine so I am pretty sure that it is a root cause of the problem.

\r\n

3. It's just for testing purposes. In fact I need to deflate a memory stream and continue to work with it.

\r\n

4. Yeah, I know it. Again it was just for testing purposes so I named the file with the first name I had in my head. I am agree it could be confusing.

\r\n

By the way, I am not really good in C# but do I understand rightly, that even if I solve the issue and find the way to write a deflated stream into a memory stream I will have to copy its contant, as far as the stream will be closed then DeflateStream is disposed?

", "PostedDate": "2009-10-31T02:16:59.973-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "251906", "ThreadId": "73661", "Html": "

> Though in all other code this function works fine so I am pretty sure that it is a root cause of the problem.

\r\n

No, you are not understanding.  If a stream is of length 100, and the Position on the stream is 100, then calling Read() on the stream will not return any data.  In the MemoryStream, after having written it, the Position is at the end of whatever data you've written.  This isn't the problem you're having, if Length and Position are both zero, but it will be a problem, if you fix the first one.

\r\n

> I will have to copy its contant, as far as the stream will be closed then DeflateStream is disposed?

\r\n

There's a constructor on the DeflateStream class that lets you specify whether you want the internal stream to remain open, or not, after closing the DeflateStream.

\r\n

http://cheeso.members.winisp.net/DotNetZipHelp/html/c19f2a7a-1c21-a979-3cf1-40f87a008c88.htm 

\r\n

 

", "PostedDate": "2009-10-31T02:58:30.397-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "251923", "ThreadId": "73661", "Html": "

Ah, I got it. Yes, the  position is set to 0 before starting the copy process.

\r\n

Thanks for hint with a constractor, it is useful. I missed it by carelessness.

", "PostedDate": "2009-10-31T05:15:29.22-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "252050", "ThreadId": "73661", "Html": "

Hello again!

\r\n

I didn't investigate the code much but it looks like some buffers are written to the stream in the ZLibStream.finish() method. That's why using IO stream led to correct behavior and using memory stream failed - in case of memory stream finish() wasn't called. After making finish() method public and changing a part of code like this:

\r\n

           using (DeflateStream compressor = new DeflateStream(ms, CompressionMode.Compress))

\r\n

             {

\r\n

                 byte[] buffer = new byte[4096];

\r\n

                 int n;

\r\n

                 while ((n = input.Read(buffer, 0, buffer.Length)) != 0)

\r\n

                 {

\r\n

                     compressor.Write(buffer, 0, n);

\r\n

                 }

\r\n

                 compressor.Finish()

\r\n

                 MiscUtil.CopyStream(ms, raw);  // this is just a stream to stream copy utility function

\r\n

        }

\r\n

i was able to deflate a file to memory stream and then inflate it back. For me it looks like an issue but again, probably I misused your code. Could you please comment?

\r\n

 

\r\n

Best regards,

\r\n

Alex

", "PostedDate": "2009-10-31T17:41:19.443-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "252051", "ThreadId": "73661", "Html": "

Ah, yes, I should have caught that.   You don't need finish() to be public.

\r\n

You only need to call Close() on the DeflateStream, before reading the MemoryStream.  Reading the MemoryStream after the exit of the using() clause is sufficient.  Like so:

\r\n
\r\n
var ms = new MemoryStream();\r\nusing (DeflateStream compressor = new DeflateStream(ms, CompressionMode.Compress))\r\n{\r\n     byte[] buffer = new byte[4096];\r\n     int n;\r\n     while ((n = input.Read(buffer, 0, buffer.Length)) != 0)\r\n     {\r\n         compressor.Write(buffer, 0, n);\r\n     }\r\n}  // the finish() method is called here, implicitly\r\nMiscUtil.CopyStream(ms, raw);\r\n\r\n
\r\n
", "PostedDate": "2009-10-31T17:57:34.93-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "252631", "ThreadId": "73661", "Html": "

Thanks a lot!

\r\n

It's nice to deal with you.

", "PostedDate": "2009-11-02T18:41:25.273-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "255331", "ThreadId": "73661", "Html": "

Hello again!

\r\n

One more time the help is needed. Here is a unit test:

\r\n

 

\r\n
        [Test]
\r\n
        public void UnifiedTestTextboxWithImage()
\r\n
        {
\r\n
            string fileToCompress = @"d:\\inflated1";
\r\n
            using (System.IO.Stream input = System.IO.File.OpenRead(fileToCompress))
\r\n
            {
\r\n
                using (Stream raw = System.IO.File.Create(@"d:\\deflated_"))
\r\n
                {
\r\n
                    MemoryStream ms = new MemoryStream();
\r\n
                    using (Stream compressor = new DeflateStream(ms, CompressionMode.Compress, true))
\r\n
                    {
\r\n
                        byte[] buffer = new byte[4096];
\r\n
                        int n;
\r\n
                        while ((n = input.Read(buffer, 0, buffer.Length)) != 0)
\r\n
                        {
\r\n
                            compressor.Write(buffer, 0, n);
\r\n
                        }
\r\n
                    }
\r\n
                    ms.Position = 0;
\r\n
                    MiscUtil.CopyStream(ms, raw);
\r\n
                }
\r\n
            }
\r\n
            using (System.IO.Stream srcStream = System.IO.File.OpenRead(@"d:\\deflated_"))
\r\n
            {
\r\n
                using (Stream raw = System.IO.File.Create(@"d:\\inflated_"))
\r\n
                {
\r\n
                    Stream inflaterStream = new DeflateStream(srcStream, CompressionMode.Decompress);
\r\n
                    MemoryStream dstStream = new MemoryStream();
\r\n
                    using (inflaterStream)
\r\n
                    {
\r\n
                        // MiscUtil.CopyStream(inflaterStream, dstStream);
\r\n
                        int nByte;
\r\n
                        byte[] buffer = new byte[519];
\r\n
                        while ((nByte = inflaterStream.Read(buffer, 0, buffer.Length)) != 0)
\r\n
                        {
\r\n
                            dstStream.Write(buffer, 0, nByte);
\r\n
                        }
\r\n
                    }
\r\n
                    dstStream.Position = 0;
\r\n
                    MiscUtil.CopyStream(dstStream, raw);
\r\n
                }
\r\n
            }
\r\n
            //    TestShapeTextboxes.UnifiedTestTextboxWithImage(MyLoadFormat, MySaveFormat);
\r\n
        }
\r\n

 

\r\n

        [Test]

\r\n

        public void DeflateTest()

\r\n

        {

\r\n

            using (System.IO.Stream input = System.IO.File.OpenRead(@"d:\\inflated1"))

\r\n

            {

\r\n

                using (Stream raw = System.IO.File.Create(@"d:\\deflated_"))

\r\n

                {

\r\n

                    using (Stream compressor = new DeflateStream(raw, CompressionMode.Compress, true))

\r\n

                    {

\r\n

                        byte[] buffer = new byte[4096];

\r\n

                        int n;

\r\n

                        while ((n = input.Read(buffer, 0, buffer.Length)) != 0)

\r\n

                            compressor.Write(buffer, 0, n);

\r\n

                    }

\r\n

                }

\r\n

            }

\r\n

            using (System.IO.Stream srcStream = System.IO.File.OpenRead(@"d:\\deflated_"))

\r\n

            {

\r\n

                using (Stream raw = System.IO.File.Create(@"d:\\inflated_"))

\r\n

                {

\r\n

                    Stream inflaterStream = new DeflateStream(srcStream, CompressionMode.Decompress);

\r\n

                    using (inflaterStream)

\r\n

                    {

\r\n

                        int nByte;

\r\n

                        byte[] buffer = new byte[519];

\r\n

                        while ((nByte = inflaterStream.Read(buffer, 0, buffer.Length)) != 0)

\r\n

                            raw.Write(buffer, 0, nByte);

\r\n

                    }

\r\n

                }

\r\n

            }

\r\n

        }

\r\n
The size of inflated1 is 518 bytes. If the size of inflate buffer is <=518 then test passes and output file is identical to source file. If the buffer size is > 518 (519 in this case) inflaterStream.Read returnes 0, though the buffer  is re-written with correctly inflated data. 
\r\n
from what i can see in debugger in ZlibStream.Read in do-while loop in the second pass _z.Inflate(_flushMode) returnes ZlibConstants.Z_BUF_ERROR in
\r\n
\r\n
                    rc = (_wantCompress)
\r\n
                        ? _z.Deflate(_flushMode)
\r\n
                        : _z.Inflate(_flushMode);
\r\n
\r\n
\r\n
Thanks in advance,
\r\n
Alex
\r\n

 

\r\n

 

", "PostedDate": "2009-11-09T21:07:18.24-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "255347", "ThreadId": "73661", "Html": "

Alex, I don't understand the problem.  I understand everything you wrote, up to this point;

\r\n

The size of inflated1 is 518 bytes. If the size of inflate buffer is <=518 then test passes and output file is identical to source file.

\r\n

I don't know what problem you are seeing.  I don't know what you're trying to describe.  IS there an exception? IS the file being inflated incorrectly?  What problem are you seeing?

", "PostedDate": "2009-11-09T22:03:42.737-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "255354", "ThreadId": "73661", "Html": "

Sorry for misleading.

\r\n

Ok, here is the scenario. I have a file named inflated1. I deflate it and save in a file named deflated_. Up to here everything works fine. 

\r\n

Next I read the file deflated_  and try to inflate it and save into a file inflated_ to be able co compare with initial file.

\r\n

I use the code a posted above to do both this operation in a test. The size of original file is 518 byte.

\r\n

If i set the size of a  buffer i use to inflate the data to equal o less then 518 bytes then the code works fine and file is inflated correctly.

\r\n

If I make a buffer of size greater then 518 (in this example it is 519)

\r\n

                     byte[] buffer = new byte[519];

\r\n

then the error occures. There is no exeption thrown but here

\r\n

nByte = inflaterStream.Read(buffer, 0, buffer.Length)

\r\n

nBytes = 0 though in debugger i can see that the buffer is changed. Moreover, if on this step i change nByte and set it nByte=518 in the debugger test passes, that is the data wrote to the buffer are correctly inflated.

\r\n

 

\r\n

 

", "PostedDate": "2009-11-09T22:29:58.14-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "255388", "ThreadId": "73661", "Html": "

ok, Thanks for the additional explanation. It's very clear now.

\r\n

I just tried your code and I could not reproduce what you saw.  I tried a file of length 518 and buffers of length 517, 518, and 519.  I always got the same results, correct results. I also tried files of longer and shorter length, with the same range of buffer size.  I tried DotNetZip v1.8.4.24 and v1.9.0.29. 

\r\n

It could be the error is related to the actual data in the buffer you compress.  Can you make that file available?

\r\n

 

", "PostedDate": "2009-11-10T00:55:48.91-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "255403", "ThreadId": "73661", "Html": "

Sure.

\r\n

Could you please email me at anovickov (at) mail (dot) ru and I reply to you with a test file.

", "PostedDate": "2009-11-10T01:26:22.66-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "255415", "ThreadId": "73661", "Html": "

ok, I did that. Awaiting your reply.

", "PostedDate": "2009-11-10T01:57:00.777-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "258171", "ThreadId": "73661", "Html": "

Hi Cheeso,

\r\n

Did you receive a test file from me?

\r\n

Could you confirm or decline the issue?

\r\n

Regards,

\r\n

Alex

", "PostedDate": "2009-11-18T00:38:15.587-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "258210", "ThreadId": "73661", "Html": "

No, I did not receive an email.  I sent one to you, on the 10th of November, but I did not see a reply.

", "PostedDate": "2009-11-18T02:25:32.28-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "258238", "ThreadId": "73661", "Html": "

It's strange, casue i have sent you three emails on 10, 11 and 17. Could it be that my mails felt in spam box?

\r\n

Resent again from mail.ru and gmail.com

", "PostedDate": "2009-11-18T03:57:07.283-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "258594", "ThreadId": "73661", "Html": "

Hi Cheeso, did you receive it this tiem?

\r\n

Alex

", "PostedDate": "2009-11-19T02:50:19.38-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "258637", "ThreadId": "73661", "Html": "

Yes I did. I just receievd your email.  Only the one from gmail.com . 

\r\n

I'll let you know what I find.

", "PostedDate": "2009-11-19T05:11:54.627-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "261144", "ThreadId": "73661", "Html": "

Bongiorno Dino,

\r\n

Any findings?

\r\n

 

\r\n

 

", "PostedDate": "2009-11-27T04:57:13.067-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "262600", "ThreadId": "73661", "Html": "

nothing yet. . .

", "PostedDate": "2009-12-01T23:01:09.29-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "262603", "ThreadId": "73661", "Html": "

But do you at least confirm that the problem exists?

\r\n

 

", "PostedDate": "2009-12-01T23:05:20.713-08:00", "UserRole": null, "MarkedAsAnswerDate": null } ]