[ { "Id": "142102", "ThreadId": "42763", "Html": "In the latest preview release of DotNetZip, I've implemented the ZIP64 extensions. 
\r\n
\r\nThe original Zip spec from PKWare allowed for a maximum of 65535 entries in a zip file; and for a max size of 4.2g of any one archive.  This worked when 640k was enough memory for anyone, but these limits are too low for many scenarios these days. 
\r\n
\r\nPKWare made "ZIP64 extensions" to the spec, to raise those limits.   The problem is, not many tools or libraries implement those extensions, as far as I can tell.
\r\n
\r\nI think I've implemented ZIP64 correctly in DotNetZip, but I don't have a good way of verifying correctness or compatibility/interoperability.  
\r\nWindows Explorer does not "do" ZIP64, nor do many third-party tools and libraries out there.  Some of the tools that claim to "do" ZIP64, seem to do it incorrectly.
\r\n
\r\nSo I need your help!  If  you are interested in ZIP64, please download v1.7.1.7 and try out the ZIP64 support in the library.  
\r\nThere is a new property on the ZipFile - UseZip64WhenSaving.   You need to set it in your app to get a ZIP64 archive. The prior behavior - no ZIP64 support - is the default. 
\r\nCreate a few archives.  Try opening them in other tools.  Or if you have a "known good" zip64 archive, try reading it with DotNetZip.   Let me know if it works for you.   If it does not work for you, I'd like to know specifically how it does not work.   Also, tell me if you think the interface makes sense. Is it usable?  Simple enough?  Is the documentation clear?
\r\n
\r\nYou can also take advantage of the ZIP64 format stuff using the command-line tools - zipit and unzip both support ZIP64 now.  And also, the winforms GUI Zip creator tool - it also will create a ZIP64 archive if you wish. 
\r\n
\r\nVery interested in feedback.
\r\n", "PostedDate": "2008-12-20T16:51:43.717-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "142125", "ThreadId": "42763", "Html": "Below a collection of all errors or problems that I have see when using DotNetZip 1.7.1.7 :
\r\n
\r\n- Using the WinForms application, when choosing "Self-extractor (Gui)" I get the error :
\r\n  "Exception while zipping : Errors compiling the extraction logic" (with "self-extractor (cmd) there is no problem)
\r\n  This is not related to Zip64 support, I get the error with or without Zip64 enabled.
\r\n
\r\n- Latin1 chars are not correctly showed using last WinRAR and 7Zip version (also it seems that you use Unicode and it's not necessary => é char is in IBM437) :
\r\n  "Encoding utf-8
\r\n  Created at 2008-déc.-21 09:50:36 || WinForms Example for DotNetZip v1.7.1.7"
\r\n
\r\n- When uncompressing a Zip64 file done with DotNetZip, I get some errors with 7Zip 4.62 :
\r\n  "Invalid compression method" for each compressed file.
\r\n
\r\n- One hour is added to the modified date of all zipped files (comparing to archives done with 7Zip 4.62 and WinRAR 3.80)
\r\n
\r\n- I have tried to use unzip.exe on the Zip64 archive "test2.zip" (about 5Go) (you can donwload the archive here : http://www.archive.org/details/test_zip64),
\r\nI have get the following error :
\r\nC:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Examples\\UnZip\\bin\\D
\r\nebug>unzip "C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Examples
\r\n\\UnZip\\bin\\Debug\\test2.zip"
\r\nexception: Ionic.Utils.Zip.ZipException: C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Examples\\UnZip\\bin\\Debug\\test2.zip is not a valid zip file
\r\n---> Ionic.Utils.Zip.BadReadException:   ZipEntry::ReadHeader(): Inconsistent zip64 datasize at position 0x0000000028AC0049
\r\n   à Ionic.Utils.Zip.ZipEntry.ProcessExtraField(ZipEntry ze, Int16 extraFieldLength) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Library\\ZipEntry.cs:ligne 932
\r\n   à Ionic.Utils.Zip.ZipEntry.ReadHeader(ZipEntry ze, Encoding defaultEncoding) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Library\\ZipEntry.cs:ligne 796
\r\n   à Ionic.Utils.Zip.ZipEntry.Read(ZipFile zf, Boolean first) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Library\\ZipEntry.cs:ligne 976
\r\n   à Ionic.Utils.Zip.ZipFile.ReadIntoInstance_Orig(ZipFile zf) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Library\\ZipFile.cs:ligne 4514
\r\n   à Ionic.Utils.Zip.ZipFile.ReadIntoInstance(ZipFile zf) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Library\\ZipFile.cs:ligne 4457
\r\n   à Ionic.Utils.Zip.ZipFile.Read(String zipFileName, TextWriter statusMessageWriter, Encoding encoding, EventHandler`1 readProgress) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Library\\ZipFile.cs:ligne 3989
\r\n   --- Fin de la trace de la pile d'exception interne ---
\r\n   à Ionic.Utils.Zip.ZipFile.Read(String zipFileName, TextWriter statusMessageWriter, Encoding encoding, EventHandler`1 readProgress) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Library\\ZipFile.cs:ligne 3994
\r\n   à Ionic.Utils.Zip.ZipFile.Read(String zipFileName, TextWriter statusMessageWriter, Encoding encoding) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Library\\ZipFile.cs:ligne 3942
\r\n   à Ionic.Utils.Zip.ZipFile.Read(String zipFileName) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Library\\ZipFile.cs:ligne 3646
\r\n   à Ionic.Utils.Zip.Examples.UnZip.Main(String[] args) dans C:\\Users\\Dominique\\Desktop\\DotNetZip-src-v1.7.1.7\\DotNetZip\\Examples\\UnZip\\UnZip.cs:ligne 160
\r\n
\r\nThanks \r\n", "PostedDate": "2008-12-21T01:27:35.813-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "142144", "ThreadId": "42763", "Html": "Dom,
\r\nthanks for the testing.
\r\n
\r\nAs I told you before, I cannot get to that zip file.   When I try to download it, I get a 404.
\r\n
\r\nAs for the problems you reported, The first one I've fixed.
\r\nI'll have to check out the other problems.
\r\n", "PostedDate": "2008-12-21T06:15:56.243-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "142151", "ThreadId": "42763", "Html": "Is there a way I can tell the 7zip archiver to create a zip64 archive?
\r\nI cannot figure out how to do that.
\r\n", "PostedDate": "2008-12-21T07:06:04.563-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "142155", "ThreadId": "42763", "Html": "Sorry, forgot that.
\r\n
\r\nI have put this file in my FTP :
\r\nftp://82.231.215.77:21
\r\n
\r\nlogin : cheeso
\r\nno password.
\r\n", "PostedDate": "2008-12-21T07:26:34.41-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "142156", "ThreadId": "42763", "Html": "I haven't find how to expressely ask to make Zip64 archive with 7Zip too.
\r\n
\r\nI think this automatically handled.\r\n", "PostedDate": "2008-12-21T07:28:45.347-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "142161", "ThreadId": "42763", "Html": "Hey Dom, I'm having a problem here.
\r\n
\r\nWhen I look at the 7zip archiver, and load one of the DotNetZip zipfiles into it, with the ZIP64 extensions in use, the file sizes for these files are all the same: 4294967295.  This is 0xFFFFFFFF, which, not coincidentally, is the marker value to be used when ZIP64 is in use.  It is not a real value.   A zip tool that supports ZIP64 is supposed to behave differently when it finds that value for a size.  The actual size is a 64-bit value stored elsewhere in the zip file.  But 7zip just displays the marker value.
\r\n
\r\nThe makers of 7zip claim to support ZIP64, but I don't see how to create one with the tool, and it does not seem to be properly handling the one that I created.
\r\nIt may be handled automatically, as you suggest, but the problem is with ZIP64, there is a question of compatibility.  Therefore the tool ought to notify the user - "Hey this is going to be a ZIP64 archive, you will not be able to open it in Windows Explorer and other tools."   Because there is no warning, I suspect that maybe the ZIP64 support in 7zip is not as well thought out as we would hope.
\r\n
\r\nHere's the challenge - I don't know of an authoritative source for ZIP64 compatibility.   Is the output from 7zip guaranteed to be correct?   If it is, then I would like to know how to create a ZIP64 with 7zip.  Is WinZIP the authoritative source?   Is there some other source?
\r\n
\r\nI tried another toolkit (Perl's IO::Compression::Zip) and found errors there as well. The maintainer of that library confirmed the error. 
\r\n
\r\nI can implement ZIP64, it is just a matter of metadata formats. 
\r\nBut I don't know how to test for compatibility.
\r\n
\r\nFor now I will grab the giant zip file from your FTP (Thanks).  I will let you know!
\r\n", "PostedDate": "2008-12-21T08:52:01.44-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "142163", "ThreadId": "42763", "Html": "ok, I am transferring that test2.zip; my client predicts it will take 13 hours.
\r\nIt would be a lot easier if I could generate a ZIP64 zip myself, here, and be confident that it was compliant.
\r\n", "PostedDate": "2008-12-21T08:59:22.617-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "142206", "ThreadId": "42763", "Html": "I made some changes and fixes.  I updated the release to v1.7.1.8. 
\r\n
\r\nNotes:
\r\nIt should work now with 7zip. 
\r\nI fixed the winforms GUI so that it can correctly compile the GUI SFX.
\r\nI fixed the time shift on the lastmod time.
\r\n
\r\nAbout the Latin characters - I am not sure about this.
\r\nI use whatever setting you choose when creating a vanilla ZIP.  If you choose to create a self-extracting archive, then the Winforms tool will always select UTF-8 for the Encoding.  UTF-8 is a good idea, because it can encode anything.  The only reason you would not want to use UTF-8 is compatibility with the extractor tool.  Windows Explorer does not handle UTF-8 very well, for example.  But if you create a SFX, then DotNetZip will always be the library used to unpack the archive, by definition.  Which means, UTF-8 is always a safe choice.  For this reason, I force the use of UTF-8 when SFX is selected.  You will see that in the Winforms UI.   If you select a vanilla ZIP, then the Encoding goes back to whatever it was before.  So, yes, UTF-8 is used "unnecessarily" in this case, but it should be a safe and always correct choice.
\r\n
\r\nIf you do not select SFX (either GUI or CMD), then the Encoding for the resulting ZIP file will be whatever you set it to.  If you select UTF-8, then it will be UTF-8.  If you select something else, it will be what you select.
\r\n
\r\nHave another look and see if it makes sense to you.
\r\n
\r\nFinally, about the test2.zip - I am still downloading.  If you have a moment, could you retest with the latest v1.7 binaries?
\r\n
\r\n", "PostedDate": "2008-12-21T13:12:04.277-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "142271", "ThreadId": "42763", "Html": "I never could download that zip file.  It kept timing out at the same point.  about 700mb.
\r\n
\r\nInterested in your feedback.\r\n", "PostedDate": "2008-12-21T22:33:14.283-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "144577", "ThreadId": "42763", "Html": "I tested using Ionic.Zip version 1.7.1.13.
\r\n
\r\nI need to do more testing with extraction via Ionic.Zip; however, both Windows Explorer and 7Zip choak on the same files inside the archive.
\r\n
\r\nWhen I went to create a new Archive in 7Zip I noticed that they support Deflate64 -- not Zip64 I wonder if potentially this is the issue.
\r\n
\r\nI'll post back here additional information about using Ionic.Zip to do the extraction and see if the files that did NOT work with the other two methods do infact work if using Ionic.Zip as the extractor.
\r\n
\r\n-Fuzz\r\n", "PostedDate": "2009-01-05T17:24:25.283-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "144578", "ThreadId": "42763", "Html": "MMkay, great Fuzz.
\r\ngood info to have is:
\r\n  - how did you create the archive - which tool, library, or program.
\r\n  - characterize the number of files and their size, and the aggregate size of the zip.  (1mb, 100mb, 5gb, etc)
\r\n  - any additional info like, UTF in use, ZIP64 in use, etc.
\r\n  - what you were doing (unzip, list, create zip, etc)  and what error occurred
\r\n
\r\nI don't know if 7zip supports ZIP64.   I know that Windows Explorer does not.  If you try to open a ZIP64 file in Explorer, generally it will open and you will be able to browse the list of files, but not always.  And, even if you can "See" the files, you will not be able to extract some of them. 
\r\n 
\r\n-Cheez\r\n", "PostedDate": "2009-01-05T17:41:40.967-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "144604", "ThreadId": "42763", "Html": "I'm looking at about ~6GB file.

Created by Ionic.Zip. Ion

List files works in explorer and 7Zip but extraction of certian files do not work. 7Zip reports the compression algorythm is not compatible, explorer gives a useless message.

I'll post back when i've had a chance to test the extraction from using the zip library.

Thanks,
~Nate
Not sent from an iPhone

-----Original Message-----
From: "Cheeso" <[email removed]>
To: [email removed]
Sent: 1/5/09 7:41 PM
Subject: Re: Please test the ZIP64 features - v1.7.1.7 [DotNetZip:42763]

From: Cheeso

MMkay, great Fuzz.
good info to have is:
  - how did you create the archive - which tool, library, or program.
  - characterize the number of files and their size, and the aggregate size of the zip.  (1mb, 100mb, 5gb, etc)
  - any additional info like, UTF in use, ZIP64 in use, etc.
  - what you were doing (unzip, list, create zip, etc)  and what error occurred

I don't know if 7zip supports ZIP64.   I know that Windows Explorer does not.  If you try to open a ZIP64 file in Explorer, generally it will open and you will be able to browse the list of files, but not always.  And, even if you can "See" the files, you will not be able to extract some of them. 
 
-Cheez

", "PostedDate": "2009-01-05T20:16:00.483-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "144621", "ThreadId": "42763", "Html": "\r\n
Great!
\r\n
\r\n
When you created the file with Ionic.Zip, did you \r\nenable the ZIP64 extensions? I would think so, but want to \r\ncheck.
\r\n
\r\n
\r\n
\r\n

\r\n
\r\n
From: [email removed]
\r\n
Sent: Monday, January 05, 2009 8:16 PM
\r\n
To: [email removed]
\r\n
Subject: Re: Please test the ZIP64 features - v1.7.1.7 \r\n[DotNetZip:42763]
\r\n

\r\n\r\n\r\n

From: fuzzzerd

\r\n
I'm looking at about ~6GB \r\nfile.

Created by Ionic.Zip. Ion

List files works in explorer and \r\n7Zip but extraction of certian files do not work. 7Zip reports the compression \r\nalgorythm is not compatible, explorer gives a useless message.

I'll post \r\nback when i've had a chance to test the extraction from using the zip \r\nlibrary.

Thanks,
~Nate
Not sent from an iPhone

-----Original \r\nMessage-----
From: "Cheeso" <[email removed]>
To: [email \r\nremoved]
Sent: 1/5/09 7:41 PM
Subject: Re: Please test the ZIP64 features \r\n- v1.7.1.7 [DotNetZip:42763]

From: Cheeso

MMkay, great \r\nFuzz.
good info to have is:
- how did you create the archive - \r\nwhich tool, library, or program.
- characterize the number of files \r\nand their size, and the aggregate size of the zip. (1mb, 100mb, 5gb, \r\netc)
- any additional info like, UTF in use, ZIP64 in use, etc. \r\n
- what you were doing (unzip, list, create zip, etc) and what \r\nerror occurred

I don't know if 7zip supports ZIP64. I know \r\nthat Windows Explorer does not. If you try to open a ZIP64 file in \r\nExplorer, generally it will open and you will be able to browse the list of \r\nfiles, but not always. And, even if you can "See" the files, you will not \r\nbe able to extract some of them.

-Cheez

\r\n", "PostedDate": "2009-01-05T21:38:49.083-08:00", "UserRole": null, "MarkedAsAnswerDate": null } ]