[
{
"Id": "133993",
"ThreadId": "40368",
"Html": "Hi,
\r\n I am trying to extract some zip files, in parallel. The zip files have different names though, they all contains same named files (with different contents). When i try to do that it throws exceptions such as "CRC error: the file being extracted appears to be corrupted.....BadCrcException.....InternalExtract ...line 1369."
\r\n It does not happen, if i only extract one file or extract file one after the other. I try to use "TempFileFolder" but it also start raising some exceptions.
\r\nThe code is as follows:
\r\n\r\nzFile = ZipFile.Read(_tempFolder + "\\\\" + fileName);
\r\n zFile.ExtractAll(zDir, true);
\r\n\r\n Let me know, how can i do that and also give me some performance tip. Thanks,
\r\nRegards,
\r\nOsman
\r\n",
"PostedDate": "2008-11-20T11:53:34.393-08:00",
"UserRole": null,
"MarkedAsAnswerDate": null
},
{
"Id": "133995",
"ThreadId": "40368",
"Html": "So you have multiple instances of the ZipFile class that you are using in multiple threads - is that right?
\r\nor do you have a single instance of the ZipFile class that you are using in multiple threads ?
\r\n
\r\nCan you give me a simple test case that reproduces the behavior you're experiencing?\r\n",
"PostedDate": "2008-11-20T12:00:58.713-08:00",
"UserRole": null,
"MarkedAsAnswerDate": null
},
{
"Id": "134023",
"ThreadId": "40368",
"Html": "Hi, Multiple threads working with different instances. I did not purely made threads but use
\r\n
\r\nhttp://www.codeplex.com/smartthreadpool to simulate threads i.e. call the function. The function has a local variable ZipFile type and just extracts the zip file. Now, i have thousands of zip file. All the zip files have same set files inside ( the name of the files are same, although contents are different e.g say Address.txt file is present in every zip file having different address).
\r\n
\r\nuse this function :
\r\n
\r\n\r\nprivate
\r\n\r\n
\r\n\r\n void checkFolder()\r\n
\r\n{
\r\n
\r\n\r\n
\r\n\r\nstring[] fileEntries = Directory.GetFiles(_uploadFolder,"*.zip");\r\n
\r\n
\r\n\r\n
\r\n\r\nforeach (string fileName in fileEntries)\r\n
\r\n{
\r\n
\r\n\r\n_pool.QueueWorkItem(
\r\n\r\nnew WorkItemCallback(this.processZip),Path.GetFileName(fileName));\r\n
\r\n}
\r\n}
\r\n
\r\n\r\nprivate
\r\n\r\n
\r\n\r\n object processZip(object fileName)\r\n
\r\n
\r\n{
\r\n\r\nstring
\r\n\r\n
\r\n\r\n zDir = _tempFolder + "\\\\" + Path.GetFileNameWithoutExtension(fileName.ToString());\r\n
\r\n
\r\n
\r\n
\r\n
\r\nif(System.IO.Directory.Exists(zDir)==false)\r\n
\r\nSystem.IO.
\r\n
\r\nDirectory.CreateDirectory(zDir);\r\n
\r\nzFile =
\r\n
\r\nZipFile.Read(_tempFolder + "\\\\" + fileName);\r\n
\r\nzFile.ExtractAll(zDir,
\r\n
\r\ntrue);\r\n
\r\n
\r\n
\r\n}
\r\n
\r\n
\r\n Thanks,
\r\nRegards, Osman
\r\n \r\n",
"PostedDate": "2008-11-20T13:11:47.897-08:00",
"UserRole": null,
"MarkedAsAnswerDate": null
},
{
"Id": "134059",
"ThreadId": "40368",
"Html": "ok let me have a look.\r\n",
"PostedDate": "2008-11-20T14:36:44.02-08:00",
"UserRole": null,
"MarkedAsAnswerDate": null
},
{
"Id": "134275",
"ThreadId": "40368",
"Html": "Let me give you another tip.
\r\n It works; if you use lock or sync. But it will defeat the purpose of the application. The application will not be truely multi-threaded. The processing would be one after the other.\r\n",
"PostedDate": "2008-11-21T07:58:44.93-08:00",
"UserRole": null,
"MarkedAsAnswerDate": null
},
{
"Id": "135232",
"ThreadId": "40368",
"Html": "Hi,
\r\n I looked at the code and found several "lock". It means that the component is not true multi-threaded. The block will be executed only one at a time. I also noticed that most of the lock are used in the events OnBegin, OnEnd...
\r\n
\r\nI would recommend that there should be some way to turn off all the event generation, it will make it faster and may be also multi-threaded. Thanks,
\r\n",
"PostedDate": "2008-11-25T11:39:26.18-08:00",
"UserRole": null,
"MarkedAsAnswerDate": null
},
{
"Id": "135406",
"ThreadId": "40368",
"Html": "That should lock only the current instance and not the other ones !?\r\n",
"PostedDate": "2008-11-25T23:05:13.337-08:00",
"UserRole": null,
"MarkedAsAnswerDate": null
},
{
"Id": "141718",
"ThreadId": "40368",
"Html": "The ZipFile instance is not multi-thread friendly. I've updated the doc to state that. See change set 27058. workitem 5182:
\r\nhttp://www.codeplex.com/DotNetZip/WorkItem/View.aspx?WorkItemId=5182
\r\n
\r\nOn the other hand, in your case, using multiple threads working with different instances of ZipFile, is supported and will work, if you have the v1.7.1.6 release or later.
\r\n
\r\nThere was a bug in releases prior to that, which initialized a static crc table in the instance constructor. This resulted in the BadCrcException which you originally reported. See work item 6637: http://www.codeplex.com/DotNetZip/WorkItem/View.aspx?WorkItemId=6637
\r\n",
"PostedDate": "2008-12-18T16:51:41.537-08:00",
"UserRole": null,
"MarkedAsAnswerDate": null
}
]