I have to use ZipEntry with task parallel library
\r\nFirst I were looking fro clone or copy method of ZipEntry class but didn't found
\r\nProblem is that i am looping around ZipEntries and want's to call parallel task on each Zip entry.But looks like the reference is some how mixed
\r\nMy code is some thing like
\r\n\r\n
NineOneParser objParser = null;\r\n List<Task> taskHandles = new List<Task>();\r\n\r\n using (ZipFile objZip = new ZipFile(ObjMailDatLists.LevelOneValidatedFilePath))\r\n {\r\n objParser = new NineOneParser();\r\n foreach (ZipEntry ze in objZip.Entries)\r\n {\r\n if (ze.FileName.ToLower().EndsWith(".hdr"))\r\n {\r\n taskHandles.Add(Task.Factory.StartNew(() =>\r\n {\r\n ZipEntry zeToBeProcessed = ze;\r\n LoggingHandler.Log("hdr started parsing completed", EnumLogTypes.Verbose); \r\n ObjMailDatLists.HDRList = objParser.GetHDRList(zeToBeProcessed, ObjMailDatLists.ObjImportJobInfo);\r\n ObjMailDatLists.HDRFileName = zeToBeProcessed.FileName;\r\n LoggingHandler.Log("HDR parsing completed", EnumLogTypes.Verbose);\r\n }));\r\n\r\n }\r\n if (ze.FileName.ToLower().EndsWith(".seg"))\r\n {\r\n taskHandles.Add(Task.Factory.StartNew(() =>\r\n {\r\n ZipEntry zeToBeProcessed = ze;\r\n LoggingHandler.Log("seg started parsing completed", EnumLogTypes.Verbose); \r\n ObjMailDatLists.SEGList = objParser.GetSEGList(zeToBeProcessed, ObjMailDatLists.ObjImportJobInfo);\r\n ObjMailDatLists.SEGFileName = zeToBeProcessed.FileName;\r\n LoggingHandler.Log("seg parsing completed", EnumLogTypes.Verbose);\r\n }));\r\n }\r\n if (ze.FileName.ToLower().EndsWith(".mpu"))\r\n {\r\n taskHandles.Add(Task.Factory.StartNew(() =>\r\n {\r\n ZipEntry zeToBeProcessed = ze;\r\n LoggingHandler.Log("mpu started parsing completed", EnumLogTypes.Verbose); \r\n ObjMailDatLists.MPUList = objParser.GetMPUList(zeToBeProcessed, ObjMailDatLists.ObjImportJobInfo);\r\n ObjMailDatLists.MPUFileName = zeToBeProcessed.FileName;\r\n LoggingHandler.Log("mpu parsing completed", EnumLogTypes.Verbose);\r\n }));\r\n }\r\n
..............//in real i have about 15 odd files
\r\n }\r\n foreach (Task t in taskHandles) { t.Wait(); }\r\n LoggingHandler.Log("All parsing completed", EnumLogTypes.Verbose);\r\n objZip.Dispose();\r\n }\r\n objParser = null;\r\n
\r\n
While the method on each entry looks like
\r\n\r\n
public List<HDR> GetHDRList(ZipEntry ze, ImportJob objJob)\r\n {\r\n List<HDR> objList = new List<HDR>();\r\n using (BufferedStream buffer = new BufferedStream(ze.OpenReader()))\r\n {\r\n using (StreamReader reader = new StreamReader((buffer), Encoding.ASCII))\r\n {\r\n HDR obj = null;\r\n string line = String.Empty;\r\n int recordID = 0;\r\n while ((line = reader.ReadLine()) != null)\r\n {\r\n if (line.Trim().Length > 0)\r\n {\r\n recordID++;\r\n obj = new HDR();\r\n obj.IdeAllianceVersionOfJobInBaseClass = objJob.imjIdeAllianceVersion;\r\n obj.JobID = line.Substring(0, 8).Trim().Length == 0 ? String.Empty : line.Substring(0, 8).ToLower();//casesensitivecheck\r\n obj.IDEAllianceVersion = line.Substring(8, 4).Trim().Length == 0 ? String.Empty : line.Substring(8, 4);\r\n obj.HeaderHistorySequenceNumber = line.Substring(12, 4).Trim().Length == 0 ? String.Empty : line.Substring(12, 4);\r\n obj.HeaderHistoryStatus = line.Substring(16, 1).Trim().Length == 0 ? String.Empty : line.Substring(16, 1).ToUpper();\r\n obj.SystemGeneratedJobID = objJob.JobID;\r\n obj.RecordRowNumber = recordID;\r\n objList.Add(obj);\r\n line = null;\r\n obj = null;\r\n }\r\n }\r\n reader.Close();\r\n reader.Dispose();\r\n }\r\n buffer.Close();\r\n buffer.Dispose();\r\n }\r\n return objList;\r\n }\r\n
Problem is that ZipEntries are mixing and wrong list got wrong entry
Any help on it
\r\n
\r\n", "PostedDate": "2011-10-04T04:32:30.59-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "680333", "ThreadId": "274690", "Html": "
You cannot use multiple threads on a single ZipFile instance.
\r\nin other words: Don't do what you are doing.
", "PostedDate": "2011-10-05T09:18:48.517-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "681948", "ThreadId": "274690", "Html": "Hmmm,
\r\nAny Idea Cheeso (Geek) how to improve it via parallelism?
", "PostedDate": "2011-10-09T23:41:37.29-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "682232", "ThreadId": "274690", "Html": "What are you trying to improve? Are you trying to improve the library, or improve your use of the library?
\r\nAnd in what way? What is the goal?
", "PostedDate": "2011-10-10T12:31:09.62-07:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "682303", "ThreadId": "274690", "Html": "Hi all. I try to use this code and found it faster then the same without AsParallel extension method:
\r\n\r\n
ParallelQuery<ZipEntry> ze = null;\r\n using (ZipFile zf = new ZipFile(@\"G:\\test\\myFile.zip\")) {\r\n ze = zf.SelectEntries(\"*.*\").AsParallel<ZipEntry>();\r\n }\r\n\r\n foreach (ZipEntry z in ze) {\r\n z.Extract(new FileStream(@\"G:\\temp\\\" + z.FileName, FileMode.Create, FileAccess.Write));\r\n }\r\n\r\n
I think that ideally you want to overlap I/O with decompression and parsing, so while reading one file from the archive you're decompressing/parsing another previously read one.
", "PostedDate": "2011-11-07T11:59:31.54-08:00", "UserRole": null, "MarkedAsAnswerDate": null }, { "Id": "694981", "ThreadId": "274690", "Html": "yes, that would make sense.
", "PostedDate": "2011-11-07T14:29:13.147-08:00", "UserRole": null, "MarkedAsAnswerDate": null } ]