Issue
From time to time it might be necessary to check the EV Collector log files if there are any issues present. With large journal archives, the collection can take some time, and it might be important to check for collection issues.

Solution
You will find here a sample of the EV Collector log file when Journal collection is triggered.
 
First, we will need to find and open the log files. They are stored on:
 
a) Machine where are the modules installed (ie: C:\Program Files (x86)\QUADROtech\Logs), in many cases it is the Source EV server. The log file name is “AS_EVCollector_Log.txt”
 
b) Machine where is core installed (ie: C:\Program Files\QUADROtech\Logs). You will find there two different log files for EV collector, first is the Client (Module) log file with name “ArchiveShuttle.WebServicesLog.HOSTNAME.EVCollector.Client.txt”, and the second one is the core log ArchiveShuttle.WebServicesLog.HOSTNAME.EVCollector.txt
 
Second, the log level may need to be changed to TRACE to collect detailed information.
 
Here you can see the sample of Journal Collection with Trace logging enabled, which should give you the basic overview of the command process flow:
 
Module received the command from core to collect items for single archive:

2015-08-27 08:24:02Z|3184| 23| INFO|                                               Get| -> Got 1 commands
2015-08-27 08:24:02Z|3184| 23| INFO|                             ProcessManualCommand|Got Command CollectItemsForArchive with commandID 105
2015-08-27 08:24:02Z|3184| 23|DEBUG|                                               Get|Got Command CollectItemsForArchive
2015-08-27 08:24:02Z|3184| 23|TRACE|                                             .ctor|>> Collecting Items for Single User

 
EV Schema version and Archive ID:

2015-08-27 08:24:02Z|3184| 24|DEBUG|                                         GetEVDAL|EV Version 10 SP4 Detected. Schema Version is 10.125.5.137
2015-08-27 08:24:02Z|3184| 23|DEBUG|                                 GetWigForArchive|Created new WorkItemGroup for ArchiveID 1EEE91F5D55D7B5448A5E8B1DB1BF0EC71110000ev10-site
2015-08-27 08:24:02Z|3184| 33|TRACE|                                           Dispose|<< Collecting Items for Single User [187,2439 ms]

 
Start of the single archive collection:

2015-08-27 08:24:02Z|3184| 33| INFO|                     CollectItemsForSingleArchive|Collecting Items for Archive [Journal]
2015-08-27 08:24:02Z|3184| 33|TRACE|                     CollectItemsForSingleArchive|dd9894e4-28f1-444b-be59-69d7fd801fe8 added successfully to ResultDict
2015-08-27 08:24:02Z|3184| 33| INFO|                               GatherArchivedItems|*** Starting item collection for [Journal] from: [01/01/1900 00:00:00]

 
Item count of gathered items:

2015-08-27 08:24:04Z|3184| 13|TRACE|                               GatherArchivedItems|Collecting [4831243] items for Archive [Journal]

 
SQL timeout information:

2015-08-27 08:24:04Z|3184| 13|TRACE|                             get_SqlCommandTimeout|SQL connection timeout is set to 600 seconds.

 
Journal collection is divided into pages as the EV Collector is gathering huge amount of data. The default page setting is 100,000 rows per page:

2015-08-27 08:24:04Z|3184| 15|TRACE|                               GatherArchivedItems|Doing Page 1 of 49
2015-08-27 08:24:13Z|3184| 13|TRACE|                               QueryArchivedItems|Journal: 1000 items processed.
2015-08-27 08:24:13Z|3184| 13|TRACE|                               QueryArchivedItems|Journal: 2000 items processed.

 
Transferring collected items from module to core and database is done during the collection as there is a huge amount of data which need to be sent, because of this the migration could start before all items are collected.

2015-08-27 08:24:14Z|3184| 24| INFO|                       TransferItemMetadataToCore|Starting transmission of 1 containers containing 30999 items to core
2015-08-27 08:24:14Z|3184| 10|TRACE|                       TransferItemMetadataToCore|Checking Container: dd9894e4-28f1-444b-be59-69d7fd801fe8
2015-08-27 08:24:14Z|3184| 10|TRACE|                       TransferItemMetadataToCore|Adding container dd9894e4-28f1-444b-be59-69d7fd801fe8 to transmission list.
2015-08-27 08:24:14Z|3184| 23|TRACE|                                     CreateTracer|>> --> WT: Sending 10000 Collected Items Metadata to Core for dd9894e4-28f1-444b-be59-69d7fd801fe8
2015-08-27 08:24:15Z|3184| 14|TRACE|                                     CreateTracer|>> --> WT: Sending 5000 Collected Items (chunk) Metadata to Core for dd9894e4-28f1-444b-be59-69d7fd801fe8
2015-08-27 08:24:15Z|3184| 15|TRACE|                                             .ctor|>> SetCollectedEVItems
2015-08-27 08:24:15Z|3184| 15|TRACE|                                             .ctor|>> CallWebService
2015-08-27 08:24:15Z|3184| 15|TRACE|                                  CallWebService|Communication attempt number: 1
2015-08-27 08:24:19Z|3184| 14|TRACE|                                           Dispose|<< CallWebService [4806,4557 ms]
2015-08-27 08:24:19Z|3184| 10|TRACE|                                           Dispose|<< SetCollectedEVItems [4806,9793 ms]
2015-08-27 08:24:19Z|3184| 10|TRACE|                                         SenderWT|Transmission of 5000 items was successful. Deleting them in BacklogDB
2015-08-27 08:24:19Z|3184| 14|TRACE|                            DeleteTransmittedItems|Deleted 5000 items [2 ms]
2015-08-27 08:24:19Z|3184| 10|TRACE|                                         SenderWT|Deleting 5000 items in Backlog DB was successful
2015-08-27 08:24:19Z|3184| 10|TRACE|                                          Dispose|<< --> WT: Sending 5000 Collected Items (chunk) Metadata to Core for dd9894e4-28f1-444b-be59-69d7fd801fe8 [4815,3561 ms]
2015-08-27 08:24:19Z|3184| 10| INFO|                                         SenderWT|5000/10000 items still in this transmit queue. Chunk: [4948 ms] Total: [4948 ms]
2015-08-27 08:24:44Z|3184| 13| INFO|                               QueryArchivedItems|Sleeping 30 secs
2015-08-27 08:24:44Z|3184| 13|TRACE|                               QueryArchivedItems|rowijrnl: 32000 items processed.
2015-08-27 08:24:44Z|3184| 23|TRACE|                               QueryArchivedItems|rowijrnl: 33000 items processed.

 
When the first page is collected, it will continue with the next one till the last one is collected:

2015-08-27 08:25:46Z|3184| 13|TRACE|                               QueryArchivedItems|rowijrnl: 98000 items processed.
2015-08-27 08:25:47Z|3184| 13|TRACE|                               QueryArchivedItems|rowijrnl: 99000 items processed.
2015-08-27 08:25:47Z|3184| 13|TRACE|                               QueryArchivedItems|rowijrnl: 100000 items processed.
2015-08-27 08:25:47Z|3184| 10|TRACE|                               GatherArchivedItems|Doing Page 2 of 49
...
2015-08-27 09:41:50Z|3184| 13|TRACE|                               GatherArchivedItems|Doing Page 49 of 49
2015-08-27 09:42:08Z|3184| 13|TRACE|                               QueryArchivedItems|rowijrnl: 1000 items processed.

 
Journal Collection ends at this point, as you can see it collected 4,8 million of items in 4 716 seconds (1.31 hour). The transmission of results will continue till all items metadata are send to the database.

2015-08-27 09:42:38Z|3184| 13| INFO|                               GatherArchivedItems|Finished collection of [4831243] items for [rowijrnl] in [4 716 s]

 
If there is any error/issues present try to check our knowledge base for EV Collector for any help.

Print Friendly, PDF & Email