Limiting Download Batch Sizes in the DIM Service

Limiting Download Batch Sizes in the DIM Service

Overview

The Data Integration Module Service defaults to downloading all possible Jobs in a single batch for the Form defined in the Project. The default size is to download every Form ever sent by the Company. Similar to limiting Job Downloads by Date, this feature is only available by editing the Project (.XML) file directly with a Text Editor.

Limiting the Download Batch Size

You can limit the Download Batch Size by adding a single line to the Project file which tells the Data Integration Module Service to only download the specified number of Job. The tag used for this configuration option is <maxDownloadBatch> and requires an Integer be entered as the value.


Info
Note: Do not have the Project file open in the Project Manager when doing this update.

  1. Open the .xml Project File (typically located at C:\Program Files\F2B Data Integration Module\Projects) with a Text Editor.
  2. Find the <enabled> flag.
  3. Below the <enabled> tag, add the following line to limit each to 10 downloads per batch:
          <maxDownloadBatch>10</maxDownloadBatch>
  4. Save the updated Project File.
  5. Exit the Text Editor.
  6. Open the Data Integration Module Administrator.
  7. Start (or Restart) the Service to start the download with the New Batch Size in place.


Info
Note: When this type of filtering is in place, the service should now download and process batches of 10 (or the number defined) Forms rather than downloading every Form job to download before processing. You can check the Logs of the Administrator Utility to make sure that your downloads are occurring as expected.
Info
Note: Project adjustment can be used in conjunction with the MinRfiTimestamp configuration option (Limiting Job Downloads in the Data Integration Module Service) to help quickly process or re-process Form Data. However, if the DB Rotation Tool was used to archive data, MinRFITimestamp is no longer respected and the DIM will pick up where it left off before the Rotation.