Limiting Download Batch Sizes in the DIM Service

Limiting Download Batch Sizes in the DIM Service

Overview

The Data Integration Module Service defaults to downloading all possible Jobs in a single batch for the Form defined in the Project. The default size is to download every Form ever sent by the Company. Similar to limiting Job Downloads by Date, this feature is only available by editing the Project (.XML) file directly with a Text Editor.


Limiting the Download Batch Size

You can limit the Download Batch Size by adding a single line to the Project file which tells the Data Integration Module Service to only download the specified number of Job. The tag used for this configuration option is <maxDownloadBatch> and requires an Integer be entered as the value.

Note: Do not have the Project file open in the Project Manager when doing this update.

  1. Open the .xml Project File (typically located at C:\Program Files\F2B Data Integration Module\Projects) with a Text Editor.
  2. Find the <enabled> flag.
  3. Below the <enabled> tag, add the following line to limit each to 10 downloads per batch:
          <maxDownloadBatch>10</maxDownloadBatch>
  4. Save the updated Project File.
  5. Exit the Text Editor.
  6. Open the Data Integration Module Administrator.
  7. Start (or Restart) the Service to start the download with the New Batch Size in place.

Note: When this type of filtering is in place, the service should now download and process batches of 10 (or the number defined) Forms rather than downloading every Form job to download before processing. You can check the Logs of the Administrator Utility to make sure that your downloads are occurring as expected.
Note: Project adjustment can be used in conjunction with the MinRfiTimestamp configuration option (Limiting Job Downloads in the Data Integration Module Service) to help quickly process or re-process Form Data.


    • Related Articles

    • Limiting Job Downloads Start Date in the DIM Service

      Overview The Data Integration Module Service defaults to downloading the entire sent history for the Form defined in the Project. Similar to limiting Download Batch Sizes, this feature is only available by editing the Project (.XML) file directly ...
    • DIM Reset Guide

      Overview This document will familiarize you with the process behind resetting your installation of the Field2Base Data Integration Module (DIM). You may want to reset the DIM if you wish to recapture all data starting from a specific point in time ...
    • Data Integration Module (DIM) User Guide

      Overview The Field2Base Data Integration Module allows you to automatically download data from your Sent Forms to your backend systems. The DIM provides transformation of your Form Data into a variety of formats including CSV and SQL. The DIM Sample ...
    • DIM 6.5 Install Guide

      Integration Suite Editions There are two available editions of the Field2Base Integration Suite, the Server Edition and the Designer Edition. Each edition has a 32 Bit and a 64 Bit version. We recommend using the 64 Bit for increased memory ...
    • DIM Migration Guide

      Overview This article provides the information necessary to migrate the Field2Base Data Integration Module (DIM) over from one server to another.  Please refer to the DIM Install Guide for the initial installation of the Field2Base DIM.  Once that's ...