Limiting Job Downloads Start Date in the DIM Service

Limiting Job Downloads Start Date in the DIM Service

Overview

The Data Integration Module Service defaults to downloading the entire sent history for the Form defined in the Project. Similar to limiting Download Batch Sizes, this feature is only available by editing the Project (.XML) file directly with a Text Editor.


Limiting Job Downloads

You can limit the Data Integration Module Service to only start downloading Jobs after the Date Entered by adding a single line to the Project file. The tag used for this configuration option is the <minRfiTimestamp> and requires that a Date & Timestamp (must be a valid UTC format) be entered as the value.
Note: Do not have the Project file open in the Project Manager when doing this update.
  1. Open the .xml Project File (typically located at C:\Program Files\F2B Data Integration Module\Projects) with a Text Editor.
  2. Find the <rfiSvc> block (this is where the new tag will be added).
  3. Below the <formTemplateId> tag, add the following line (10/1/2020 is used as the sample start date here):
           <minRfiTimestamp>10/01/2020</minRfiTimestamp>
    1. This example shows a Date & Timestamp with only the Date defined.  There is typically no need to define the time when using this Filter unless you are looking to do something specific for testing purposes.
  4. Save the updated Project File.
  5. Exit the Text Editor.
  6. Open the Data Integration Module Administrator.
  7. Start (or Restart) the Service to now Download with the Job Limitation in place.
Note: When this type of filtering is in place, there are no changes to the Logs or in any other display for troubleshooting. The only way to tell this is working is by checking the output after the Jobs have been processed.

    • Related Articles

    • Limiting Download Batch Sizes in the DIM Service

      Overview The Data Integration Module Service defaults to downloading all possible Jobs in a single batch for the Form defined in the Project. The default size is to download every Form ever sent by the Company. Similar to limiting Job Downloads by ...
    • DIM Reset Guide

      Overview This document will familiarize you with the process behind resetting your installation of the Field2Base Data Integration Module (DIM). You may want to reset the DIM if you wish to recapture all data starting from a specific point in time ...
    • Outputting "Per Job" CSV Files in a DIM Project

      The DIM Project Manager allows you to output a new CSV file with every Job (Form) processed by using one of the following Field2Base Internal Values in the Output filename. InternalFormId - the unique incrementing number assigned to Forms as they are ...
    • Data Integration Module (DIM) User Guide

      Overview The Field2Base Data Integration Module allows you to automatically download data from your Sent Forms to your backend systems. The DIM provides transformation of your Form Data into a variety of formats including CSV and SQL. The DIM Sample ...
    • DIM PDF Plugin Setup

      Overview The PDF Plugin allows customers running the Data Integration Manager (DIM) to save PDF files of Sent Forms to a specified file location. There are limited customize-able options for this plugin. The following options are available: The ...