Managing record types and header/footer records

Record types and header/footer records are only applicable to delimited and fixed-width file formats.

Overview

Records types

Sometimes a delimited or fixed-width file will contain records with different formats. For example, this delimited file contains records with two different formats. Some records have an account number and postal address fields and other records have an account number and email address:

addresss, account1234, 9A Lexington Street, Bridgeport, Michigan, 48009
email, account1234 bar@example.com
address, account5678, 9B Agawam Village, Rochester, Colorado, 80015
address, account4321, 99 Mill River Drive, Davenport, Washington, 99336
email, account4321, foo@example.com 

In this example, the first field differentiates the records: address for records with the format:

type, account_number, address, city, state, zip

and email for records with the format:

type, account_number, email_address

A field that differentiates records from one another is called a record type qualifier. The Compliance Engine supports up to three record type qualifiers.

In this case, define qualifiers that allow the Compliance Engine to differentiate between the different record types.

Header and footer records

Another common situation is for a delimited or fixed-width file to have one or more header or footer records. In this case, it may be desirable for the Compliance Engine to place unaltered copies of these records into the masked output file. For example, this delimited file’s first record is a header that contains the names of each field:

hostname, IP
foo.example.com, 10.11.12.13
bar.exmaple.com, 10.14.15.16

In this situation, the Compliance Engine can be configured to treat the first record as a header so that its unmodified contents will be written into the masked file.

Navigation Options:

i. Go to Settings > File Format. Use the Action menu (…) option to Edit against the fixed or delimited file format for the records you want to add.

ii. Navigate to Environments > Inventory.

You must select a rule set that was created using a file connector from the Select Rule Set dropdown list and select the file format or data file from the dropdown for the record type you want to add.

Click on Go to Format Setting and click on Add Record Types. The Record Type window appears.

The Environments > Inventory screen only allows viewing the record type, utilize the Go to file Format option for adding, editing, and deleting the record type which is a format level change.

Adding record types

Create a record type for each distinct record format by uploading a format file.

Perform the following steps to add a record type to a file format:

1. Click Add Record Type button. The Add Record Type window appears.

2. In the Add Record Type window, enter values for the following fields:
   Record Name - A free-form name for this record type.
   Choose File - Browse for the file from which to import fields.

The contents of the imported file vary for Delimited and Fixed-width. Refer to Managing file formats for formatting examples.

5. Click Save.

7. The added record type will be displayed with corresponding fields in the grid below.

Editing record types

In order to edit an added record type name:

1. Select the Edit option from the … menu in the Actions column of the record type to rename.

   

2. A prefilled window (similar to the above) will appear.

3. Rename and Save.

Deleting record types

In order to delete an added record type:

1. Select the Delete option from the … menu in the Actions column of the record type to be deleted.

2. A confirmation window will appear, confirm to Delete.

Managing qualifiers

In order to associate qualifiers with record types:

1. Click on Qualifier Button, the Record Type Qualifier window will open.

   

2. Select the corresponding Record Type to add, edit, or view qualifiers.

3. No. of Qualifiers - Select the number of qualifiers. There can be a maximum of 3 qualifiers.

   

Fields to add Qualifier 1, Qualifier 2 and Qualifier 3 will render based on selected “No. of Qualifiers”.

4. Regular Expression - This value is a regular expression that the Compliance Engine uses to match the specified field, to determine whether the record is of this type. A record type applies if its regular expression matches its specified identifier fields.

5. Field Name - Select the field name within the record type.

6. Click Save once complete.

Configure header and footer

The Header or Trailer associated with a format is used to specify the number of records that are not masked at the beginning and end of a file.

1. Click the Header & Footer button and a small window will appear.

2. Add or update the already configured Number of Records for the header or footer, or both, then save.