Ab Initio Component | Filter by Expression: Part 1

 Purpose of FILTER BY EXPRESSION

•  FILTER BY EXPRESSION is used to filter records according to a DML expression or transform function, which specifies the selection criteria.

• FILTER BY EXPRESSION can also sometimes used to create a subset, or sample, of the data. For example, you can configure FILTER BY EXPRESSION to select a certain percentage of records, or to select every third (or fourth, or fifth, and so on) record. 

 

Parameters for FILTER BY EXPRESSION

select_expr   (expression, required when use_package is false)

 

• This parameter filters records according to the DML expression you specify.

use_package  (boolean, optional)

• This parameter controls whether the component uses the select_expr parameter or the package to specify the filter criteria. When the value is true, it uses the package.

• When false (the default), you may still use the package to customize the component’s handling of error and log information.

package   (filename or embedded string, optional)

• This parameter is package that can include a select function (required when use_package is true). It also allows you to customize the component’s handling of error and log information.

 
error_group  (string, optional)

• This parameter defines name of the error group to which this component belongs. It sends its error output to the HANDLE ERRORS component with a matching error_group value.

    

log_group  (string, optional)

• This parameter defines name  of the log group to which this component belongs. It sends its log output to the HANDLE LOGS component with a matching log_group value.

reject-threshold  (choice, required)

• This parameter specifies the component’s tolerance for reject events.

limit  (integer, required)

• This parameter defines a number representing reject events.

• When the reject-threshold parameter is set to Use limit/ramp, the component uses the values of the ramp and limit parameters in a formula to determine the component’s tolerance for reject events.

    Default is 0.