...Continue from part 1......
max-core(integer, required)
- This parameter define maximum memory usage in bytes.
- It is available only when the sorted-input parameter is set to False.
- If the total size of the intermediate results that the component holds in memory exceeds the number of bytes specified in the max-core parameter, the component writes temporary files to disk.
Default is 67108864 (64 MB).
reject-threshold(choice, required)
- Specifies the component’s tolerance for reject events i.e after how many reject records the component should abort its operation
check-sort(boolean, optional)
- This parameter is available only when the sorted-input parameter is set to True and the key-method parameter is set to Use key specifier.
Difference between using unsorted and sorted data
With unsorted data
- When the input data is not sorted (and the sorted-input parameter is set to False), the function outputs an arbitrary record from each group. This might not be particularly useful.
- To get the first or last record in the unsorted data, you can use the first or last aggregation function.
With sorted data
- When the input data is sorted (and the sorted-input parameter is set to True), the function outputs the last record from each group.
- In this case, the function is equivalent to the following, which uses the last aggregation function
No comments:
Post a Comment