Academy
Transformation

Merge Step

The Merge step combines two data sources based on columns that are of the same data type. You define which columns serve as comparison keys and the platform separates records common to both sources from records exclusive to each one. Merge is located in the Combination category of the toolbar.

How to configure

When connecting the step, the columns from the input sources appear in Port A and Port B. Define the comparison rule by selecting the columns to be compared, remembering that each pair of columns must have the same data type.

  • Merge Keys: define the comparison rule between ports. You can create more than one rule using the + button and remove a rule via the trash icon. The key status can be Valid or Invalid.

  • Column Selection: chooses one or more columns that will be part of the comparison rule. By default, all columns are selected.

  • Column Status: indicates whether the column is Valid or Invalid. The status becomes Invalid when the column used in the rule is deleted in the input step, or when its data type is changed in the input step. In this status, the platform allows deleting the column.

  • Port: identifies which port (A or B) the column belongs to.

  • Source Name: shows all columns from the input step. The values in this column are not editable.

  • Rename Column: allows changing the name the column will have at the step output.

  • Close Button: closes the screen without saving and returns to the Designer.

  • Save Button: saves the settings.

Duplicate names: if there are columns with the same name in both input sources, rename one of them. The platform does not allow two columns with the same name.

Output ports

After configuring the columns, the Merge step generates three outputs:

  • Output A: records from Port A that are not common to those in Port B.

  • Output M: records common to Ports A and B.

  • Output B: records from Port B that are not common to those in Port A.

An empty port is still valid: even if the rule does not return data, the port remains valid and can be connected to another step to compose the flow.

Usage example

Consider two input sources. Port A has the columns Business, Date, Account, Value, and Description, with four records: two from business A (Expenses 2 and Credits 1) and two from business B (Expenses 2 and Credits 2). Port B has the columns Business, Description, and Department, with two records from business A (Expenses 1 and Credits 1).

The objective is to merge the two sources by the Business and Description columns. With this rule, the results are:

  • Output A: the two records from business B (Expenses 2 and Credits 2), which have no match in Port B.

  • Output M: the two records from business A, now enriched with the Department column coming from Port B (Accounts Payable and Accounts Receivable).

  • Output B: empty file, as all records from Port B have a match in Port A.

  • Lookup Step

  • Consolidate Step

Was this helpful?
Was this helpful?