Data Merging

Combine data streams by using various nodes to match your workflow needs.

  • Merge data from multiple sources using the Merge node.

  • Combine data from different node runs using the Code node for complex scenarios requiring data merging from various node executions.

  • Compare and merge data: The Compare Datasets node is used to compare, merge, and output data streams.

Merge data from different data streams

When your workflow diverges, you must reintegrate the individual streams into a unified stream. An illustrative workflow is presented to demonstrate various forms of consolidation, such as concatenating data sets, retaining solely fresh entries, and preserving solely current entries.

Merge data from different nodes

You can merge data from two previous nodes using the Merge node. This is helpful for creating a single dataset from multiple nodes' data.

Merge data from multiple node executions

Utilize the Code node to combine data from different node runs, especially in Looping situations.

This section explains combining data from multiple node runs, which occurs when a node runs multiple times within one workflow execution.

Example workflow demonstrates using Loop Over Items and Wait to simulate multiple executions.

Compare, merge, and split again

The Compare Datasets node checks data streams before combining them, producing four data streams as output.

Refer sample here

Last updated