Transformers have both input and output ports. They can:
put together more data flows with the same metadata (, and );
remove duplicate records ();
filter data records ();
create samples from input records ( ), sort data records (, and );
multiply existing data flow ();
split one data flow into more data flows ( at all, but optionally also , and );
intersect two data flows (even with different metadata on inputs) (), aggregate data information ();
and perform much more complicated transformations of data flows (, , , and ).
Metadata can be propagated through some of these transformers, whereas the same is not possible in such components that transform data flows in a more complicated manner. You must have the output metadata defined prior to configuring these components.
Some of these transformers use transformations that have been described above. For detailed information about how transformation should be defined, see .
Some Transformers can have a transformation attribute defined, it may be optional or required. For information about transformation templates for transformations written in CTL, see .
Some Transformers can have a transformation attribute defined, it may be optional or required. For information about transformation interfaces that must be implemented in transformations written in Java, see: .
Below is an overview of all Transformers:
-
x
1
1
x
x
x
✓
x
1-n
1
x
x
✓
x
✓
2
3
✓
✓
✓
-
x
1
n
x
x
✓
-
✓
1
1-2
x
x
✓
-
x
1
1
✓
✓
x
-
x
1
1-n
x
x
✓
-
x
1
1-n
x
x
✓
-
x
1
1-2
x
x
✓
✓
✓
2-n
1
x
x
✓
-
x
1
1
x
x
✓
-
x
1
1
✓
✓
x
-
x
1
1-n
[1]
[1]
✓
-
x
1
1
✓
✓
x
-
x
1
1-n
✓
✓
✓
-
x
1
1-n
✓
✓
x
-
x
1
1-n
x
x
✓
✓
x
1-n
1
x
x
✓
-
✓
1
1-n
x
x
✓
-
x
0-1
0-2
x
x
x
[1] Partition can use either a transformation or two other attributes (Ranges or Partition key). The transformation must be defined unless one of these is specified.
requires a transformation (which can be written in both CTL and Java) unless Partition key or Ranges are defined. Remember that this component sends each record through the connected output port whose number is equal to the value returned by the transformation (). Mapping does not need to be done, records are mapped automatically.
requires a transformation which can be written in both CTL and Java. For more information about the transformation template, see .
requires a transformation which can be written in both CTL and Java. For more information about the transformation template, see . Remember that this component sends each record through the connected output port whose number is equal to the value returned by the transformation (). Mapping must be defined for this port.
requires a transformation which can be written in both CTL and Java. For more information about the transformation template, see .
requires a transformation which can be written in both CTL and Java. For more information about the transformation template, see .
requires a transformation which can be written in both CTL and Java. For more information about the transformation template, see . Remember that this component sends each record through the connected output port whose number is equal to the value returned by the transformation (). Mapping must be defined for this port.
requires a transformation (which can be written in both CTL and Java) unless Partition key or Ranges are defined. Remember that this component sends each record through the connected output port whose number is equal to the value returned by the transformation (). Mapping does not need to be done, records are mapped automatically.
requires a transformation which can be written in both CTL and Java. For more information about the interface, see .
requires a transformation which can be written in both CTL and Java. For more information about the interface, see . Remember that this component sends each record through the connected output port whose number is equal to the value returned by the transformation (). Mapping must be defined for such port.
requires a transformation which can be written in both CTL and Java. For more information about the interface, see .
requires a transformation which can be written in both CTL and Java. For more information about the interface, see see .
requires a transformation which can be written in both CTL and Java. For more information about the interface, see see . Remember that this component sends each record through the connected output port whose number is equal to the value returned by the transformation (). Mapping must be defined for such port.
