Centerprise Data Integrator features a large number of built-in transformations that enable users to develop sophisticated flows to meet complex data integration demands. New in Centerprise 6 is detached transformations, a key new functionality that enables you to both conditionally use transformations and reuse them in multiple expressions. You can also create composite transformations in your subflows that can be reused in a variety of scenarios, adding modularity to your flows.
Centerprise 6 will be out in the next few weeks and our blog is going to focus in the coming months on getting users up to speed with the many new features and enhancements so that you can get the most out of your investment.
What is a detached transformation?
Centerprise transformations can be broadly classified into single transformations and set transformations. Single transformations usually operate on a single record at a time and are used for looking up or computing values. Examples of single transformations include lookups, expressions, functions, and others. Set transformations, on the other hand, operate on sets of records and may alter the sequence and number of records passing through them. Examples of set transformations include sort, filter, join, merge, normalize, denormalize, and union, among others.
Until now, all Centerprise transformations have been attached. That is, they receive input from other objects via inbound maps and send output via outbound maps. Centerprise 6 now introduces the concept of detached transformations—single transformations that are not mapped to any other objects.
Instead, these transformations behave similarly to built-in or custom functions and can be used in expressions. When a single transformation is marked as detached, Centerprise disallows mapping to and from that transformation.
The image below shows how the Expression Transformation can be designated as a detached transformation. Simply right click the Expression Transformation Object and click Detached:
In the Expression Builder dialog, detached transformations are listed in the Function List box. These functions are under the Detached Action category and are prefixed by the “$” sign. This feature enables you to invoke lookups, expressions, subflows, and others from within expressions.
The following actions can be designated as detached transformations:
1. Database Lookup
2. File Lookup
3. SQL Statement Lookup
4. Code Lookup
5. Sequence Generator
7. Subflow (Those containing only the single transformations)
Detached transformations can have only one output element and a maximum of five input elements. For complete flexibility, they can be used in any expression inside a dataflow or workflow, including expression transformation, filter, route, workflow decision, data-driven write strategy, and data quality rules.
With the introduction of detached transformations in Centerprise 6, the Astera team provides a new way to help you save time and money by increasing your productivity, and, in some cases, the performance of your data integration scenarios.