Skip to main content

Creating transformations

Compose allows you to transform data using an expression either in Replicate or Compose, according to your needs. The table below provides further information about creating transformations.

Where to create a transformation
Where the Transformation is Created Reasons to Create a Transformation There When the Transformation is Applied

Replicate

  • Filtering large amounts of data that is not needed for the Storage Zone (in the present or the future)
  • Obfuscation due to regulatory reasons or internal policies
  • Data type conversion (e.g. converting a source data type that is not supported on the Storage Zone platform)

Before the data reaches the landing zone.

Metadata

  • The default location if you are not sure where to put it
  • General business logic
  • Needed for several sources or several data marts

Between the Landing Zone and the Storage Zone.

Storage Zone

  • Specific source preparation
  • Need to preserve the original unfiltered source information in Hadoop

  • Needed for merging several sources

Between the Landing Zone and the Storage Zone.

See also Reusable transformations.

In this section:

Did this page help you?

If you find any issues with this page or its content – a typo, a missing step, or a technical error – let us know how we can improve!