Skip to main content

Mapping

Overview​

The "Mapping" pipeline is used to transform data from one format to another. This pipeline is useful when you need to transform data from one system to another, or when you need to transform data from one format to another within the same system.

Pipeline Parameters​

Source Entity Settings​

Source Entity

  • Type: Entity
  • Description: The entity from which data will be pulled for mapping.
  • Configuration: Select the appropriate entity from the dropdown menu in the pipeline configuration interface.

Source Entity Filter

  • Type: JSON
  • Description: Defines conditions under which records are selected for mapping.
  • Configuration: Enter a Mongo query JSON object that specifies filtering rules.

Source Entity Mapping

  • Type: JSONata
  • Description: Defines the mapping between the source entity record and the data to be transformed.
  • Configuration: Enter a JSONata expression that specifies the mapping rules.

Target Entity Settings​

Target Entity

  • Type: Entity
  • Description: The entity where the transformed data will be stored.
  • Configuration: Select the appropriate entity from the dropdown menu in the pipeline configuration interface.

Target Entity Mapping For Upsert Filter

  • Type: JSONata
  • Description: Define mongo filter that will be used to upsert the data.
  • Configuration: Enter a JSONata expression that specifies the upsert filter
  • Example:
    {
        "data.new_field_1": $.data.field_1,
        "data.new_field_2": $.data.field_2
    }
    Key is the field in the target entity and value is the field in the source entity.