Configure attribute filtering for Snowflake pipeline

Learn how to configure the list of attributes to include in the data sent to Snowflake after enabling filtering.

You need the ROLE_ADMIN_TENANT or ROLE_ADMIN_CUSTOMER role and access to your tenant's business configuration.

Note: Attribute data filtering must be enabled in the layer 1 configuration:

Existing pipeline - check the pipeline details in the Data Pipelines application in the Console. For more information, see Manage existing data pipelines.
New pipeline - request for data filtering during setup, see Configure Snowflake (Direct Connect) in Console.
If you are creating a new pipeline in Console, you can request attribute filtering during setup, then refine it under Manage existing data pipelines.

Once attribute filtering is enabled, Reltio includes only the attributes defined in the dataPipelineConfig section of your business configuration. You can define attribute filters separately for entity types, interaction types, and relationship types. For more details on the layer 3 business configuration, see Apply an L3 to a tenant.

Note: If a dataPipelineConfig section is not present for a given type, that object's data will be excluded from the pipeline output.

To configure attribute filtering for the Reltio Data Pipeline for Snowflake:

In your tenant business configuration, add or edit the dataPipelineConfig section for each object type you want to filter, and list the attributes to include:

Without object inheritance


Entity attribute filtering	For the `Employment` entity type, only the `Title`, `IsCurrent`, and `Commenters` attributes will be sent:
	`{ "uri": "configuration/entityTypes/Employment", "dataPipelineConfig": { "enabled": true, "attributes": [ "configuration/entityTypes/Employment/attributes/Title", "configuration/entityTypes/Employment/attributes/IsCurrent", "configuration/entityTypes/Employment/attributes/Commenters" ] } }`
Interaction attribute filtering	For `ExhibitionEventNoMembers`, only these attributes are included:
	`{ "uri": "configuration/interactionTypes/ExhibitionEventNoMembers", "dataPipelineConfig": { "enabled": true, "attributes": [ "configuration/interactionTypes/ExhibitionEvent/attributes/EXHBT_NAME", "configuration/interactionTypes/ExhibitionEvent/attributes/EXHBT_URL", "configuration/interactionTypes/ExhibitionEvent/attributes/EXHBT_DAYS" ] } }`
Relationship attribute filtering	For `Supplier` relations, only the following attributes are included:
	`{ "uri": "configuration/relationTypes/Supplier", "dataPipelineConfig": { "enabled": true, "attributes": [ "configuration/relationTypes/Supplier/attributes/Type", "configuration/relationTypes/Supplier/attributes/Primary" ] } }`

With object inheritance (entities only)

Scenario Parent entity Child entity

Default inheritance

Scenario	Parent entity	Child entity
Default inheritance	`{ "uri": "configuration/entityTypes/Individual", "dataPipelineConfig": { "enabled": true, "attributes": [ "configuration/entityTypes/Individual/attributes/Name", "configuration/entityTypes/Individual/attributes/FirstName", "configuration/entityTypes/Individual/attributes/LastName" ] } }`	`{ "uri": "configuration/entityTypes/HCP", "extendsTypeURI": "configuration/entityTypes/Individual" }`
Disable filtering in child	Same as above	`{ "uri": "configuration/entityTypes/HCP", "extendsTypeURI": "configuration/entityTypes/Individual", "dataPipelineConfig": { "enabled": false } }`
Override filtering in child	Same as above	`{ "uri": "configuration/entityTypes/HCP", "extendsTypeURI": "configuration/entityTypes/Individual", "dataPipelineConfig": { "enabled": true, "attributes": [ "configuration/entityTypes/HCP/attributes/Name" ] } }`

{
  "uri": "configuration/entityTypes/Individual",
  "dataPipelineConfig": {
    "enabled": true,
    "attributes": [
      "configuration/entityTypes/Individual/attributes/Name",
      "configuration/entityTypes/Individual/attributes/FirstName",
      "configuration/entityTypes/Individual/attributes/LastName"
    ]
  }
}

{
  "uri": "configuration/entityTypes/HCP",
  "extendsTypeURI": "configuration/entityTypes/Individual"
}

Disable filtering in child

Same as above

{
  "uri": "configuration/entityTypes/HCP",
  "extendsTypeURI": "configuration/entityTypes/Individual",
  "dataPipelineConfig": {
    "enabled": false
  }
}

Override filtering in child

Same as above

{
  "uri": "configuration/entityTypes/HCP",
  "extendsTypeURI": "configuration/entityTypes/Individual",
  "dataPipelineConfig": {
    "enabled": true,
    "attributes": [
      "configuration/entityTypes/HCP/attributes/Name"
    ]
  }
}

Unify and manage your data

Configure attribute filtering for Snowflake pipeline

Footer