Configure data pipelines in the Console
Learn about the new UI to export data to cloud data warehouses using GBQ and Snowflake.
Reltio data pipelines deliver clean, merged, and validated profile data to your platform, so that you always have accurate data to inform your analytical and reporting decisions. Reltio connects to the Google Big Query (GBQ) and Snowflake cloud warehouses. For more information, see topics Reltio Data Pipeline for GBQ and Reltio Data Pipeline for Snowflake.
-
the Cloud data warehouse pipelines application in the Console as described in this topic.
-
Reltio REST APIs. For more information, see topics Configure the Reltio GBQ Connector, Configure the Reltio Data Pipeline for Snowflake for AWS, Configure the Reltio Data Pipeline for Snowflake for Azure and Configure the Reltio Data Pipeline for Snowflake for GCP.
In either case, ensure you are assigned the ROLE_API and ROLE_ADMIN_TENANT roles for you to create and submit pipelines. For details, see topics ROLE_API Access permissions and ROLE_ADMIN_TENANT Access permissions.
Cloud data warehouse pipelines
Create new pipelines using the application.
If you haven't configured any data pipelines yet, an information page displays advising you to visit this documentation portal to learn how to configure pipelines.
If you have previously configured data pipelines, they are listed:
Use these controls to manage data pipelines:
-
Status: Slide this switch right to enable or left to disable the data pipeline
-
View details: Select this to display a details panel on the right.
- More options: Select the three vertical dots to display a menu from which you can select these options:
-
Recreate tables and views: Recreate tables and views for your GBQ pipeline.
-
Resync data : Resynchronize your data between Reltio and the cloud platform
-
Delete : Delete this GBQ or Snowflake data pipeline.
-
+ NEW PIPELINE: Configure a new data pipeline. For more information, see topics Configure a new GBQ pipeline in the Console and Configure a Snowflake pipeline in the Console