Configure the Reltio Data Pipeline for Snowflake for GCP
Learn how to configure your GCP to receive data from your Reltio tenant.
Learn about the configuration steps needed to set up your Reltio Data Pipeline for Snowflake.
This table provides more information on these configuration steps, which are described in detail in the following sections.
| Step # | Activity | Notes |
|---|---|---|
| Snowflake Connection to Cloud Storage | ||
| 1. | Create a Google Cloud storage bucket. | |
| 2. | In your Snowflake environment, create a Snowflake integration. | The storage location allows data movement between Reltio and GCS. |
| 3. | Retrieve the Cloud Storage Service Account for your Snowflake Account. | |
| Cloud Storage Integration | ||
| 4. | Create a custom IAM role. | The role enables you to grant the service account permission to access the bucket objects that store your data. |
| 5. | Assign the role to the cloud storage service account. | |
| 6. | Create a Pub/Sub topic. | |
| 7. | Create a Pub/Sub subscription. | |
| 8. | Retrieve the Pub/Sub subscription ID. | |
| 9. | Grant Snowflake Access to the Pub/Sub Subscription. | |
| 10. | Set TTL for files in bucket. | |
| Snowflake Configuration of Reltio Data from Cloud Storage | ||
| 11. | Provision your Reltio tenant for the Reltio Data Pipeline for Snowflake (GCP) with your
| |
| 12. | In your Snowflake environment, create an external stage. | The file format type is JSON. |
| 13. | In your Snowflake environment, create a notification integration. | This allows events to be sent to the queue. |
| 14. | Retrieve the GCP_PUBSUB_SERVICE_ACCOUNT. | |
| 15. | Create a Pipe with Auto-Ingest Enabled. | |
| Validate and Sync All Desired Reltio Data to Snowflake | ||
| 16. | Validate event transfer in Snowflake with the Reltio UI. | You can verify that the validation is successful by changing an entity attribute in the Reltio UI. |
| 17. | Validate event transfer in Snowflake with the Reltio API. | You can use the reindex API for validating event transfer. |
| 18. |
Sync data between Reltio and Snowflake:
|
If the synchronize task is successfully scheduled, you see a 200 OK status in the response. Query each object’s staging table to view data in the corresponding Snowflake landing table. If your connection is unsuccessful, contact Reltio support. |