Zero-copy integration from Databricks architecture
Learn how zero-copy integration connects Reltio Intelligent 360 to data in your Databricks workspace.
Zero-copy integration from Databricks connects Reltio Intelligent 360 to interaction and transaction data stored in your Databricks workspace. Reltio sends SQL queries to a Databricks SQL warehouse and uses the results in profile views and segments. The interaction and transaction data remains in Databricks.
Architecture overview
Reltio Intelligent 360 connects to Databricks through a Databricks connection configured in Reltio. The connection identifies the Databricks workspace and SQL warehouse and stores the OAuth credentials for a Databricks service principal. Interaction mappings identify the Databricks source objects to query and the crosswalk columns that link Databricks rows to Reltio profiles.
Databricks connection
Zero-copy integration uses a Databricks connection for a Reltio tenant. The connection identifies the Databricks workspace and SQL warehouse and stores the OAuth credentials for a Databricks service principal. Interaction integration, segmentation, or both use this connection to submit queries to Databricks.
Interaction mappings identify the Databricks source objects to query and the crosswalk columns that link Databricks rows to Reltio profiles. Interaction integration requires these mappings. Segmentation uses them when a segment rule includes interaction attributes.
Authentication and permissions
Reltio authenticates to Databricks through the service principal configured for the Databricks connection. The permissions assigned to the service principal control which SQL warehouse and Unity Catalog objects Reltio accesses.
Grant the service principal access only to the Databricks resources required by the capability you configure.
Reltio and Databricks query work flow
Reltio and Databricks exchange data through this workflow:
- Reltio authenticates to Databricks through the configured connection.
- Reltio submits a SQL query to the configured warehouse.
- The SQL warehouse evaluates the query against the Databricks objects that the service principal has permission to access.
- Databricks returns the query results, and Reltio uses them in Reltio Intelligent 360.