Zero-copy integration from Google BigQuery architecture
Learn about the architecture of zero-copy integration from Google BigQuery.
Zero-copy integration from Google BigQuery uses keyless Google Cloud service account impersonation and interaction mappings to retrieve interaction and transaction data from BigQuery. BigQuery remains the source for interaction and transaction data, while Reltio remains the source for mastered profile data.
Architecture overview
The architecture connects Reltio to BigQuery through a BigQuery connection, an interaction mapping, and keyless service account impersonation. The connection identifies the BigQuery environment, while the interaction mapping identifies the source object, returned attributes, interaction type, and profile-linking rules.
Authentication and access control
A Reltio source identity impersonates a service account owned by your organization. Google Cloud IAM Credentials issues a short-lived access token, which Reltio uses to query the BigQuery API. Reltio does not store a service account key.
Access depends on two Google Cloud IAM grants. Your organization grants the Reltio source identity permission to impersonate the customer-owned service account. The customer-owned service account has permission to run BigQuery jobs and read the mapped data. Google Cloud IAM validates these grants before issuing the short-lived access token that Reltio uses to query BigQuery.
Query flow and profile linking
The interaction mapping created during setup identifies the BigQuery table or view, the member types, the crosswalk column for each member type, and interaction attribute columns.
- Reltio reads the crosswalk IDs from the mastered profile in Reltio for each member type defined in the interaction mapping.
- Reltio uses the interaction mapping to create a filtered query for rows containing those crosswalk IDs.
- Reltio sends the query to the mapped BigQuery table or view through the saved BigQuery connection.
- BigQuery returns the matching rows and mapped columns to Reltio.
- Reltio displays the returned values in the profile's interaction timeline without storing the BigQuery data.
Network and service dependencies
The integration requires access to these Google Cloud services:
-
Reltio uses the Google Cloud IAM Credentials API at
iamcredentials.googleapis.comto obtain short-lived access tokens. -
Reltio sends filtered queries to the BigQuery API at
bigquery.googleapis.com.
Reltio retrieves and displays interaction data from BigQuery only when the BigQuery project is accessible, the required IAM permissions are valid, and the IAM Credentials and BigQuery APIs are operational.