JSON columns datasets for Databricks Delta Lake

Learn about the datasets in JSON storage format for Databricks Delta Lake.

Entity table

This table lists the fields in this Delta Lake storage raw table.


Field	Data Type	Description
uri	string	The entity Uri which consists of the <ObjectTypeSpecifier> Id
version	bigint	The version of objects in the Reltio system
timestamp	bigint	The time at which the event was logged
type	string	The entity type in Reltio system
attributes	string	All the attributes of the entity
crosswalks	ARRAY< STRUCT< type:string, uri:string, value:string, sourceTable:string, initialSource:ARRAY<string>, endInitialSource: STRING, startInitialSource: STRING, attributes:ARRAY<string>, createDate:string, reltioLoadDate:string, updateDate:string, deleteDate: STRING, singleAttributeUpdateDates:MAP<string, string>, crosswalkExternalInfo: STRUCT< dtssInfo: STRUCT< tenantId: STRING, operationId: STRING, matchReasons: ARRAY<STRING>, updatedBy: STRING, updatedTime: BIGINT, status: STRING, matchRuleUris: ARRAY<STRING> > > > >	The crosswalk for the object
analyticsAttributes	string	All the analytical attributes of the entity
createdBy	string	The creator of the entity
createdTime	bigint	Timestamp of the entity creation in the source system
updatedBy	string	The ID of the person who made the last update
updatedTime	bigint	Timestamp of the last update of the entity in the source system
commitTime	bigint	The commit time
deleted	boolean	The boolean value that indicates whether the entity is deleted or not
label	string	The label of the entity
linked	boolean	The boolean value that indicates whether the object is linked or have references to other objects
secondaryLabel	string	The secondary label of the entity
tags	array<string>	The tags of the entity
startDate	bigint	The date when the entity was created in the Reltio system
endDate	bigint	The date when the entity was soft deleted (if deleted) in the Reltio system

Relation table

This table lists the fields in this Delta Lake storage raw table.


Field	Data Type	Definition
uri	string	The relation Uri which consists of the <ObjectTypeSpecifier> Id
type	string	The relation type in Reltio system
attributes	string	All the attributes of the relation
commitTime	bigint	The commit time
createdBy	string	The creator of the relation
createdTime	bigint	Timestamp of the relation creation in the source system
crosswalks	ARRAY< STRUCT< type:string, uri:string, value:string, sourceTable:string, initialSource:ARRAY<string>, endInitialSource: STRING, startInitialSource: STRING, attributes:ARRAY<string>, createDate:string, reltioLoadDate:string, updateDate:string, deleteDate: STRING, singleAttributeUpdateDates:MAP<string, string>, crosswalkExternalInfo: STRUCT< dtssInfo: STRUCT< tenantId: STRING, operationId: STRING, matchReasons: ARRAY<STRING>, updatedBy: STRING, updatedTime: BIGINT, status: STRING, matchRuleUris: ARRAY<STRING> > > > >	The crosswalk for the object
deleted	boolean	The boolean value that indicates whether the relation is deleted or not
linked	boolean	The boolean value that indicates whether the object is linked or have references to other objects
timestamp	bigint	The time at which the event was logged
updatedBy	string	The ID of the person who made the last update
updatedTime	bigint	Timestamp of the last update of the relation in the source system
version	bigint	The version of objects in the Reltio system
startObject	STRUCT< crosswalks:ARRAY< STRUCT< type:string, uri:string, value:string, sourceTable:string, initialSource:ARRAY<string>, endInitialSource: STRING, startInitialSource: STRING, attributes:ARRAY<string>, createDate:string, reltioLoadDate:string, updateDate:string, deleteDate: STRING, singleAttributeUpdateDates:MAP<string, string>, crosswalkExternalInfo: STRUCT< dtssInfo: STRUCT< tenantId: STRING, operationId: STRING, matchReasons: ARRAY<STRING>, updatedBy: STRING, updatedTime: BIGINT, status: STRING, matchRuleUris: ARRAY<STRING> > > > >, objectURI:STRING >	The start object in a relation
startRefIgnored	boolean	The boolean value if start object reference is ignored
startRefPinned	boolean	The boolean value if start object reference is pinned
endObject	STRUCT< crosswalks: ARRAY< STRUCT< type: string, uri: string, value: string, sourceTable: string, initialSource: ARRAY<string>, endInitialSource: STRING, startInitialSource: STRING, attributes: ARRAY<string>, createDate: string, reltioLoadDate: string, updateDate: string, deleteDate: STRING, singleAttributeUpdateDates: MAP<string, string>, crosswalkExternalInfo: STRUCT< dtssInfo: STRUCT< tenantId: STRING, operationId: STRING, matchReasons: ARRAY<STRING>, updatedBy: STRING, updatedTime: BIGINT, status: STRING, matchRuleUris: ARRAY<STRING> > > > >, objectURI: STRING >	The end object in a relation
endRefIgnored	boolean	The boolean value if the end object reference is ignored
endRefPinned	boolean	The boolean value if the start object reference is pinned
startDate	bigint	The date when the entity was created in the Reltio system
endDate	bigint	The date when the entity was soft deleted (if deleted) in the Reltio system

Interactions table

This table lists the fields in this Delta Lake storage raw table.


Field	Data Type	Description
uri	string	The interaction Uri which consists of the <ObjectTypeSpecifier> Id
version	bigint	The version of objects in the Reltio system
timestamp	bigint	The time at which the event was logged
type	string	The interaction type in Reltio system
deleted	boolean	The boolean value that indicates whether the interaction is deleted or not
attributes	string	All the attributes of the interaction
crosswalks	ARRAY< STRUCT< type: string, uri: string, value: string, sourceTable: string, initialSource: ARRAY<string>, endInitialSource: STRING, startInitialSource: STRING, attributes: ARRAY<string>, createDate: string, reltioLoadDate: string, updateDate: string, deleteDate: STRING, singleAttributeUpdateDates: MAP<string, string>, crosswalkExternalInfo: STRUCT< dtssInfo: STRUCT< tenantId: STRING, operationId: STRING, matchReasons: ARRAY<STRING>, updatedBy: STRING, updatedTime: BIGINT, status: STRING, matchRuleUris: ARRAY<STRING> > > > >	The crosswalk for the object
members	MAP<STRING, STRUCT< uri: STRING, type: STRING, members: ARRAY<MAP<STRING, STRING>> > >	The memberTypes (roles like "Chefs") with concrete entities which plays these roles in this interaction.
createdBy	string	The creator of the interaction
createdTime	bigint	Timestamp of the interaction creation in the source system
updatedBy	string	The ID of the person who made the last update
updatedTime	bigint	Timestamp of the last update of the relation in the source system
commitTime	bigint	The commit time

Matches table

This table lists the fields in this Delta Lake storage raw table.


Field	Data Type	Description
entityId	string	The ID of the Entity in the Reltio system
manual_matches	`array<struct<entityId:string>>`	Entity IDs of manual matches for entityId
not_matches	`array<struct<entityId:string>>`	Entity IDs that are not matches to entityId
potential_matches	array< struct< entityId:string, matchRules:array<string>, matchScore:string> >	Entity IDs of potential matches
version	bigint	The version of objects in the Reltio system
deleted	boolean	The boolean value that indicates whether the record is deleted or not
timestamp	bigint	The time at which the event was logged
insertedTime	bigint	Timestamp of the record inserted in the table

Merges table

This table lists the fields in this Delta Lake storage raw table.


Field	Data Type	Description
winnerId	string	The entity ID of the winner record in the merge
loserId	string	The entity ID of the loser record in the merge
mergeKey	string	The same as the loserId
type	string	The type of event that occurred: `MANUAL` - When two entities are merged manually by an user `AUTO` - When two entities are merged Automatically by merge process using an Automatic match rule `ON_THE_FLY` - When an newly created entity is merged on the fly using some Automatic match rules `GROUP_MERGE` - refers to the situation when entities are merged with each other in two different merge processes simultaneously
deleted	boolean	The boolean value that indicates whether the record is deleted or not
mergeRulesUris	array<string>	The URI of the merge rules. The `configuration/entityTypes/Organization/matchGroups/FuzzyNameExactAddress` URI corresponds to the match rule defined in your L3 under the `Organization` entity type
matchRules	array<string>	The list of the match rules that played a role in matching the records before they got merged. This column hold the label of the match rules
insertedTime	bigint	Timestamp of the record inserted in the table
version	bigint	The version of objects in the Reltio system
timestamp	bigint	The timestamp of the event that occurred in Reltio system

Links table

This table lists the fields in this Delta Lake storage raw table.


Field	Data Type	Description
winnerId	string	The entity ID of the winner record in the merge
loserId	string	The entity ID of the loser record in the merge
deleted	boolean	The boolean value that indicates whether the record is deleted or not
insertedTime	bigint	Timestamp of the record inserted in the GBQ table
version	bigint	The version of objects in the Reltio system
timestamp	bigint	The timestamp of the event that occurred in Reltio system

Activity table

This table lists the fields in this Delta Lake storage raw table.


Field	Data Type	Description
activityClientType	string	The type of client made the Rest API request. Clients may specify its own type via the globalId HTTP header. In case of the header is not specified the type will be "UNKNOWN"
activityID	string	The activity record Id
activityMethod	string	The HTTP method used in the Rest API request
activitySource	string	The activity source
activityTimestamp	bigint	The time when the object was affected
activityUrl	string	The HTTP url of the Rest API request
activityUser	string	The activity performed by user
activityDescription	string	The activity description
activityLabel	string	The activity Label
items	ARRAY<STRUCT<data: STRING, delta: STRING, eventId: STRING, eventType: STRING, id: STRING, objectLabel: STRING, objectType: STRING, objectUri: STRING, startObjectUri: STRING, startObjectLabel: STRING, endObjectUri: STRING, endObjectUriLabel: STRING>>	The activity Items
ingestTime	timestamp	The time when the record was added in table

Workflow table

This table lists the fields in this Delta Lake storage raw table.


Field	Data Type	Description
uri	string	The Uri which consists of the <ObjectTypeSpecifier> Id
timestamp	bigint	The timestamp of the event that occurred in Reltio system
environmentName	string	Name of the environment
tenantId	string	Tenant ID
objectURIs	string	Object URIs affected by this workflow activity
resourceURIs	string	Resource URIs affected by this workflow activity
processInstanceID	string	Process Instance ID
taskID	string	ID of the task
processType	string	Type of Workflow process
taskType	string	Type of task
processInstanceCreateTime	bigint	Process instance create time
taskCreateTime	bigint	Task created time
username	string	User name for the workflow activity
assignee	string	Assignee to whom this workflow activity is assigned
processInstanceDueDate	bigint	Due date for this workflow process
decision	string	Decision of the user
userActivityTime	bigint	Activity time
processInstanceComplete	Boolean	Flag that indicates whether the process is complete or not
processInstanceCompletionTime	bigint	Completion time of workflow process
processSuspended	Boolean	Flag that indicates whether the process is suspended or not

Unify and manage your data

JSON columns datasets for Databricks Delta Lake

Entity table

Relation table

Interactions table

Matches table

Merges table

Links table

Activity table

Workflow table

Footer