Remove Attribute Duplicates Task
Use this API to remove duplicate attribute values.
This task removes duplicate values for attributes (that is, when value is the same, but URI is different), which may appear during simultaneous updates of the same object. The root cause was fixed earlier, but corrupted data may still be found in old tenants.
You can Stop and Pause this task. For more info, see Stop Task for Tenant and Pause Task for Tenant.
Requests
Use the following request to remove duplicate attribute values in all tenants. You must have the Admin role assigned.
POST {ApplicationURL}/removeAttributeDuplicates
["entities"] Use the following request to remove duplicate attribute values for an entity in a single tenant. You must have the Tenant admin role assigned.
POST {ApplicationURL}/api/{tenantId}/removeAttributeDuplicates
["entities/<entity id>"]Use the following request to remove all duplicate attribute values for all entities in a single tenant. You must have the Tenant admin role assigned. Ensure that you keep the request body empty.
POST {ApplicationURL}/api/{tenantId}/removeAttributeDuplicatesNote: The
RemoveAttributeDuplicates task does not process data when the internal queue size is high and more than 15K events are there in the queue. So, it is recommended to run the task when there are no activities on the tenant. For example, dataload or other activities.| Parameter | Required | Description |
|---|---|---|
tenantId | Yes | ID of the tenant to remove duplicated attributes. |
objectType | No | Type of objects to process. Possible values: entities and relations.Default value: entities. |
skipObjectsCount | No | Number of objects which will be skipped during processing. Default value: 0. |
maxResultsToStore | No | The task stores object IDs for which inconsistency has been found in its status. This parameter is needed to prevent consuming huge volumes of memory when numerous objects with inconsistencies are found. Default value: 100. |
bufferSize | No | Size of the buffer which is used to fetch objects from Cassandra. Default value: 1500. |