Unify and manage your data

Distributed mode

Learn how tasks run in distributed mode using the distributed and taskPartsCount parameters.

When you set distributed=true in a task request, the task runs in distributed mode. In this mode, the system may create multiple sub-tasks to process different portions of the data in parallel. These sub-tasks run concurrently across available API nodes (as long as those nodes are free to handle periodic tasks).

The maximum number of sub-tasks that can be created is controlled by the taskPartsCount parameter. However, this value represents the upper limit — not the guaranteed number — of sub-tasks. The Reltio platform evaluates optimal performance conditions and starts only as many parts as necessary, up to the value specified. This is to avoid performance degradation caused by excessive partitioning, especially in cloud environments such as Azure CosmosDB.

Attention: When distributed=true is used, the parallelExecution parameter is automatically set to true for each sub-task. Ensure that no other tenant-wide tasks are running to avoid resource contention.