Trigger Delta Live Tables pipeline

Learn how to trigger the Delta Live Tables pipeline.

Before this step, you need to have provisioned the Delta Live Tables pipeline.

When you run the pipeline in Triggered mode, you must trigger the pipeline for it to run. For more details on the Delta Lake, see topic Delta Lake API.

To trigger the pipeline:

Send a request to DPH Delta Lake adapter trigger pipeline endpoint:

POST {{hub-url}}/api/tenants/{{tenantID}}/adapters/deltalake/actions/trigger_pipeline

where hub-url is of the form <env>-date-pipeline-hub.retio.com and the body in this format:

{
   "fullRefresh": "true/false"
}

fullRefresh When true, runs the pipeline in "FullRefreshAll" mode. In this mode, the pipeline deletes all data in the existing tables and reads the files present in the Staging bucket to then update the tables. The default is false.

When successful

{  "status": "SUCCESS",
   "errors": [],
   "adapter-response":
      {
         "update_id": "f1417e23-f5b3-49ff-a28a-702a0ee60d1c",
         "request_id": "f1417e23-f5b3-49ff-a28a-702a0ee60d1c"
      }
}

Contact Support if you receive this validation error:

{  "severity": "Error", 
   "errorMessage": "Adapter not enabled for deltalake.",
   "errorCode": 8004,
   "errorDetailMessage": "Adapter not enabled for deltalake.",
   "foundErrors": null,
   "innerErrorData": null,
   "causedBy": null,
   "asJSON": "{\"severity\":\"Error\",\"errorMessage\":\"Adapter not enabled for deltalake.\",\"errorCode\":8004,\"errorDetailMessage\":\"Adapter not enabled for  deltalake.\",\"foundErrors\":null,\"innerErrorData\":null,\"exception\":null,\" stack\":null,\"causedBy\":null}" 
}

Accelerate the Value of Data

Trigger Delta Live Tables pipeline

Footer