Accelerate the Value of Data

Create an Azure lifecycle rule

Learn how to set a lifecycle or Time-to-Live (TTL) rule for Azure.

Before you add a lifecycle rule, we recommend you complete the previous topics in this Configure Azure cloud storage section. You must have the editor role to add a lifecycle rule.
An Azure Storage lifecycle rule defines when to expire data at the end of the data lifecycle. Create a lifecycle rule to specify the period of time to retain Reltio data in your Azure Staging container. Don't create a lifecycle rule for the Target container.
To add a lifecycle rule for Azure:
  1. In Microsoft Azure portal, search for and select Storage accounts.
  2. On the Storage accounts page, select the storage account you previously created. For details, see topic Create an Azure storage account.
  3. In storage account Overview page, from the left navigation panel, scroll down to the Data management section and select Lifecycle management.
  4. In the Lifecycle management page, select Add a rule.
  5. In the Add a rule page, fill in the Details tab:
    • Rule name: Enter a name for this rule.

    • Rule scope: Select the appropriate option:
      • Apply rule to all blobs in your storage account: Use the same rule for all files in the bucket. Select this option if the storage account is solely for use with the Reltio Data Pipeline for Databricks Delta Lake.

      • Limit blobs with filters: Use the rule only for some files and enable blob filtering. Use this option if the storage account is shared for use in other business purposes.

    • Blob type: Select Block blobs. Reltio Data Pipeline for Databricks Delta Lake uses only this blob type.

    • Blob subtype: Select Base blobs. Reltio Data Pipeline for Databricks Delta Lake uses only this blob sub type.

  6. Select Next to complete the Details tab.
  7. In the Base blobs tab, complete these fields to build a rule:
    • If condition:
      • Base blobs were: Specify the time period to apply the condition:

        • Last modified: Select this option.

        • More than (days ago): Enter the number of days.

          Note: We recommend a value of 14 days.
    • Then condition:
      • Delete the blob: Select this condition to delete the blob after the specified time period.

  8. Select Add. After the Successfully updated policy notification clears, view your new rule in the List View tab back on the Lifecyle management page.
For general information, see topic Optimize costs by automatically managing the data lifecycle in the Microsoft Azure documentation.