Azure Data Lake Storage

Scalable, secure data lake for high-performance analytics.

Web Resources

1/12/2023, Azure PaaS Blog
Symptoms:      Uploading files using Java SDK class DataLakeFileClient fails to initiate the ADF trigger.    Uploading files using Azure Portal initiates the trigger as expected.    ADF trigger is configured to ignore empty blobs.    Analysis:    Whenever a file is created using ADLS Gen2 REST API, there are 3 operations called at the backend i.e. CreateFile, AppendFile and FlushFile. Microsoft.Storage.BlobCreated event is triggered when a blob is created or replaced. Specifically, this event is triggered when clients use the CreateFile and FlushWithClose operations that are available...
11/17/2022, Azure PaaS Blog
Background   This article describes how to get container level stats in Azure Blob Storage, and how to work with the information provided by blob inventory.   The approach presented here uses Azure Databricks and is most suited to be used in storage accounts with a huge amount of data.   At the end of this article, you would be able to create a script to calculate: The total number of blobs in the container The total container capacity (in bytes) The total number of snapshots in the container The total container snapshots capacity (in bytes) The total number of versions in the...
11/16/2022, Azure PaaS Blog
Background: Many times, we have a requirement to delete the older logs from $logs as the Retention days as it was not supported for ADLS gen2 storage account.   Please note Product team already worked on this fix and in case automatic deletion is not working can follow the below steps   Please refer to article https://docs.microsoft.com/en-us/azure/storage/common/manage-storage-analytics-logs?tabs=azure-portal#modify-log-data-retention-period for more information   Deletion of logs from the $logs can be achieved from the following options Azure Storage explorer REST...