Update Reports

General Topics

Azure Services Categories

Azure Data Lake Storage

Scalable, secure data lake for high-performance analytics.
Service Profile Videos Learning

Web Resources

Azure Data Factory trigger is not initiated when uploading a file using Java SDK
1/12/2023, Azure PaaS Blog
Symptoms:      Uploading files using Java SDK class DataLakeFileClient fails to initiate the ADF trigger.    Uploading files using Azure Portal initiates the trigger as expected.    ADF trigger is configured to ignore empty blobs.    Analysis:    Whenever a file is created using ADLS Gen2 REST API, there are 3 operations called at the backend i.e. CreateFile, AppendFile and FlushFile. Microsoft.Storage.BlobCreated event is triggered when a blob is created or replaced. Specifically, this event is triggered when clients use the CreateFile and FlushWithClose operations that are available...
How to calculate Container Level Statistics in Azure Blob Storage with Azure Databricks
11/17/2022, Azure PaaS Blog
Background   This article describes how to get container level stats in Azure Blob Storage, and how to work with the information provided by blob inventory.   The approach presented here uses Azure Databricks and is most suited to be used in storage accounts with a huge amount of data.   At the end of this article, you would be able to create a script to calculate: The total number of blobs in the container The total container capacity (in bytes) The total number of snapshots in the container The total container snapshots capacity (in bytes) The total number of versions in the...
Deletion of logs from $logs container from ADLS gen2 storage account using PowerShell
11/16/2022, Azure PaaS Blog
Background: Many times, we have a requirement to delete the older logs from $logs as the Retention days as it was not supported for ADLS gen2 storage account.   Please note Product team already worked on this fix and in case automatic deletion is not working can follow the below steps   Please refer to article https://docs.microsoft.com/en-us/azure/storage/common/manage-storage-analytics-logs?tabs=azure-portal#modify-log-data-retention-period for more information   Deletion of logs from the $logs can be achieved from the following options Azure Storage explorer REST...