Azure Data Lake Storage

Scalable, secure data lake for high-performance analytics.

Web Resources

7/9/2025, Azure PaaS Blog
Azure Storage Actions is a fully managed platform designed to automate data management tasks for Azure Blob Storage and Azure Data Lake Storage. You can use it to perform common data operations on millions of objects across multiple storage accounts without provisioning extra compute capacity and without requiring you to write code. Storage task actions can be used to rehydrate the archived blobs in any tier as required. Please note there is no option to set the rehydration priority and is defaulted to Standard one as of now. Note :- Azure Storage Actions are generally available in the...
4/9/2025, Azure PaaS Blog
The blog explains how lease management in Azure Storage works, covering the management of concurrent access to blobs and containers. It discusses key concepts such as acquiring, renewing, changing, releasing, and breaking leases, ensuring only the lease holder can modify or delete a resource for a specified duration. Additionally, it explores common troubleshooting scenarios in Azure Storage Lease Management. Lease management in Azure Storage allows you to create and manage locks on blobs for write and delete operations. This is particularly useful for ensuring that only one client can...
2/7/2025, Azure PaaS Blog
SFTP is a feature which is supported for Azure Blob Storage with hierarchical namespace (ADLS Gen2 Storage Account). As documented, the permission system used by SFTP feature is different from normal permission system in Azure Storage Account. It’s using a form of identity management called local users.   Normally the permission which user can set up on local users while creating them is on container level. But in real user case, it’s usual that user needs to configure multiple local users, and each local user only has permission on one specific directory. In this scenario, using ACLs...
12/26/2024, Azure PaaS Blog
In this blog, we’ll explore how to configure list-only permissions for specific users in Azure Storage, allowing them to view the structure of files and directories without accessing or downloading their contents. Granting list-only permissions to specific users for an Azure Storage container path allows them to list files and directories without reading or downloading their contents. While RBAC manages access at the container or account level, ABAC offers more granular control by leveraging attributes like resource metadata, user roles, or environmental factors, enabling customized...
2/26/2024, Azure PaaS Blog
In this blog post, we will investigate the impacts of disabling public network access in the storage account and learn how to establish connections to an Azure Data Lake Storage account from both IaaS (Virtual Machine) and PaaS services (Azure Data Factory), when public network access is disabled. Additionally, we will address common troubleshooting issues that may arise due to this configuration.   Introduction Azure storage accounts provide a scalable and secure way to store and access data in the cloud. This model enables you to control the level of access to your storage accounts that...
11/23/2023, Azure PaaS Blog
Azure Storage supports for Secure File Transfer (SFTP) protocol in Azure Storage Account. We can use a SFTP client to securely connect to the Blob Storage endpoint of your Azure Storage account, and then perform upload and download operations over the account. Please note that SFTP feature support is only available for hierarchical namespace (ADLS Gen2) enabled accounts. In this article, we will discuss about how to troubleshoot and isolate connectivity issues to SFTP storage account from your machine to understand whether this is due to port blockage, firewall issues, connectivity using...
8/18/2023, Azure PaaS Blog
Ensuring adequate access control is of utmost importance for effectively safeguarding your Azure Storage assets. The Access Control Lists (ACLs) of your Azure Storage Account assume a pivotal role in establishing permissions for both containers and blobs situated within the storage account. The inheritance of ACLs is already in place for newly generated child items beneath a parent directory. However, it's noteworthy that now you also have the capability to set, update, or remove ACLs recursively for the pre-existing child items of a parent directory, thereby eliminating the need to...
3/31/2023, Azure PaaS Blog
Disclaimer: Please test this solution before implementing it for your critical data.   Scenario: This article explains step by step procedures to accomplish the requirements in Azure Storage using built in RBAC roles: Read/Download and write/upload operation for containers and blobs should be allowed for the users. Delete operations should be restricted.   Pre-Requisites: Azure Storage GPV2 / ADLS Gen 2 Storage account Make sure to have enough permissions(Microsoft.Authorization/roleAssignments/write permissions) to assign roles to users , such as Owner or User Access...
1/12/2023, Azure PaaS Blog
Symptoms:      Uploading files using Java SDK class DataLakeFileClient fails to initiate the ADF trigger.    Uploading files using Azure Portal initiates the trigger as expected.    ADF trigger is configured to ignore empty blobs.    Analysis:    Whenever a file is created using ADLS Gen2 REST API, there are 3 operations called at the backend i.e. CreateFile, AppendFile and FlushFile. Microsoft.Storage.BlobCreated event is triggered when a blob is created or replaced. Specifically, this event is triggered when clients use the CreateFile and FlushWithClose operations that are available...
11/17/2022, Azure PaaS Blog
Background   This article describes how to get container level stats in Azure Blob Storage, and how to work with the information provided by blob inventory.   The approach presented here uses Azure Databricks and is most suited to be used in storage accounts with a huge amount of data.   At the end of this article, you would be able to create a script to calculate: The total number of blobs in the container The total container capacity (in bytes) The total number of snapshots in the container The total container snapshots capacity (in bytes) The total number of versions in the...
11/16/2022, Azure PaaS Blog
Background: Many times, we have a requirement to delete the older logs from $logs as the Retention days as it was not supported for ADLS gen2 storage account.   Please note Product team already worked on this fix and in case automatic deletion is not working can follow the below steps   Please refer to article https://docs.microsoft.com/en-us/azure/storage/common/manage-storage-analytics-logs?tabs=azure-portal#modify-log-data-retention-period for more information   Deletion of logs from the $logs can be achieved from the following options Azure Storage explorer REST...