In continuation with our Azure Every Day mini-series on Azure Databricks, I will be covering some key topics within Databricks such as Azure Key Vault, storage accounts, PowerPoint and DevOps. If you’re just starting out with Databricks, you may want to check out our previous posts on Databricks 101 and Getting Started with Azure Databricks. Today’s post is focused on accessing Azure Storage accounts.
How to Connect Azure Databricks to an Azure Storage Account
August 20, 2020
Azure, Azure Blob Storage, Azure Databricks, Azure Every Day
How to Connect Azure Databricks to an Azure Storage Account
A common discussion we’ve had lately is about using Azure Databricks within Azure Data Factory for ETL..png)
I’m excited to tell you more about the preview of the second generation of Azure Data Lake Store. One reason I’m excited about this preview is we often get asked about whether to use Data Lake Store or Blob storage for storing files – maybe in a data warehouse load scenario for instance where we use file storage as part of the pattern.
Are you ready to get in the cloud and build your first cloud data solution? I’d like to tell you the 4 things you should know as you build your first data solution in Azure.
When we talk about blob storage, we talk about the three different tiers – hot, cool or archive – for delegating the importance of data and how accessible it is. The challenge has been that when we picked the tier that was pretty much the end of story.
In today’s post I’ll look at some considerations for choosing to use Azure Blob Storage or Azure Data Lake Store when processing data to be loaded into a data warehouse. My basis here is a reference architecture that Microsoft published, see diagram below.
There’s a lot of talk about storage options. When working with customers, I often introduce them to Azure through storage, since it’s a great way to leverage cloud assets in a positive, non-threatening way.