December 2018 - The Data Guy

Month: December 2018

Auto Process files added to Azure Storage Account using Databricks

Posted on December 5, 2018May 8, 2019 by benjaminleroux

Have you ever wanted to process in near real time new files added to your Azure Storage account (BLOB)? Have you tried using Azure EventHub but files are too large to make this a practical solution? Let me present you...Read More

Managing passwords and secrets in Azure Databricks with KeyVault

Posted on December 5, 2018May 8, 2019 by benjaminleroux

Continuing on my previous post, changes in the integration between Databricks and Azure have made things even easier... I'm referring to secrets within Databricks and Azure KeyVault. First, you will need to create a KeyVault resource within Azure. The following...Read More