Skip to content
The Data Guy

The Data Guy

  • Home
  • My Data Blogs
  • My Network Blogs
Auto Process files added to Azure Storage Account using Databricks

Auto Process files added to Azure Storage Account using Databricks

Posted on December 5, 2018July 22, 2020 by benjaminleroux

Have you ever wanted to process in near real time new files added to your Azure Storage account (BLOB)? Have you tried using Azure EventHub but files are too large to make this a practical solution?

Let me present you to ABS-AQS file source…

Posted in Big Data, DatabricksTagged Azure, BLOB, Databricks, Streaming8 Comments
  • Archives

    • April 2020 (1)
    • May 2019 (1)
    • April 2019 (1)
    • January 2019 (1)
    • December 2018 (2)
    • March 2018 (1)
  • Categories

    • Azure SQL (2)
    • Big Data (6)
    • Data (1)
    • Databricks (7)
  • Admin stuff

    • Log in
    • Entries feed
    • Comments feed
    • WordPress.org