Must use an Azure Data Factory, not an Azure Databricks job. Correct solution: You use an Azure Data Factory schedule trigger to execute a pipeline that executes an Azure Databricks notebook, and then inserts the data into the data warehouse. Reference: https://docs.microsoft.com/en-US/azure/data-factory/transform-data