Requirement: "The number of rows added to the Orders table during refreshes must be minimized." The Orders table has a sequential OrderID.
To minimize refresh size, you must only import new rows, not the entire table.
This requires retrieving the maximum OrderID currently loaded, then only loading rows with a greater OrderID.
So, the correct solution is to use a pipeline (ADF) with a dataflow to retrieve the maximum OrderID.
an Azure Data Factory pipeline that executes a dataflow to retrieve the maximum value of the OrderID column in the destination lakehouse