lyft_set_incremental_marker_column

Sets incremental marker column for given table or view. The column will be later used for incremental load process. Maximum value found in that column will be used as next value of incremental marker for a view.

Given column should have monotonically increasing values. Otherwise, incremental load process will miss new data.

Syntax

lyft_set_incremental_marker_column 'object', 'columnName' [;]

Arguments

object'

Fully qualified name of view which incremental marker will be changed.

'columnName'

Name of the column in given table or view.

Example

Sets incremental marker column for 'AdventureWorksDW2012_spark.dbo.DimEmployee' view.

EXEC lyft_set_incremental_marker_column 'AdventureWorksDW2012_spark.dbo.DimEmployee', 'EmployeeKey';