Basic Information

appmixer.google.bigquery.UpdatedRow

1.0.3

Public

Watch for row updates in your BigQuery dataset.

Properties

FieldTypeDescription
Project select Select a BigQuery project from the list to run your query in.
Detect updated rows while stopped toggle If this is set to true, rows that are updated while the flow was stopped will be processed next time the flow is started.
SQL Query textarea Enter an SQL query. If your query contains a ? character placeholder, then the UpdatedRow component replaces the placeholder with the last timestamp (milliseconds since epoch) the component was triggered to query only data that has been added since the the last time the component was triggered. Note that the replaced timestamp is an integer, so you might need to use a function like TIMESTAMP_MILLIS to make date comparisons. Also note that this is only possible if your result set contains an "updated_at" type of field. A typical use case is, e.g. select * from myproject.mydataset.mytable where updated_at > TIMESTAMP_MILLIS(?). If you do not provide the ? placeholder, then the component will always query all data periodically.
ID field text Select a column that will be used as reference to detect updated rows. It should be an unique field.
Reference Fields text A comma separated list of fields from the query result set that will be used to check for changes in rows. If you do not provide Reference Fields, any change in any field is detected.

Output Ports

Full Metadata