appmixer.google.bigquery.NewRow

Component Details

v1.0.2

Basic Information

appmixer.google.bigquery.NewRow

1.0.2

Public

Tracks new rows added to your BigQuery dataset. A temporary storage will be created while the flow is running for this trigger, and it will be automatically removed when the flow stops. To ensure continuous operation, kindly refrain from altering or deleting the storage during the flow's execution.

Properties

FieldTypeDescription
Project select Select a BigQuery project from the list to run your query in.
Detect new rows while stopped toggle If this is set to true, rows that are added while the flow was stopped will be processed next time the flow is started.
SQL Query textarea Enter an SQL query. If your query contains a ? character placeholder, then the NewRow component replaces the placeholder with the last timestamp (milliseconds since epoch) the component was triggered to query only data that has been added since the the last time the component was triggered. Note that the replaced timestamp is an integer, so you might need to use a function like TIMESTAMP_MILLIS to make date comparisons. Also note that this is only possible if your result set contains an "created_at" type of field. A typical use case is, e.g. select * from myproject.mydataset.mytable where created_at > TIMESTAMP_MILLIS(?). If you do not provide the ? placeholder, then the component will always query all data periodically.
ID field text Select a column that will be used as reference to detect new rows. It should be an unique field.

Output Ports

out

FieldTypeDescription
Row -

Full Metadata