This component is experimental and therefore subject to change or removal outside of major version releases.
SELECT query against BigQuery and creates a message for each row received.
Introduced in version 3.63.0.
# Config fields, showing default values
Once the rows from the query are exhausted, this input shuts down, allowing the pipeline to gracefully terminate (or the next input in a sequence to execute).
- Word counts
Here we query the public corpus of Shakespeare's works to generate a stream of the top 10 words that are 3 or more characters long:
- sum(word_count) as total_count
where: length(word) >= ?
GROUP BY word
ORDER BY total_count DESC
root = [ 3 ]
GCP project where the query job will execute.
Fully-qualified BigQuery table name to query.
A list of columns to query.
An optional where clause to add. Placeholder arguments are populated with the
args_mapping field. Placeholders should always be question marks (
where: type = ? and created_at > ?
where: user_id = ?
A list of labels to add to the query job.
An optional Bloblang mapping which should evaluate to an array of values matching in size to the number of placeholder arguments in the field
args_mapping: root = [ "article", now().ts_format("2006-01-02") ]
An optional prefix to prepend to the select query (before SELECT).
An optional suffix to append to the select query.