Skip to main content

blob_storage

DEPRECATED

This component is deprecated and will be removed in the next major version release. Please consider moving onto alternative components.

This component has been renamed to azure_blob_storage.

# Common config fields, showing default values
output:
label: ""
blob_storage:
storage_account: ""
storage_access_key: ""
storage_sas_token: ""
storage_connection_string: ""
container: ""
path: ${!count("files")}-${!timestamp_unix_nano()}.txt
max_in_flight: 1

Performance#

This output benefits from sending multiple messages in flight in parallel for improved performance. You can tune the max number of in flight messages with the field max_in_flight.

Fields#

storage_account#

The storage account to upload messages to. This field is ignored if storage_connection_string is set.

Type: string
Default: ""

storage_access_key#

The storage account access key. This field is ignored if storage_connection_string is set.

Type: string
Default: ""

storage_sas_token#

The storage account SAS token. This field is ignored if storage_connection_string or storage_access_key are set.

Type: string
Default: ""

storage_connection_string#

A storage account connection string. This field is required if storage_account and storage_access_key / storage_sas_token are not set.

Type: string
Default: ""

public_access_level#

The container's public access level. The default value is PRIVATE.

Type: string
Default: "PRIVATE"
Options: PRIVATE, BLOB, CONTAINER.

container#

The container for uploading the messages to. This field supports interpolation functions.

Type: string
Default: ""

# Examples
container: messages-${!timestamp("2006")}

path#

The path of each message to upload. This field supports interpolation functions.

Type: string
Default: "${!count(\"files\")}-${!timestamp_unix_nano()}.txt"

# Examples
path: ${!count("files")}-${!timestamp_unix_nano()}.json
path: ${!meta("kafka_key")}.json
path: ${!json("doc.namespace")}/${!json("doc.id")}.json

blob_type#

Block and Append blobs are comprised of blocks, and each blob can support up to 50,000 blocks. The default value is +"BLOCK"+.` This field supports interpolation functions.

Type: string
Default: "BLOCK"
Options: BLOCK, APPEND.

max_in_flight#

The maximum number of messages to have in flight at a given time. Increase this to improve throughput.

Type: number
Default: 1