hdfs

Reads files from a HDFS directory, where each discrete file will be consumed as a single message payload.

input:
hdfs:
hosts:
- localhost:9000
user: benthos_hdfs
directory: ""

Metadata

This input adds the following metadata fields to each message:

- hdfs_name
- hdfs_path

You can access these metadata fields using function interpolation.

Fields

hosts

array A list of target host addresses to connect to.

user

string A user ID to connect as.

directory

string The directory to consume from.