Mozilla Telemetry Landfill Data S3 Input

Retrieves/reads each file from the s3_file_list. The primary use of this sandbox is to backfill the telemetry folder or to test new data transformation/validation sandboxes.

1. Sample Configuration

filename        = "moz_telemetry_s3_landfill.lua"
s3_bucket       = "net-mozaws-prod-us-west-2-pipeline-data"
s3_file_list    = "landfill_dims.ls.1"
tmp_dir         = "/mnt/work/tmp"
schema_path     = "./mozilla-pipeline-schemas"
passthru        = false -- if true the raw message is injected as-is (nginx_moz_ingest test)

source code: moz_telemetry_s3_landfill.lua

results matching ""

    No results matching ""