Mozilla Telemetry Landfill Data S3 Input
Retrieves/reads each file from the s3_file_list
. The primary use of this
sandbox is to backfill the telemetry folder or to test new data
transformation/validation sandboxes.
1. Sample Configuration
filename = "moz_telemetry_s3_landfill.lua"
s3_bucket = "net-mozaws-prod-us-west-2-pipeline-data"
s3_file_list = "landfill_dims.ls.1"
tmp_dir = "/mnt/work/tmp"
schema_path = "./mozilla-pipeline-schemas"
passthru = false -- if true the raw message is injected as-is (nginx_moz_ingest test)
source code: moz_telemetry_s3_landfill.lua