Mozilla Telemetry Data S3 Input
Retrieves/reads each file from the
s3_file_list. The primary use of this
sandbox is to feed the transformed/validated data into analysis plugins. Once
the snappy ugliness is removed (Bugzilla #1250218) the generalized 'heka_s3.lua'
input can be used instead.
1. Sample Configuration
filename = "moz_telemetry_s3_snappy.lua" s3_bucket = "net-mozaws-prod-us-west-2-pipeline-data" s3_file_list = "telemetry_dims.ls.1" tmp_dir = "/mnt/work/tmp"
source code: moz_telemetry_s3_snappy.lua