Mozilla Telemetry Data S3 Input

Retrieves/reads each file from the s3_file_list. The primary use of this sandbox is to feed the transformed/validated data into analysis plugins. Once the snappy ugliness is removed (Bugzilla #1250218) the generalized 'heka_s3.lua' input can be used instead.

1. Sample Configuration

filename        = "moz_telemetry_s3_snappy.lua"
s3_bucket       = "net-mozaws-prod-us-west-2-pipeline-data"
s3_file_list    = "telemetry_dims.ls.1"
tmp_dir         = "/mnt/work/tmp"

source code: moz_telemetry_s3_snappy.lua