com.mozilla.secops.input

Class KinesisInput

java.lang.Object

com.mozilla.secops.input.KinesisInput

All Implemented Interfaces:

Serializable

public class KinesisInput
extends Object
implements Serializable

Configuration for a single Kinesis input

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
KinesisInput()

Method Summary

Modifier and Type	Method and Description
static KinesisInput	fromInputSpecifier(String spec, String project) Parse Kinesis input specification into configuration
org.apache.beam.sdk.values.PCollection<String>	toCollection(org.apache.beam.sdk.values.PBegin begin) Apply KinesisIO using configuration set in object

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KinesisInput

public KinesisInput()

Method Detail

toCollection

public org.apache.beam.sdk.values.PCollection<String> toCollection(org.apache.beam.sdk.values.PBegin begin)

Apply KinesisIO using configuration set in object

When executed, will apply the KinesisIO transform in addition to a ParDo which splits individual elements by new line, returning raw strings read from the stream.

Parameters:

begin - Pipeline begin

Returns:

Collection of strings

fromInputSpecifier

public static KinesisInput fromInputSpecifier(String spec,
                                              String project)

Parse Kinesis input specification into configuration

Specification format: streamname:access id:access secret:region

The specification processor supports RuntimeSecrets, and may therefore also be a cloudkms:// URL or a GCS URL.

Parameters:

spec - Input specification

project - GCP project if specification is encrypted with RuntimeSecrets, null otherwise

Returns:

KinesisInput