com.mozilla.secops.input

Class InputCollectionCache

java.lang.Object

com.mozilla.secops.input.InputCollectionCache

public class InputCollectionCache
extends Object

The input collection cache is used to optimize the graph for duplicate stream reads within the Input class.

Constructor Summary

Constructors

Constructor and Description
InputCollectionCache() Initialize collection cache

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.values.PCollection<String>	fileInput(org.apache.beam.sdk.values.PBegin begin, String name) Request file input
org.apache.beam.sdk.values.PCollection<String>	kinesisInput(org.apache.beam.sdk.values.PBegin begin, String name, String project) Request Kinesis input
org.apache.beam.sdk.values.PCollection<String>	pubsubInput(org.apache.beam.sdk.values.PBegin begin, String name) Request Pubsub input

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InputCollectionCache

public InputCollectionCache()

Initialize collection cache

Method Detail

fileInput

public org.apache.beam.sdk.values.PCollection<String> fileInput(org.apache.beam.sdk.values.PBegin begin,
                                                                String name)

Request file input

Parameters:

begin - Pipeline begin

name - File input path

Returns:

PCollection

pubsubInput

public org.apache.beam.sdk.values.PCollection<String> pubsubInput(org.apache.beam.sdk.values.PBegin begin,
                                                                  String name)

Request Pubsub input

Parameters:

begin - Pipeline begin

name - Pubsub topic

Returns:

PCollection

kinesisInput

public org.apache.beam.sdk.values.PCollection<String> kinesisInput(org.apache.beam.sdk.values.PBegin begin,
                                                                   String name,
                                                                   String project)

Request Kinesis input

Parameters:

begin - Pipeline begin

name - Kinesis input specification

project - Project name if CloudKMS decryption is required for specification

Returns:

PCollection