com.mozilla.secops.customs

Class CustomsFeaturesCombiner

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,Event>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,CustomsFeatures>>>

com.mozilla.secops.customs.CustomsFeaturesCombiner

All Implemented Interfaces:

Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

public class CustomsFeaturesCombiner
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,Event>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,CustomsFeatures>>>

Combines windowed key/value collections into a collection of CustomsFeatures

CustomsFeaturesCombiner is a Combine.CombineFn that will combine a windowed collection of KV objects, where the key is an arbitrary string and the value is an event, into a collection of CustomsFeatures objects.

For each key in the input collection, all events keyed with that key are combined and processed together to extract features for the resulting output collection.

The key is a arbitrary string, for example a source IP address. In this case, the resulting CustomsFeatures object will contain features extracted for all events associated with that IP address.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CustomsFeaturesCombiner.CustomsFeaturesCombineFn Combine.CombineFn for creating collections of CustomsFeatures

Constructor Summary

Constructors

Constructor and Description
CustomsFeaturesCombiner()

Method Summary

Modifier and Type	Method and Description
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,CustomsFeatures>>	expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,Event>> input)

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

CustomsFeaturesCombiner

public CustomsFeaturesCombiner()

Method Detail

expand

public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,CustomsFeatures>> expand(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,Event>> input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,Event>>,org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<String,CustomsFeatures>>>