com.mozilla.secops.customs

Class CustomsPreFilter

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<Event,Event>

com.mozilla.secops.customs.CustomsPreFilter

All Implemented Interfaces:

Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

public class CustomsPreFilter
extends org.apache.beam.sdk.transforms.DoFn<Event,Event>

Basic filtering of ingested events prior to analysis application

This DoFn will split events up based on type. Configuration ticks are emitted in the main output collection which contains FxA authentication server events.

For FXAAUTH events, this DoFn will filter any events from the input collection that are not returned in Customs.featureSummaryRegistration().

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

org.apache.beam.sdk.transforms.DoFn.AlwaysFetched, org.apache.beam.sdk.transforms.DoFn.BoundedPerElement, org.apache.beam.sdk.transforms.DoFn.BundleFinalizer, org.apache.beam.sdk.transforms.DoFn.Element, org.apache.beam.sdk.transforms.DoFn.FieldAccess, org.apache.beam.sdk.transforms.DoFn.FinishBundle, org.apache.beam.sdk.transforms.DoFn.FinishBundleContext, org.apache.beam.sdk.transforms.DoFn.GetInitialRestriction, org.apache.beam.sdk.transforms.DoFn.GetInitialWatermarkEstimatorState, org.apache.beam.sdk.transforms.DoFn.GetRestrictionCoder, org.apache.beam.sdk.transforms.DoFn.GetSize, org.apache.beam.sdk.transforms.DoFn.GetWatermarkEstimatorStateCoder, org.apache.beam.sdk.transforms.DoFn.Key, org.apache.beam.sdk.transforms.DoFn.MultiOutputReceiver, org.apache.beam.sdk.transforms.DoFn.NewTracker, org.apache.beam.sdk.transforms.DoFn.NewWatermarkEstimator, org.apache.beam.sdk.transforms.DoFn.OnTimer, org.apache.beam.sdk.transforms.DoFn.OnTimerContext, org.apache.beam.sdk.transforms.DoFn.OnTimerFamily, org.apache.beam.sdk.transforms.DoFn.OnWindowExpiration, org.apache.beam.sdk.transforms.DoFn.OnWindowExpirationContext, org.apache.beam.sdk.transforms.DoFn.OutputReceiver<T>, org.apache.beam.sdk.transforms.DoFn.ProcessContext, org.apache.beam.sdk.transforms.DoFn.ProcessContinuation, org.apache.beam.sdk.transforms.DoFn.ProcessElement, org.apache.beam.sdk.transforms.DoFn.RequiresStableInput, org.apache.beam.sdk.transforms.DoFn.RequiresTimeSortedInput, org.apache.beam.sdk.transforms.DoFn.Restriction, org.apache.beam.sdk.transforms.DoFn.Setup, org.apache.beam.sdk.transforms.DoFn.SideInput, org.apache.beam.sdk.transforms.DoFn.SplitRestriction, org.apache.beam.sdk.transforms.DoFn.StartBundle, org.apache.beam.sdk.transforms.DoFn.StartBundleContext, org.apache.beam.sdk.transforms.DoFn.StateId, org.apache.beam.sdk.transforms.DoFn.Teardown, org.apache.beam.sdk.transforms.DoFn.TimerFamily, org.apache.beam.sdk.transforms.DoFn.TimerId, org.apache.beam.sdk.transforms.DoFn.Timestamp, org.apache.beam.sdk.transforms.DoFn.TruncateRestriction, org.apache.beam.sdk.transforms.DoFn.UnboundedPerElement, org.apache.beam.sdk.transforms.DoFn.WatermarkEstimatorState, org.apache.beam.sdk.transforms.DoFn.WindowedContext

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.beam.sdk.values.TupleTag<Event>	TAG_FXA_AUTH_EVENTS Tuple tag used for FxA auth events
static org.apache.beam.sdk.values.TupleTag<Event>	TAG_FXA_CONTENT_EVENTS
static org.apache.beam.sdk.values.TupleTag<Event>	TAG_RELAY_EVENTS Tuple tag used for private relay events

Constructor Summary

Constructors

Constructor and Description
CustomsPreFilter()

Method Summary

Modifier and Type	Method and Description
void	processElement(org.apache.beam.sdk.transforms.DoFn.ProcessContext c)
void	setup()

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TAG_FXA_AUTH_EVENTS

public static final org.apache.beam.sdk.values.TupleTag<Event> TAG_FXA_AUTH_EVENTS

Tuple tag used for FxA auth events

TAG_RELAY_EVENTS

public static final org.apache.beam.sdk.values.TupleTag<Event> TAG_RELAY_EVENTS

Tuple tag used for private relay events

TAG_FXA_CONTENT_EVENTS

public static final org.apache.beam.sdk.values.TupleTag<Event> TAG_FXA_CONTENT_EVENTS

Constructor Detail

CustomsPreFilter

public CustomsPreFilter()

Method Detail

setup

@DoFn.Setup
public void setup()

processElement

@DoFn.ProcessElement
public void processElement(org.apache.beam.sdk.transforms.DoFn.ProcessContext c)