Package org.apache.nemo.compiler.frontend.beam.transform

Class AbstractDoFnTransform<InputT,InterT,OutputT>

java.lang.Object

org.apache.nemo.compiler.frontend.beam.transform.AbstractDoFnTransform<InputT,InterT,OutputT>

Type Parameters:

InputT - input type.

InterT - intermediate type.

OutputT - output type.

All Implemented Interfaces:

java.io.Serializable, Transform<org.apache.beam.sdk.util.WindowedValue<InputT>,org.apache.beam.sdk.util.WindowedValue<OutputT>>

Direct Known Subclasses:

DoFnTransform, GBKTransform, PushBackDoFnTransform

public abstract class AbstractDoFnTransform<InputT,InterT,OutputT>
extends java.lang.Object
implements Transform<org.apache.beam.sdk.util.WindowedValue<InputT>,org.apache.beam.sdk.util.WindowedValue<OutputT>>

This is a base class for Beam DoFn Transforms.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.nemo.common.ir.vertex.transform.Transform

Transform.Context

Constructor Summary

Constructors

Constructor

Description

AbstractDoFnTransform(org.apache.beam.sdk.transforms.DoFn<InterT,OutputT> doFn, org.apache.beam.sdk.coders.Coder<InputT> inputCoder, java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.coders.Coder<?>> outputCoders, org.apache.beam.sdk.values.TupleTag<OutputT> mainOutputTag, java.util.List<org.apache.beam.sdk.values.TupleTag<?>> additionalOutputTags, org.apache.beam.sdk.values.WindowingStrategy<?,?> windowingStrategy, java.util.Map<java.lang.Integer,org.apache.beam.sdk.values.PCollectionView<?>> sideInputs, org.apache.beam.sdk.options.PipelineOptions options, org.apache.beam.sdk.transforms.display.DisplayData displayData, org.apache.beam.sdk.transforms.DoFnSchemaInformation doFnSchemaInformation, java.util.Map<java.lang.String,org.apache.beam.sdk.values.PCollectionView<?>> sideInputMapping)

AbstractDoFnTransform constructor.

Method Summary

Modifier and Type	Method	Description
void	close()	Close the transform.
org.apache.beam.sdk.transforms.DoFn<InterT,OutputT>	getDoFn()	Getter function for DoFn.
OutputCollector<org.apache.beam.sdk.util.WindowedValue<OutputT>>	getOutputCollector()	Getter function for output collector.
void	onLatencymark(LatencyMark latencymark)	On latencymark received.
void	prepare(Transform.Context context, OutputCollector<org.apache.beam.sdk.util.WindowedValue<OutputT>> oc)	Prepare the transform.
java.lang.String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.nemo.common.ir.vertex.transform.Transform

onData, onWatermark

Constructor Detail

AbstractDoFnTransform

public AbstractDoFnTransform(org.apache.beam.sdk.transforms.DoFn<InterT,OutputT> doFn,
                             org.apache.beam.sdk.coders.Coder<InputT> inputCoder,
                             java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.coders.Coder<?>> outputCoders,
                             org.apache.beam.sdk.values.TupleTag<OutputT> mainOutputTag,
                             java.util.List<org.apache.beam.sdk.values.TupleTag<?>> additionalOutputTags,
                             org.apache.beam.sdk.values.WindowingStrategy<?,?> windowingStrategy,
                             java.util.Map<java.lang.Integer,org.apache.beam.sdk.values.PCollectionView<?>> sideInputs,
                             org.apache.beam.sdk.options.PipelineOptions options,
                             org.apache.beam.sdk.transforms.display.DisplayData displayData,
                             org.apache.beam.sdk.transforms.DoFnSchemaInformation doFnSchemaInformation,
                             java.util.Map<java.lang.String,org.apache.beam.sdk.values.PCollectionView<?>> sideInputMapping)

AbstractDoFnTransform constructor.

Parameters:

doFn - doFn

inputCoder - input coder

outputCoders - output coders

mainOutputTag - main output tag

additionalOutputTags - additional output tags

windowingStrategy - windowing strategy

sideInputs - side inputs

options - pipeline options

displayData - display data.

doFnSchemaInformation - doFn schema information.

sideInputMapping - side input mapping.

Method Detail

getDoFn

public final org.apache.beam.sdk.transforms.DoFn<InterT,OutputT> getDoFn()

Getter function for DoFn.

Returns:

DoFn.

prepare

public final void prepare(Transform.Context context,
                          OutputCollector<org.apache.beam.sdk.util.WindowedValue<OutputT>> oc)

Description copied from interface: Transform

Prepare the transform.

Specified by:

prepare in interface Transform<InputT,InterT>

Parameters:

context - of the transform.

oc - that collects outputs.

getOutputCollector

public final OutputCollector<org.apache.beam.sdk.util.WindowedValue<OutputT>> getOutputCollector()

Getter function for output collector.

Returns:

output collector.

onLatencymark

public void onLatencymark(LatencyMark latencymark)

On latencymark received.

Specified by:

onLatencymark in interface Transform<InputT,InterT>

Parameters:

latencymark - latencymark.

close

public final void close()

Description copied from interface: Transform

Close the transform.

Specified by:

close in interface Transform<InputT,InterT>

toString

public final java.lang.String toString()

Overrides:

toString in class java.lang.Object