Package org.apache.nemo.examples.beam

Class WriteOneFilePerWindow

  • All Implemented Interfaces:
    java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData
    public final class WriteOneFilePerWindow
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<java.lang.String>,​org.apache.beam.sdk.values.PDone>
    This class is brought from beam/examples/common/WriteOneFilePerWindow.java.
    See Also:
    Serialized Form

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description
      static class  WriteOneFilePerWindow.PerWindowFiles
      A FileBasedSink.FilenamePolicy produces a base file name for a write based on metadata about the data being written.

    • Field Summary

      • Fields inherited from class org.apache.beam.sdk.transforms.PTransform

        name

    • Constructor Summary

      Constructors 
      Constructor Description
      WriteOneFilePerWindow​(java.lang.String filenamePrefix, java.lang.Integer numShards)
      Constructor.

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.beam.sdk.values.PDone expand​(org.apache.beam.sdk.values.PCollection<java.lang.String> input)  

      • Methods inherited from class org.apache.beam.sdk.transforms.PTransform

        compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, populateDisplayData, toString, validate

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    • Constructor Detail

      • WriteOneFilePerWindow

        public WriteOneFilePerWindow​(java.lang.String filenamePrefix,
                             java.lang.Integer numShards)
        Constructor.
        Parameters:
        filenamePrefix - file name prefix.
        numShards - number of shards.

    • Method Detail

      • expand

        public org.apache.beam.sdk.values.PDone expand​(org.apache.beam.sdk.values.PCollection<java.lang.String> input)
        Specified by:
        expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<java.lang.String>,​org.apache.beam.sdk.values.PDone>