Package gorsat.process

Class GorSpark

  • All Implemented Interfaces:
    java.io.Serializable, org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,​org.gorpipe.gor.model.Row>
    Direct Known Subclasses:
    GorSparkMaterialize
    public class GorSpark
extends java.lang.Object
implements org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,​org.gorpipe.gor.model.Row>
    See Also:
    Serialized Form

    • Constructor Summary

      Constructors 
      Constructor Description
      GorSpark​(java.lang.String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, java.lang.String gorcmd, java.lang.String gorroot)  
      GorSpark​(java.lang.String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, java.lang.String gorcmd, java.lang.String gorroot, java.lang.String uri, java.lang.String jobId)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      java.util.Iterator<org.gorpipe.gor.model.Row> call​(java.util.Iterator<org.gorpipe.gor.model.Row> iterator)  
      gorsat.process.PipeInstance query()  
      void setSchema​(org.apache.spark.sql.types.StructType st)  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • GorSpark

        public GorSpark​(java.lang.String inputHeader,
                boolean nor,
                org.apache.spark.sql.types.StructType schema,
                java.lang.String gorcmd,
                java.lang.String gorroot)

      • GorSpark

        public GorSpark​(java.lang.String inputHeader,
                boolean nor,
                org.apache.spark.sql.types.StructType schema,
                java.lang.String gorcmd,
                java.lang.String gorroot,
                java.lang.String uri,
                java.lang.String jobId)

    • Method Detail

      • setSchema

        public void setSchema​(org.apache.spark.sql.types.StructType st)

      • query

        public gorsat.process.PipeInstance query()

      • call

        public java.util.Iterator<org.gorpipe.gor.model.Row> call​(java.util.Iterator<org.gorpipe.gor.model.Row> iterator)
        Specified by:
        call in interface org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,​org.gorpipe.gor.model.Row>