Package gorsat.process

Class GorSpark

java.lang.Object
gorsat.process.GorSpark
All Implemented Interfaces:
java.io.Serializable, org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,​org.gorpipe.gor.model.Row>
Direct Known Subclasses:
GorSparkMaterialize
public class GorSpark
extends java.lang.Object
implements org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,​org.gorpipe.gor.model.Row>
See Also:
Serialized Form

  • Constructor Summary

    Constructors 
    Constructor Description
    GorSpark​(java.lang.String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, java.lang.String gorcmd, java.lang.String gorroot)  
    GorSpark​(java.lang.String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, java.lang.String gorcmd, java.lang.String gorroot, java.lang.String uri, java.lang.String jobId)  

  • Method Summary

    Modifier and Type Method Description
    java.util.Iterator<org.gorpipe.gor.model.Row> call​(java.util.Iterator<org.gorpipe.gor.model.Row> iterator)  
    gorsat.process.PipeInstance query()  
    void setSchema​(org.apache.spark.sql.types.StructType st)  

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • GorSpark

      public GorSpark​(java.lang.String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, java.lang.String gorcmd, java.lang.String gorroot)

    • GorSpark

      public GorSpark​(java.lang.String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, java.lang.String gorcmd, java.lang.String gorroot, java.lang.String uri, java.lang.String jobId)

  • Method Details

    • setSchema

      public void setSchema​(org.apache.spark.sql.types.StructType st)

    • query

      public gorsat.process.PipeInstance query()

    • call

      public java.util.Iterator<org.gorpipe.gor.model.Row> call​(java.util.Iterator<org.gorpipe.gor.model.Row> iterator)
      Specified by:
      call in interface org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,​org.gorpipe.gor.model.Row>