Package gorsat.process

Class GorSpark

java.lang.Object

gorsat.process.GorSpark

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,org.gorpipe.gor.model.Row>

Direct Known Subclasses:

GorSparkMaterialize

public class GorSpark
extends Object
implements org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,org.gorpipe.gor.model.Row>

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
GorSpark(String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, String gorcmd, String gorroot)
GorSpark(String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, String gorcmd, String gorroot, String uri, String jobId)

Method Summary

Modifier and Type	Method	Description
Iterator<org.gorpipe.gor.model.Row>	call(Iterator<org.gorpipe.gor.model.Row> iterator)
gorsat.process.PipeInstance	query()
void	setSchema(org.apache.spark.sql.types.StructType st)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

GorSpark

public GorSpark(String inputHeader,
 boolean nor,
 org.apache.spark.sql.types.StructType schema,
 String gorcmd,
 String gorroot)

GorSpark

public GorSpark(String inputHeader,
 boolean nor,
 org.apache.spark.sql.types.StructType schema,
 String gorcmd,
 String gorroot,
 String uri,
 String jobId)

Method Details

setSchema

public void setSchema(org.apache.spark.sql.types.StructType st)

query

public gorsat.process.PipeInstance query()

call

public Iterator<org.gorpipe.gor.model.Row> call(Iterator<org.gorpipe.gor.model.Row> iterator)

Specified by:

call in interface org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,org.gorpipe.gor.model.Row>