Package gorsat.process

Class GorSparkMaterialize

java.lang.Object

gorsat.process.GorSpark

gorsat.process.GorSparkMaterialize

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,org.gorpipe.gor.model.Row>

public class GorSparkMaterialize
extends GorSpark

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
GorSparkMaterialize(String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, String gorcmd, String gorroot, int max)
GorSparkMaterialize(String inputHeader, boolean nor, org.apache.spark.sql.types.StructType schema, String gorcmd, String gorroot, String uri, String jobId, int max)

Method Summary

Modifier and Type	Method	Description
Iterator<org.gorpipe.gor.model.Row>	call(Iterator<org.gorpipe.gor.model.Row> iterator)

Methods inherited from class gorsat.process.GorSpark

query, setSchema

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

GorSparkMaterialize

public GorSparkMaterialize(String inputHeader,
 boolean nor,
 org.apache.spark.sql.types.StructType schema,
 String gorcmd,
 String gorroot,
 int max)

GorSparkMaterialize

public GorSparkMaterialize(String inputHeader,
 boolean nor,
 org.apache.spark.sql.types.StructType schema,
 String gorcmd,
 String gorroot,
 String uri,
 String jobId,
 int max)

Method Details

call

public Iterator<org.gorpipe.gor.model.Row> call(Iterator<org.gorpipe.gor.model.Row> iterator)

Specified by:

call in interface org.apache.spark.api.java.function.MapPartitionsFunction<org.gorpipe.gor.model.Row,org.gorpipe.gor.model.Row>

Overrides:

call in class GorSpark