Package org.gorpipe.spark

Class SparkGorExecutionEngine

java.lang.Object

gorsat.process.GorExecutionEngine

org.gorpipe.spark.SparkGorExecutionEngine

public class SparkGorExecutionEngine
extends gorsat.process.GorExecutionEngine

Constructor Summary

Constructors

Constructor	Description
SparkGorExecutionEngine(String query, String projectDirectory, String cacheDirectory, String configFile, String aliasFile, String outfile, String securityContext, org.gorpipe.gor.monitor.GorMonitor sparkMonitor)
SparkGorExecutionEngine(String query, String projectDirectory, String cacheDirectory, String configFile, String aliasFile, String outfile, String securityContext, org.gorpipe.gor.monitor.GorMonitor sparkMonitor, int workers)

Method Summary

Modifier and Type	Method	Description
gorsat.process.PipeInstance	createIterator(org.gorpipe.gor.session.GorSession session)
org.gorpipe.gor.session.GorRunner	createRunner(org.gorpipe.gor.session.GorSession session)
org.gorpipe.gor.session.GorSession	createSession()
void	execute()

Methods inherited from class gorsat.process.GorExecutionEngine

session, session_$eq

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SparkGorExecutionEngine

public SparkGorExecutionEngine(String query,
 String projectDirectory,
 String cacheDirectory,
 String configFile,
 String aliasFile,
 String outfile,
 String securityContext,
 org.gorpipe.gor.monitor.GorMonitor sparkMonitor)

SparkGorExecutionEngine

public SparkGorExecutionEngine(String query,
 String projectDirectory,
 String cacheDirectory,
 String configFile,
 String aliasFile,
 String outfile,
 String securityContext,
 org.gorpipe.gor.monitor.GorMonitor sparkMonitor,
 int workers)

Method Details

execute

public void execute()

Overrides:

execute in class gorsat.process.GorExecutionEngine

createSession

public org.gorpipe.gor.session.GorSession createSession()

Specified by:

createSession in class gorsat.process.GorExecutionEngine

createIterator

public gorsat.process.PipeInstance createIterator(org.gorpipe.gor.session.GorSession session)

Specified by:

createIterator in class gorsat.process.GorExecutionEngine

createRunner

public org.gorpipe.gor.session.GorRunner createRunner(org.gorpipe.gor.session.GorSession session)

Specified by:

createRunner in class gorsat.process.GorExecutionEngine