Package org.gorpipe.spark

Class GeneralSparkQueryHandler

java.lang.Object

org.gorpipe.spark.GeneralSparkQueryHandler

All Implemented Interfaces:

org.gorpipe.gor.model.GorParallelQueryHandler

public class GeneralSparkQueryHandler
extends Object
implements org.gorpipe.gor.model.GorParallelQueryHandler

Field Summary

Fields

Modifier and Type	Field	Description
static final String	queue

Constructor Summary

Constructors

Constructor	Description
GeneralSparkQueryHandler()
GeneralSparkQueryHandler(org.gorpipe.spark.GorSparkSession gorPipeSession)

Method Summary

Modifier and Type	Method	Description
String[]	executeBatch(String[] fingerprints, String[] commandsToExecute, String[] batchGroupNames, String[] cacheFiles, org.gorpipe.gor.monitor.GorMonitor mon)
static String[]	executeSparkBatch(org.gorpipe.spark.GorSparkSession session, String projectDir, String cacheDir, String[] fingerprints, String[] commandsToExecute, String[] jobIds, String[] cacheFiles, String[] securityContext, Boolean[] allowToFail)
long	getWaitTime()
void	init(org.gorpipe.spark.GorSparkSession gorPipeSession)
void	setForce(boolean force)
void	setQueryTime(Long time)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

queue

public static final String queue

See Also:

• Constant Field Values

Constructor Details

GeneralSparkQueryHandler

public GeneralSparkQueryHandler(org.gorpipe.spark.GorSparkSession gorPipeSession)

GeneralSparkQueryHandler

public GeneralSparkQueryHandler()

Method Details

init

public void init(org.gorpipe.spark.GorSparkSession gorPipeSession)

executeSparkBatch

public static String[] executeSparkBatch(org.gorpipe.spark.GorSparkSession session,
 String projectDir,
 String cacheDir,
 String[] fingerprints,
 String[] commandsToExecute,
 String[] jobIds,
 String[] cacheFiles,
 String[] securityContext,
 Boolean[] allowToFail)

executeBatch

public String[] executeBatch(String[] fingerprints,
 String[] commandsToExecute,
 String[] batchGroupNames,
 String[] cacheFiles,
 org.gorpipe.gor.monitor.GorMonitor mon)

Specified by:

executeBatch in interface org.gorpipe.gor.model.GorParallelQueryHandler

setForce

public void setForce(boolean force)

Specified by:

setForce in interface org.gorpipe.gor.model.GorParallelQueryHandler

setQueryTime

public void setQueryTime(Long time)

Specified by:

setQueryTime in interface org.gorpipe.gor.model.GorParallelQueryHandler

getWaitTime

public long getWaitTime()

Specified by:

getWaitTime in interface org.gorpipe.gor.model.GorParallelQueryHandler