Package gorsat.spark

Class GorScanBuilder

java.lang.Object

gorsat.spark.GorScanBuilder

All Implemented Interfaces:

org.apache.spark.sql.connector.read.Batch, org.apache.spark.sql.connector.read.Scan, org.apache.spark.sql.connector.read.ScanBuilder, org.apache.spark.sql.connector.read.SupportsPushDownFilters

Direct Known Subclasses:

GorSpecificScanBuilder

public abstract class GorScanBuilder
extends Object
implements org.apache.spark.sql.connector.read.ScanBuilder, org.apache.spark.sql.connector.read.Scan, org.apache.spark.sql.connector.read.Batch, org.apache.spark.sql.connector.read.SupportsPushDownFilters

Constructor Summary

Constructors

Constructor	Description
GorScanBuilder(org.apache.spark.sql.types.StructType schema, String redisUri, String streamKey, String jobId, String cacheFile, String projectRoot, String cacheDir, String configFile, String aliasFile, String securityContext, String useCpp)

Method Summary

Modifier and Type	Method	Description
org.apache.spark.sql.connector.read.Scan	build()
org.apache.spark.sql.connector.read.PartitionReaderFactory	createReaderFactory()
org.apache.spark.sql.types.StructType	readSchema()
org.apache.spark.sql.connector.read.Batch	toBatch()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.connector.read.Batch

planInputPartitions

Methods inherited from interface org.apache.spark.sql.connector.read.Scan

description, supportedCustomMetrics, toContinuousStream, toMicroBatchStream

Methods inherited from interface org.apache.spark.sql.connector.read.SupportsPushDownFilters

pushedFilters, pushFilters

Constructor Details

GorScanBuilder

public GorScanBuilder(org.apache.spark.sql.types.StructType schema,
 String redisUri,
 String streamKey,
 String jobId,
 String cacheFile,
 String projectRoot,
 String cacheDir,
 String configFile,
 String aliasFile,
 String securityContext,
 String useCpp)

Method Details

build

public org.apache.spark.sql.connector.read.Scan build()

Specified by:

build in interface org.apache.spark.sql.connector.read.ScanBuilder

toBatch

public org.apache.spark.sql.connector.read.Batch toBatch()

Specified by:

toBatch in interface org.apache.spark.sql.connector.read.Scan

readSchema

public org.apache.spark.sql.types.StructType readSchema()

Specified by:

readSchema in interface org.apache.spark.sql.connector.read.Scan

createReaderFactory

public org.apache.spark.sql.connector.read.PartitionReaderFactory createReaderFactory()

Specified by:

createReaderFactory in interface org.apache.spark.sql.connector.read.Batch