Package gorsat.spark

Class GorScanBuilder

  • All Implemented Interfaces:
    org.apache.spark.sql.connector.read.Batch, org.apache.spark.sql.connector.read.Scan, org.apache.spark.sql.connector.read.ScanBuilder, org.apache.spark.sql.connector.read.SupportsPushDownFilters
    Direct Known Subclasses:
    GorSpecificScanBuilder
    public abstract class GorScanBuilder
extends java.lang.Object
implements org.apache.spark.sql.connector.read.ScanBuilder, org.apache.spark.sql.connector.read.Scan, org.apache.spark.sql.connector.read.Batch, org.apache.spark.sql.connector.read.SupportsPushDownFilters

    • Constructor Summary

      Constructors 
      Constructor Description
      GorScanBuilder​(org.apache.spark.sql.types.StructType schema, java.lang.String redisUri, java.lang.String streamKey, java.lang.String jobId, java.lang.String cacheFile, java.lang.String projectRoot, java.lang.String cacheDir, java.lang.String configFile, java.lang.String aliasFile, java.lang.String securityContext, java.lang.String useCpp)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.spark.sql.connector.read.Scan build()  
      org.apache.spark.sql.connector.read.PartitionReaderFactory createReaderFactory()  
      org.apache.spark.sql.types.StructType readSchema()  
      org.apache.spark.sql.connector.read.Batch toBatch()  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

      • Methods inherited from interface org.apache.spark.sql.connector.read.Batch

        planInputPartitions

      • Methods inherited from interface org.apache.spark.sql.connector.read.Scan

        description, supportedCustomMetrics, toContinuousStream, toMicroBatchStream

      • Methods inherited from interface org.apache.spark.sql.connector.read.SupportsPushDownFilters

        pushedFilters, pushFilters

    • Constructor Detail

      • GorScanBuilder

        public GorScanBuilder​(org.apache.spark.sql.types.StructType schema,
                      java.lang.String redisUri,
                      java.lang.String streamKey,
                      java.lang.String jobId,
                      java.lang.String cacheFile,
                      java.lang.String projectRoot,
                      java.lang.String cacheDir,
                      java.lang.String configFile,
                      java.lang.String aliasFile,
                      java.lang.String securityContext,
                      java.lang.String useCpp)

    • Method Detail

      • build

        public org.apache.spark.sql.connector.read.Scan build()
        Specified by:
        build in interface org.apache.spark.sql.connector.read.ScanBuilder

      • toBatch

        public org.apache.spark.sql.connector.read.Batch toBatch()
        Specified by:
        toBatch in interface org.apache.spark.sql.connector.read.Scan

      • readSchema

        public org.apache.spark.sql.types.StructType readSchema()
        Specified by:
        readSchema in interface org.apache.spark.sql.connector.read.Scan

      • createReaderFactory

        public org.apache.spark.sql.connector.read.PartitionReaderFactory createReaderFactory()
        Specified by:
        createReaderFactory in interface org.apache.spark.sql.connector.read.Batch