Package gorsat.spark

Class GorScanBuilder

java.lang.Object
gorsat.spark.GorScanBuilder
All Implemented Interfaces:
org.apache.spark.sql.connector.read.Batch, org.apache.spark.sql.connector.read.Scan, org.apache.spark.sql.connector.read.ScanBuilder, org.apache.spark.sql.connector.read.SupportsPushDownFilters
Direct Known Subclasses:
GorSpecificScanBuilder
public abstract class GorScanBuilder
extends java.lang.Object
implements org.apache.spark.sql.connector.read.ScanBuilder, org.apache.spark.sql.connector.read.Scan, org.apache.spark.sql.connector.read.Batch, org.apache.spark.sql.connector.read.SupportsPushDownFilters

  • Constructor Summary

    Constructors 
    Constructor Description
    GorScanBuilder​(org.apache.spark.sql.types.StructType schema, java.lang.String redisUri, java.lang.String jobId, java.lang.String cacheFile, java.lang.String projectRoot, java.lang.String cacheDir, java.lang.String useCpp)  

  • Method Summary

    Modifier and Type Method Description
    org.apache.spark.sql.connector.read.Scan build()  
    org.apache.spark.sql.connector.read.PartitionReaderFactory createReaderFactory()  
    org.apache.spark.sql.types.StructType readSchema()  
    org.apache.spark.sql.connector.read.Batch toBatch()  

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.spark.sql.connector.read.Batch

    planInputPartitions

    Methods inherited from interface org.apache.spark.sql.connector.read.Scan

    description, toContinuousStream, toMicroBatchStream

    Methods inherited from interface org.apache.spark.sql.connector.read.SupportsPushDownFilters

    pushedFilters, pushFilters

  • Constructor Details

    • GorScanBuilder

      public GorScanBuilder​(org.apache.spark.sql.types.StructType schema, java.lang.String redisUri, java.lang.String jobId, java.lang.String cacheFile, java.lang.String projectRoot, java.lang.String cacheDir, java.lang.String useCpp)

  • Method Details

    • build

      public org.apache.spark.sql.connector.read.Scan build()
      Specified by:
      build in interface org.apache.spark.sql.connector.read.ScanBuilder

    • toBatch

      public org.apache.spark.sql.connector.read.Batch toBatch()
      Specified by:
      toBatch in interface org.apache.spark.sql.connector.read.Scan

    • readSchema

      public org.apache.spark.sql.types.StructType readSchema()
      Specified by:
      readSchema in interface org.apache.spark.sql.connector.read.Scan

    • createReaderFactory

      public org.apache.spark.sql.connector.read.PartitionReaderFactory createReaderFactory()
      Specified by:
      createReaderFactory in interface org.apache.spark.sql.connector.read.Batch