Package gorsat.spark

Class GorPartitionReader

java.lang.Object
gorsat.spark.GorPartitionReader
All Implemented Interfaces:
Closeable, AutoCloseable, org.apache.spark.sql.connector.read.PartitionReader<org.apache.spark.sql.catalyst.InternalRow>
Direct Known Subclasses:
GorDoublePartitionReader, GorIntegerPartitionReader, GorLongPartitionReader, GorStringPartitionReader

public class GorPartitionReader extends Object implements org.apache.spark.sql.connector.read.PartitionReader<org.apache.spark.sql.catalyst.InternalRow>
  • Constructor Details

    • GorPartitionReader

      public GorPartitionReader(org.apache.spark.sql.types.StructType schema, gorsat.spark.GorRangeInputPartition gorRangeInputPartition, String redisUri, String streamKey, String jobId, String projectRoot, String cacheDir, String configFile, String aliasFile, String securityContext, String useCpp)
  • Method Details

    • next

      public boolean next()
      Specified by:
      next in interface org.apache.spark.sql.connector.read.PartitionReader<org.apache.spark.sql.catalyst.InternalRow>
    • get

      public org.apache.spark.sql.catalyst.InternalRow get()
      Specified by:
      get in interface org.apache.spark.sql.connector.read.PartitionReader<org.apache.spark.sql.catalyst.InternalRow>
    • close

      public void close()
      Specified by:
      close in interface AutoCloseable
      Specified by:
      close in interface Closeable