Package org.projectnessie.gc.base

Class IdentifyContentsPerExecutor

java.lang.Object

org.projectnessie.gc.base.IdentifyContentsPerExecutor

All Implemented Interfaces:

Serializable

public class IdentifyContentsPerExecutor
extends Object
implements Serializable

Contains the methods that executes in spark executor for GCImpl.identifyExpiredContents(SparkSession).

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor	Description
IdentifyContentsPerExecutor(GCParams gcParams)

Method Summary

Modifier and Type	Method	Description
protected org.apache.spark.api.java.function.Function<String,Map<String,ContentBloomFilter>>	computeLiveContentsFunc(long bloomFilterSize, Map<String,Instant> droppedRefTimeMap)
protected SerializableFunction1<scala.collection.Iterator<String>,scala.collection.Iterator<org.apache.spark.sql.Row>>	getExpiredContentRowsFunc(Map<String,ContentBloomFilter> liveContentsBloomFilterMap, String runId, Timestamp startedAt)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

IdentifyContentsPerExecutor

public IdentifyContentsPerExecutor(GCParams gcParams)

Method Detail

computeLiveContentsFunc

protected org.apache.spark.api.java.function.Function<String,Map<String,ContentBloomFilter>> computeLiveContentsFunc(long bloomFilterSize,
                                                                                                                                 Map<String,Instant> droppedRefTimeMap)

getExpiredContentRowsFunc

protected SerializableFunction1<scala.collection.Iterator<String>,scala.collection.Iterator<org.apache.spark.sql.Row>> getExpiredContentRowsFunc(Map<String,ContentBloomFilter> liveContentsBloomFilterMap,
                                                                                                                                                       String runId,
                                                                                                                                                       Timestamp startedAt)