A B C D E F G H I M N O P S T V W
All Classes All Packages

A

addContent(String, Content) - Method in class org.projectnessie.gc.base.IdentifiedResult

B

bloomFilterExpectedEntries(Long) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Initializes the value for the bloomFilterExpectedEntries attribute.

bloomFilterFpp(double) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Initializes the value for the bloomFilterFpp attribute.

build() - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Builds a new ImmutableGCParams.

builder() - Static method in class org.projectnessie.gc.base.ImmutableGCParams

Creates a builder for ImmutableGCParams.

C

commitProtectionDuration(Duration) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Initializes the value for the commitProtectionDuration attribute.

computeExpiredContentsFunc(Map<String, ContentBloomFilter>) - Method in class org.projectnessie.gc.base.IdentifyContentsPerExecutor

computeLiveContentsFunc(long, Map<Reference, Instant>) - Method in class org.projectnessie.gc.base.IdentifyContentsPerExecutor

ContentBloomFilter - Class in org.projectnessie.gc.base

A utility class wrapping bloom filter functionality.

ContentBloomFilter(long, double) - Constructor for class org.projectnessie.gc.base.ContentBloomFilter

ContentValues - Class in org.projectnessie.gc.base

Contains details about one content id: like expired contents.

ContentValues() - Constructor for class org.projectnessie.gc.base.ContentValues

copyOf(GCParams) - Static method in class org.projectnessie.gc.base.ImmutableGCParams

Creates an immutable copy of a GCParams value.

cutOffTimestampPerRef(Map<String, ? extends Instant>) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Sets or replaces all mappings from the specified map as entries for the cutOffTimestampPerRef map.

D

deadReferenceCutOffTimeStamp(Instant) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Initializes the value for the deadReferenceCutOffTimeStamp attribute.

defaultCutOffTimestamp(Instant) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Initializes the value for the defaultCutOffTimestamp attribute.

DistributedIdentifyContents - Class in org.projectnessie.gc.base

Identify the expired and live contents in a distributed way using the spark and bloom filter by walking all the references (both dead and live).

DistributedIdentifyContents(SparkSession, GCParams) - Constructor for class org.projectnessie.gc.base.DistributedIdentifyContents

E

equals(Object) - Method in class org.projectnessie.gc.base.ImmutableGCParams

This instance is equal to all instances of ImmutableGCParams that have equal attribute values.

F

from(GCParams) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Fill a builder with attribute values from the provided GCParams instance.

G

GCImpl - Class in org.projectnessie.gc.base

Encapsulates the logic to retrieve expired contents by walking over all commits in all named-references.

GCImpl(GCParams) - Constructor for class org.projectnessie.gc.base.GCImpl

Instantiates a new GCImpl.

GCParams - Interface in org.projectnessie.gc.base

Config params for GC.

GCUtil - Class in org.projectnessie.gc.base

getBloomFilterExpectedEntries() - Method in interface org.projectnessie.gc.base.GCParams

Optional bloom filter expected live commits entries per reference.

getBloomFilterExpectedEntries() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Optional bloom filter expected live commits entries per reference.

getBloomFilterFpp() - Method in interface org.projectnessie.gc.base.GCParams

Optional bloom filter fpp.

getBloomFilterFpp() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Optional bloom filter fpp.

getCommitProtectionDuration() - Method in interface org.projectnessie.gc.base.GCParams

Commit protection duration to avoid expiring on going or recent commits.

getCommitProtectionDuration() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Commit protection duration to avoid expiring on going or recent commits.

getContentValues() - Method in class org.projectnessie.gc.base.IdentifiedResult

getContentValuesForReference(String) - Method in class org.projectnessie.gc.base.IdentifiedResult

getCutOffTimestampPerRef() - Method in interface org.projectnessie.gc.base.GCParams

Optional cutoff time per live reference.

getCutOffTimestampPerRef() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Optional cutoff time per live reference.

getDeadReferenceCutOffTimeStamp() - Method in interface org.projectnessie.gc.base.GCParams

Optional cutoff time for all the dead references.

getDeadReferenceCutOffTimeStamp() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Optional cutoff time for all the dead references.

getDefaultCutOffTimestamp() - Method in interface org.projectnessie.gc.base.GCParams

Default cutoff time for all the references.

getDefaultCutOffTimestamp() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Default cutoff time for all the references.

getExpectedFpp() - Method in class org.projectnessie.gc.base.ContentBloomFilter

getExpiredContents() - Method in class org.projectnessie.gc.base.ContentValues

getIdentifiedResults(Map<String, ContentBloomFilter>, List<Reference>) - Method in class org.projectnessie.gc.base.DistributedIdentifyContents

Gets the expired contents per content id by walking all the live and dead references in a distributed way using spark and checking the contents against the live bloom filter results.

getLiveContentsBloomFilters(List<Reference>, long, Map<Reference, Instant>) - Method in class org.projectnessie.gc.base.DistributedIdentifyContents

Compute the bloom filter per content id by walking all the live references in a distributed way using spark.

getNessieClientConfigs() - Method in interface org.projectnessie.gc.base.GCParams

Nessie client configurations from NessieConfigConstants.

getNessieClientConfigs() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Nessie client configurations from NessieConfigConstants.

getSparkPartitionsCount() - Method in interface org.projectnessie.gc.base.GCParams

Optional spark partitions count to be used for distributing references.

getSparkPartitionsCount() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Optional spark partitions count to be used for distributing references.

H

hashCode() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Computes a hash code from attributes: nessieClientConfigs, cutOffTimestampPerRef, defaultCutOffTimestamp, deadReferenceCutOffTimeStamp, sparkPartitionsCount, commitProtectionDuration, bloomFilterExpectedEntries, bloomFilterFpp.

I

IdentifiedResult - Class in org.projectnessie.gc.base

Output of Identify GC action GCImpl.identifyExpiredContents(SparkSession).

IdentifiedResult() - Constructor for class org.projectnessie.gc.base.IdentifiedResult

IdentifyContentsPerExecutor - Class in org.projectnessie.gc.base

Contains the methods that executes in spark executor for GCImpl.identifyExpiredContents(SparkSession).

IdentifyContentsPerExecutor(GCParams) - Constructor for class org.projectnessie.gc.base.IdentifyContentsPerExecutor

identifyExpiredContents(SparkSession) - Method in class org.projectnessie.gc.base.GCImpl

Identify the expired contents using a two-step traversal algorithm.

ImmutableGCParams - Class in org.projectnessie.gc.base

Immutable implementation of GCParams.

ImmutableGCParams.Builder - Class in org.projectnessie.gc.base

Builds instances of type ImmutableGCParams.

M

merge(ContentBloomFilter) - Method in class org.projectnessie.gc.base.ContentBloomFilter

mightContain(Content) - Method in class org.projectnessie.gc.base.ContentBloomFilter

N

nessieClientConfigs(Map<String, ? extends String>) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Sets or replaces all mappings from the specified map as entries for the nessieClientConfigs map.

O

org.projectnessie.gc.base - package org.projectnessie.gc.base

P

put(Content) - Method in class org.projectnessie.gc.base.ContentBloomFilter

putAllCutOffTimestampPerRef(Map<String, ? extends Instant>) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Put all mappings from the specified map as entries to cutOffTimestampPerRef map.

putAllNessieClientConfigs(Map<String, ? extends String>) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Put all mappings from the specified map as entries to nessieClientConfigs map.

putCutOffTimestampPerRef(String, Instant) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Put one entry to the cutOffTimestampPerRef map.

putCutOffTimestampPerRef(Map.Entry<String, ? extends Instant>) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Put one entry to the cutOffTimestampPerRef map.

putNessieClientConfigs(String, String) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Put one entry to the nessieClientConfigs map.

putNessieClientConfigs(Map.Entry<String, ? extends String>) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Put one entry to the nessieClientConfigs map.

S

sparkPartitionsCount(Integer) - Method in class org.projectnessie.gc.base.ImmutableGCParams.Builder

Initializes the value for the sparkPartitionsCount attribute.

T

toString() - Method in class org.projectnessie.gc.base.ImmutableGCParams

Prints the immutable value GCParams with attribute values.

V

validate() - Method in interface org.projectnessie.gc.base.GCParams

W

wasMerged() - Method in class org.projectnessie.gc.base.ContentBloomFilter

A merged bloomfilter might indicate decreased filter quality.

withBloomFilterExpectedEntries(Long) - Method in class org.projectnessie.gc.base.ImmutableGCParams

Copy the current immutable object by setting a value for the bloomFilterExpectedEntries attribute.

withBloomFilterFpp(double) - Method in class org.projectnessie.gc.base.ImmutableGCParams

Copy the current immutable object by setting a value for the bloomFilterFpp attribute.

withCommitProtectionDuration(Duration) - Method in class org.projectnessie.gc.base.ImmutableGCParams

Copy the current immutable object by setting a value for the commitProtectionDuration attribute.

withCutOffTimestampPerRef(Map<String, ? extends Instant>) - Method in class org.projectnessie.gc.base.ImmutableGCParams

Copy the current immutable object by replacing the cutOffTimestampPerRef map with the specified map.

withDeadReferenceCutOffTimeStamp(Instant) - Method in class org.projectnessie.gc.base.ImmutableGCParams

Copy the current immutable object by setting a value for the deadReferenceCutOffTimeStamp attribute.

withDefaultCutOffTimestamp(Instant) - Method in class org.projectnessie.gc.base.ImmutableGCParams

Copy the current immutable object by setting a value for the defaultCutOffTimestamp attribute.

withNessieClientConfigs(Map<String, ? extends String>) - Method in class org.projectnessie.gc.base.ImmutableGCParams

Copy the current immutable object by replacing the nessieClientConfigs map with the specified map.

withSparkPartitionsCount(Integer) - Method in class org.projectnessie.gc.base.ImmutableGCParams

Copy the current immutable object by setting a value for the sparkPartitionsCount attribute.

A B C D E F G H I M N O P S T V W
All Classes All Packages