A B C D E F G H I M O R S T U V W
All Classes All Packages

A

aggregate(Dataset<Row>, String) - Static method in class org.projectnessie.versioned.gc.BinaryBloomFilter

Run aggregation on dataset to add all rows to the bloom filter.

apply(Row) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItemConverter

AssetFilter(BinaryBloomFilter) - Constructor for class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.AssetFilter

AssetFlatMapper(Serializer<T>, Serializer<AssetKey>, AssetKeyConverter<T, R>) - Constructor for class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.AssetFlatMapper

Construct mapper.

AssetKey - Class in org.projectnessie.versioned.gc

Assets associated with one or more values.

AssetKey() - Constructor for class org.projectnessie.versioned.gc.AssetKey

AssetKeyConverter<T,R extends AssetKey> - Interface in org.projectnessie.versioned.gc

convert a value into a stream of asset keys.

B

BinaryBloomFilter - Class in org.projectnessie.versioned.gc

A utility class wrapping binary bloom filter functionality for spark.

BinaryBloomFilter() - Constructor for class org.projectnessie.versioned.gc.BinaryBloomFilter

C

call(Row) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.AssetFilter

call(CategorizedValue) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.AssetFlatMapper

CategorizedAssetKey() - Constructor for class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

CategorizedAssetKey(boolean, ByteString, ByteString, long, List<String>) - Constructor for class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

Construct asset key.

CategorizedValue - Class in org.projectnessie.versioned.gc

Referenced state of a value, its type and its byte[] representation.

CategorizedValue() - Constructor for class org.projectnessie.versioned.gc.CategorizedValue

CategorizedValue(boolean, ByteString, long, List<String>) - Constructor for class org.projectnessie.versioned.gc.CategorizedValue

Construct asset key.

D

delete() - Method in class org.projectnessie.versioned.gc.AssetKey

An idempotent deletion.

E

equals(Object) - Method in class org.projectnessie.versioned.gc.AssetKey

F

filter(Dataset<Row>, String) - Method in class org.projectnessie.versioned.gc.BinaryBloomFilter

G

getAsset() - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItem

getData() - Method in class org.projectnessie.versioned.gc.CategorizedValue

getData() - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

getKey() - Method in class org.projectnessie.versioned.gc.CategorizedValue

getKey() - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

getKey() - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItem

getName() - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItem

getTimestamp() - Method in class org.projectnessie.versioned.gc.CategorizedValue

getTimestamp() - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

getTimestamp() - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItem

getUniqueKey() - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

H

hashCode() - Method in class org.projectnessie.versioned.gc.AssetKey

I

identify(Dataset<CategorizedValue>) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets

IdentifyUnreferencedAssets<T,R extends AssetKey> - Class in org.projectnessie.versioned.gc

Operation which identifies unreferenced assets.

IdentifyUnreferencedAssets(Serializer<T>, Serializer<AssetKey>, AssetKeyConverter<T, R>, FilterFunction<CategorizedValue>, SparkSession) - Constructor for class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets

Drive a job that generates a dataset of unreferenced assets.

IdentifyUnreferencedAssets.AssetFilter - Class in org.projectnessie.versioned.gc

Spark filter to determine if a value is referenced by checking if the byte[] serialization is in a bloom filter.

IdentifyUnreferencedAssets.AssetFlatMapper<T,R extends AssetKey> - Class in org.projectnessie.versioned.gc

Spark flat map function to convert a value into an iterator of AssetKeys keeping their reference state.

IdentifyUnreferencedAssets.CategorizedAssetKey - Class in org.projectnessie.versioned.gc

Pair of referenced state of an asset key and its byte[] representation.

IdentifyUnreferencedAssets.UnreferencedItem - Class in org.projectnessie.versioned.gc

Unreferenced Item.

IdentifyUnreferencedAssets.UnreferencedItemConverter - Class in org.projectnessie.versioned.gc

Spark function to convert a Row into a concrete UnreferencedItem object.

isReferenced() - Method in class org.projectnessie.versioned.gc.CategorizedValue

isReferenced() - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

M

mightContain(byte[]) - Method in class org.projectnessie.versioned.gc.BinaryBloomFilter

mightContain(ByteString) - Method in class org.projectnessie.versioned.gc.BinaryBloomFilter

mightContain(ByteBuffer) - Method in class org.projectnessie.versioned.gc.BinaryBloomFilter

O

org.projectnessie.versioned.gc - package org.projectnessie.versioned.gc

R

readExternal(ObjectInput) - Method in class org.projectnessie.versioned.gc.BinaryBloomFilter

S

setAsset(byte[]) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItem

setData(byte[]) - Method in class org.projectnessie.versioned.gc.CategorizedValue

setData(byte[]) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

setKey(List<String>) - Method in class org.projectnessie.versioned.gc.CategorizedValue

setKey(List<String>) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

setKey(List<String>) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItem

setName(String) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItem

setReferenced(boolean) - Method in class org.projectnessie.versioned.gc.CategorizedValue

setReferenced(boolean) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

setTimestamp(long) - Method in class org.projectnessie.versioned.gc.CategorizedValue

setTimestamp(long) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

setTimestamp(long) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItem

setUniqueKey(byte[]) - Method in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.CategorizedAssetKey

T

toReportableName() - Method in class org.projectnessie.versioned.gc.AssetKey

Expose a description of this object to be used for reporting purposes.

toUniqueKey() - Method in class org.projectnessie.versioned.gc.AssetKey

Expose a unique key for this asset for equality purposes.

U

UnreferencedItem() - Constructor for class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItem

UnreferencedItemConverter(Serializer<AssetKey>) - Constructor for class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets.UnreferencedItemConverter

V

valueSerializer - Variable in class org.projectnessie.versioned.gc.IdentifyUnreferencedAssets

W

writeExternal(ObjectOutput) - Method in class org.projectnessie.versioned.gc.BinaryBloomFilter

A B C D E F G H I M O R S T U V W
All Classes All Packages