Module org.nasdanika.ai.cli

Package org.nasdanika.ai.cli

Class HnswIndexCommandBase

java.lang.Object

org.nasdanika.cli.CommandBase

org.nasdanika.cli.TelemetryCommand

org.nasdanika.ai.cli.HnswIndexCommandBase

All Implemented Interfaces:

Callable<Integer>, Closeable

public abstract class HnswIndexCommandBase
extends TelemetryCommand

Base command for creating vector index files by generating embeddings.

Field Summary

Fields inherited from class org.nasdanika.cli.TelemetryCommand

openTelemetry

Fields inherited from class org.nasdanika.cli.CommandBase

capabilityLoader, spec

Constructor Summary

Constructors

Constructor	Description
HnswIndexCommandBase(io.opentelemetry.api.OpenTelemetry openTelemetry, CapabilityLoader capabilityLoader)

Method Summary

Modifier and Type	Method	Description
Integer	execute(io.opentelemetry.api.trace.Span commandSpan)
protected abstract reactor.core.publisher.Flux<Map.Entry<String,String>>	getItems(io.opentelemetry.api.trace.Span commandSpan, ProgressMonitor progressMonitor)	A Flux of items which are mapped to SimilaritySearch.EmbeddingsItem and then stored to the index.
static com.github.jelmerk.hnswlib.core.hnsw.HnswIndex<SimilaritySearch.IndexId,float[],SimilaritySearch.EmbeddingsItem,Float>	loadIndex(File file)
static com.github.jelmerk.hnswlib.core.hnsw.HnswIndex<SimilaritySearch.IndexId,float[],SimilaritySearch.EmbeddingsItem,Float>	loadIndex(InputStream in)
protected void	onGenerateEmbeddings(String key, String value, List<List<Float>> vectors, List<SimilaritySearch.EmbeddingsItem> embeddingsItems)	Listener method for the generation process.

Methods inherited from class org.nasdanika.cli.TelemetryCommand

buildSpan, call, getCommandPath, getInstrumentationScopeName, getInstrumentationScopeVersion, getSpanName, getTracer

Methods inherited from class org.nasdanika.cli.CommandBase

close, getCapabilityLoader

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

HnswIndexCommandBase

public HnswIndexCommandBase(io.opentelemetry.api.OpenTelemetry openTelemetry,
 CapabilityLoader capabilityLoader)

Method Details

execute

public Integer execute(io.opentelemetry.api.trace.Span commandSpan)
                throws Exception

Specified by:

execute in class TelemetryCommand

Throws:

Exception

onGenerateEmbeddings

protected void onGenerateEmbeddings(String key,
 String value,
 List<List<Float>> vectors,
 List<SimilaritySearch.EmbeddingsItem> embeddingsItems)

Listener method for the generation process. You may override this method for progress reporting.

Parameters:

key -

value -

embeddingsItems -

getItems

protected abstract reactor.core.publisher.Flux<Map.Entry<String,String>> getItems(io.opentelemetry.api.trace.Span commandSpan,
 ProgressMonitor progressMonitor)

A Flux of items which are mapped to SimilaritySearch.EmbeddingsItem and then stored to the index.

Parameters:

commandSpan -

Returns:

loadIndex

public static com.github.jelmerk.hnswlib.core.hnsw.HnswIndex<SimilaritySearch.IndexId,float[],SimilaritySearch.EmbeddingsItem,Float> loadIndex(File file)
                                                                                                                                        throws IOException

Throws:

IOException

loadIndex

public static com.github.jelmerk.hnswlib.core.hnsw.HnswIndex<SimilaritySearch.IndexId,float[],SimilaritySearch.EmbeddingsItem,Float> loadIndex(InputStream in)
                                                                                                                                        throws IOException

Throws:

IOException