Module org.nasdanika.ai

Package org.nasdanika.ai

Class TextFloatVectorEncodingChunkingEmbeddingModel

java.lang.Object

org.nasdanika.ai.TextFloatVectorChunkingEmbeddingModel<com.knuddels.jtokkit.api.IntArrayList>

org.nasdanika.ai.TextFloatVectorEncodingChunkingEmbeddingModel

All Implemented Interfaces:

Coordinates, EmbeddingGenerator<String,List<List<Float>>>, EmbeddingModel<String,List<List<Float>>>, FloatVectorEmbeddingGenerator<String>, Model, TextEmbeddingGenerator<List<List<Float>>>, TextFloatVectorEmbeddingModel, VectorEmbeddingGenerator<String,Float>

public class TextFloatVectorEncodingChunkingEmbeddingModel
extends TextFloatVectorChunkingEmbeddingModel<com.knuddels.jtokkit.api.IntArrayList>

Nested Class Summary

Nested classes/interfaces inherited from interface org.nasdanika.ai.EmbeddingGenerator

EmbeddingGenerator.Requirement

Constructor Summary

Constructors

Constructor	Description
TextFloatVectorEncodingChunkingEmbeddingModel(TextFloatVectorEmbeddingModel target, int chunkSize, int overlap, com.knuddels.jtokkit.api.Encoding encoding)
TextFloatVectorEncodingChunkingEmbeddingModel(TextFloatVectorEmbeddingModel target, int chunkSize, int overlap, com.knuddels.jtokkit.api.EncodingType encodingType)

Method Summary

Modifier and Type	Method	Description
protected String	decode(com.knuddels.jtokkit.api.IntArrayList tokens)	Decodes a string from an array of tokens
protected com.knuddels.jtokkit.api.IntArrayList	encode(String input)	Encodes a string into tokens
protected int	size(com.knuddels.jtokkit.api.IntArrayList tokens)
protected com.knuddels.jtokkit.api.IntArrayList	slice(com.knuddels.jtokkit.api.IntArrayList tokens, int offset, int length)

Methods inherited from class org.nasdanika.ai.TextFloatVectorChunkingEmbeddingModel

chunk, generate, generateAsync, getDimensions, getMaxInputTokens, getName, getProvider, getVersion, isTooLong

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.nasdanika.ai.EmbeddingGenerator

adapt, generate, generateAsync, then

Constructor Details

TextFloatVectorEncodingChunkingEmbeddingModel

public TextFloatVectorEncodingChunkingEmbeddingModel(TextFloatVectorEmbeddingModel target,
 int chunkSize,
 int overlap,
 com.knuddels.jtokkit.api.Encoding encoding)

TextFloatVectorEncodingChunkingEmbeddingModel

public TextFloatVectorEncodingChunkingEmbeddingModel(TextFloatVectorEmbeddingModel target,
 int chunkSize,
 int overlap,
 com.knuddels.jtokkit.api.EncodingType encodingType)

Method Details

encode

protected com.knuddels.jtokkit.api.IntArrayList encode(String input)

Description copied from class: TextFloatVectorChunkingEmbeddingModel

Encodes a string into tokens

Specified by:

encode in class TextFloatVectorChunkingEmbeddingModel<com.knuddels.jtokkit.api.IntArrayList>

Returns:

decode

protected String decode(com.knuddels.jtokkit.api.IntArrayList tokens)

Description copied from class: TextFloatVectorChunkingEmbeddingModel

Decodes a string from an array of tokens

Specified by:

decode in class TextFloatVectorChunkingEmbeddingModel<com.knuddels.jtokkit.api.IntArrayList>

Returns:

size

protected int size(com.knuddels.jtokkit.api.IntArrayList tokens)

Specified by:

size in class TextFloatVectorChunkingEmbeddingModel<com.knuddels.jtokkit.api.IntArrayList>

slice

protected com.knuddels.jtokkit.api.IntArrayList slice(com.knuddels.jtokkit.api.IntArrayList tokens,
 int offset,
 int length)

Specified by:

slice in class TextFloatVectorChunkingEmbeddingModel<com.knuddels.jtokkit.api.IntArrayList>