Package rocks.imsofa.ai.puppychatter.openai

Class OpenAICompatibleInputStreamPuppyChatter<S extends OpenAICompatiblePromptParameters,T extends Response>

java.lang.Object

rocks.imsofa.ai.puppychatter.AbstractPuppyChatter<S,T>

rocks.imsofa.ai.puppychatter.openai.OpenAICompatiblePuppyChatter<S,T>

rocks.imsofa.ai.puppychatter.openai.OpenAICompatibleInputStreamPuppyChatter<S,T>

All Implemented Interfaces:

PuppyChatter<S,T>

Direct Known Subclasses:

OpenrouterPuppyChatter

public abstract class OpenAICompatibleInputStreamPuppyChatter<S extends OpenAICompatiblePromptParameters,T extends Response>
extends OpenAICompatiblePuppyChatter<S,T>

an implementation of OpenAICompatiblePromptParameters that uses an InputStream to process the response

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator

Field Summary

Fields inherited from class rocks.imsofa.ai.puppychatter.openai.OpenAICompatiblePuppyChatter

toolCallProcessor, toolCallRequests

Fields inherited from class rocks.imsofa.ai.puppychatter.AbstractPuppyChatter

cacheService, replyRole, sessionHistory

Constructor Summary

Constructors

Constructor	Description
OpenAICompatibleInputStreamPuppyChatter()
OpenAICompatibleInputStreamPuppyChatter(String replyRole)
OpenAICompatibleInputStreamPuppyChatter(CacheService cacheService, String replyRole)

Method Summary

Modifier and Type	Method	Description
protected T	_bark(String sessionId, List<Conversation> messages, S parameters)
protected void	_bark(String sessionId, List<Conversation> messages, S parameters, BarkCallback<T> callback)
protected abstract OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator	getStreamResultIterator(String sessionId, List<Conversation> messages, S parameters, boolean streamed)
protected T	processResponseStreamFromLLMProviders(String sessionId, OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator it, List<Conversation> messages, S parameters, BarkCallback<T> callback, boolean streamed)

Methods inherited from class rocks.imsofa.ai.puppychatter.openai.OpenAICompatiblePuppyChatter

createDefaultPromptParameter, createResponseFromConversation, getToolCallProcessor, isCacheable, setToolCallProcessor

Methods inherited from class rocks.imsofa.ai.puppychatter.AbstractPuppyChatter

bark, bark, bark, bark, closeSession, createConversationFromPrompt, createSession

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

OpenAICompatibleInputStreamPuppyChatter

public OpenAICompatibleInputStreamPuppyChatter()

OpenAICompatibleInputStreamPuppyChatter

public OpenAICompatibleInputStreamPuppyChatter(String replyRole)

OpenAICompatibleInputStreamPuppyChatter

public OpenAICompatibleInputStreamPuppyChatter(CacheService cacheService,
 String replyRole)

Method Details

_bark

protected T _bark(String sessionId,
 List<Conversation> messages,
 S parameters)
           throws Exception

Specified by:

_bark in class AbstractPuppyChatter<S extends OpenAICompatiblePromptParameters,T extends Response>

Throws:

Exception

_bark

protected void _bark(String sessionId,
 List<Conversation> messages,
 S parameters,
 BarkCallback<T> callback)
              throws Exception

Specified by:

_bark in class AbstractPuppyChatter<S extends OpenAICompatiblePromptParameters,T extends Response>

Throws:

Exception

getStreamResultIterator

protected abstract OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator getStreamResultIterator(String sessionId,
 List<Conversation> messages,
 S parameters,
 boolean streamed)
                                                                                                 throws Exception

Throws:

Exception

processResponseStreamFromLLMProviders

protected T processResponseStreamFromLLMProviders(String sessionId,
 OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator it,
 List<Conversation> messages,
 S parameters,
 BarkCallback<T> callback,
 boolean streamed)
                                           throws Exception

Throws:

Exception