Package rocks.imsofa.ai.puppychatter.openai

Class OpenAICompatibleInputStreamPuppyChatter<S extends OpenAICompatiblePromptParameters,T extends Response>

java.lang.Object

rocks.imsofa.ai.puppychatter.AbstractPuppyChatter<S,T>

rocks.imsofa.ai.puppychatter.openai.OpenAICompatiblePuppyChatter<S,T>

rocks.imsofa.ai.puppychatter.openai.OpenAICompatibleInputStreamPuppyChatter<S,T>

All Implemented Interfaces:

PuppyChatter<S,T>

Direct Known Subclasses:

OllamaPuppyChatter, OpenrouterPuppyChatter

public abstract class OpenAICompatibleInputStreamPuppyChatter<S extends OpenAICompatiblePromptParameters,T extends Response>
extends OpenAICompatiblePuppyChatter<S,T>

an implementation of OpenAICompatiblePromptParameters that uses an InputStream to process the response

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	OpenAICompatibleInputStreamPuppyChatter.RequestParameters	sometimes, it may be necessary to transform the original messages, to fulfill the requirements, use this class as a bridge between the original prompts and the effective prompts
static class	OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator

Field Summary

Fields inherited from class rocks.imsofa.ai.puppychatter.openai.OpenAICompatiblePuppyChatter

toolCallProcessor, toolCallRequests

Fields inherited from class rocks.imsofa.ai.puppychatter.AbstractPuppyChatter

cacheService, replyRole, sessionHistory

Constructor Summary

Constructors

Constructor	Description
OpenAICompatibleInputStreamPuppyChatter()
OpenAICompatibleInputStreamPuppyChatter(String replyRole)
OpenAICompatibleInputStreamPuppyChatter(CacheService cacheService, String replyRole)

Method Summary

Modifier and Type	Method	Description
protected T	_bark(String sessionId, List<Conversation> messages, S parameters)
protected void	_bark(String sessionId, List<Conversation> messages, S parameters, BarkCallback<T> callback)
protected com.github.kevinsawicki.http.HttpRequest	constructPayloadAndSend(OpenAICompatibleInputStreamPuppyChatter.RequestParameters requestParameters)
protected abstract OpenAICompatibleInputStreamPuppyChatter.RequestParameters	getRequestParameters(String sessionId, List<Conversation> messages, OpenAICompatiblePromptParameters parameters, boolean streamed)
protected abstract OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator	getStreamResultIterator(OpenAICompatibleInputStreamPuppyChatter.RequestParameters requestParameters)
protected void	preprocessMessages(OpenAICompatibleInputStreamPuppyChatter.RequestParameters requestParameters)
protected T	processResponseStreamFromLLMProviders(String sessionId, OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator it, List<Conversation> messages, S parameters, BarkCallback<T> callback, boolean streamed)

Methods inherited from class rocks.imsofa.ai.puppychatter.openai.OpenAICompatiblePuppyChatter

createDefaultPromptParameter, createResponseFromConversation, getToolCallProcessor, isCacheable, setToolCallProcessor

Methods inherited from class rocks.imsofa.ai.puppychatter.AbstractPuppyChatter

bark, bark, bark, bark, closeSession, createConversationFromPrompt, createSession

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

OpenAICompatibleInputStreamPuppyChatter

public OpenAICompatibleInputStreamPuppyChatter()

OpenAICompatibleInputStreamPuppyChatter

public OpenAICompatibleInputStreamPuppyChatter(String replyRole)

OpenAICompatibleInputStreamPuppyChatter

public OpenAICompatibleInputStreamPuppyChatter(CacheService cacheService,
 String replyRole)

Method Details

_bark

protected T _bark(String sessionId,
 List<Conversation> messages,
 S parameters)
           throws Exception

Specified by:

_bark in class AbstractPuppyChatter<S extends OpenAICompatiblePromptParameters,T extends Response>

Throws:

Exception

_bark

protected void _bark(String sessionId,
 List<Conversation> messages,
 S parameters,
 BarkCallback<T> callback)
              throws Exception

Specified by:

_bark in class AbstractPuppyChatter<S extends OpenAICompatiblePromptParameters,T extends Response>

Throws:

Exception

preprocessMessages

protected void preprocessMessages(OpenAICompatibleInputStreamPuppyChatter.RequestParameters requestParameters)
                           throws Exception

Throws:

Exception

getStreamResultIterator

protected abstract OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator getStreamResultIterator(OpenAICompatibleInputStreamPuppyChatter.RequestParameters requestParameters)
                                                                                                 throws Exception

Throws:

Exception

getRequestParameters

protected abstract OpenAICompatibleInputStreamPuppyChatter.RequestParameters getRequestParameters(String sessionId,
 List<Conversation> messages,
 OpenAICompatiblePromptParameters parameters,
 boolean streamed)
                                                                                           throws Exception

Throws:

Exception

constructPayloadAndSend

protected com.github.kevinsawicki.http.HttpRequest constructPayloadAndSend(OpenAICompatibleInputStreamPuppyChatter.RequestParameters requestParameters)
                                                                    throws Exception

Throws:

Exception

processResponseStreamFromLLMProviders

protected T processResponseStreamFromLLMProviders(String sessionId,
 OpenAICompatibleInputStreamPuppyChatter.StreamResultIterator it,
 List<Conversation> messages,
 S parameters,
 BarkCallback<T> callback,
 boolean streamed)
                                           throws Exception

Throws:

Exception