Package com.embabel.agent.openai
Class OpenAiCompatibleModelFactory
-
- All Implemented Interfaces:
public class OpenAiCompatibleModelFactoryGeneric support for OpenAI compatible models. Use to register LLM beans.
-
-
Constructor Summary
Constructors Constructor Description OpenAiCompatibleModelFactory(String baseUrl, String apiKey, String completionsPath, String embeddingsPath, ObservationRegistry observationRegistry, ObjectProvider<ClientHttpRequestFactory> requestFactory)
-
Method Summary
Modifier and Type Method Description final StringgetBaseUrl()final LlmService<?>openAiCompatibleLlm(String model, PricingModel pricingModel, String provider, LocalDate knowledgeCutoffDate, OptionsConverter<?> optionsConverter, RetryTemplate retryTemplate)final LlmService<?>openAiCompatibleLlm(String model, PricingModel pricingModel, String provider, LocalDate knowledgeCutoffDate, OptionsConverter<?> optionsConverter)final LlmService<?>openAiCompatibleLlm(String model, PricingModel pricingModel, String provider, LocalDate knowledgeCutoffDate)final EmbeddingServiceopenAiCompatibleEmbeddingService(String model, String provider)-
-
Constructor Detail
-
OpenAiCompatibleModelFactory
OpenAiCompatibleModelFactory(String baseUrl, String apiKey, String completionsPath, String embeddingsPath, ObservationRegistry observationRegistry, ObjectProvider<ClientHttpRequestFactory> requestFactory)
- Parameters:
baseUrl- The base URL of the OpenAI API.apiKey- The API key for the OpenAI compatible provider, or null for no authentication.
-
-
Method Detail
-
getBaseUrl
final String getBaseUrl()
-
openAiCompatibleLlm
@JvmOverloads() final LlmService<?> openAiCompatibleLlm(String model, PricingModel pricingModel, String provider, LocalDate knowledgeCutoffDate, OptionsConverter<?> optionsConverter, RetryTemplate retryTemplate)
-
openAiCompatibleLlm
@JvmOverloads() final LlmService<?> openAiCompatibleLlm(String model, PricingModel pricingModel, String provider, LocalDate knowledgeCutoffDate, OptionsConverter<?> optionsConverter)
-
openAiCompatibleLlm
@JvmOverloads() final LlmService<?> openAiCompatibleLlm(String model, PricingModel pricingModel, String provider, LocalDate knowledgeCutoffDate)
-
openAiCompatibleEmbeddingService
final EmbeddingService openAiCompatibleEmbeddingService(String model, String provider)
-
-
-
-