Class: OpenAI
OpenAI LLM implementation
Hierarchy
-
BaseLLM↳
OpenAI↳↳
TogetherLLM
Constructors
constructor
• new OpenAI(init?): OpenAI
Parameters
| Name | Type |
|---|---|
init? | Partial<OpenAI> & { azure?: AzureOpenAIConfig } |
Returns
Overrides
BaseLLM.constructor
Defined in
packages/core/src/llm/LLM.ts:95
Properties
additionalChatOptions
• Optional additionalChatOptions: Omit<Partial<ChatCompletionCreateParams>, "stream" | "model" | "temperature" | "messages" | "max_tokens" | "top_p">
Defined in
packages/core/src/llm/LLM.ts:78
additionalSessionOptions
• Optional additionalSessionOptions: Omit<Partial<ClientOptions>, "apiKey" | "timeout" | "maxRetries">
Defined in
packages/core/src/llm/LLM.ts:88
apiKey
• Optional apiKey: string = undefined
Defined in
packages/core/src/llm/LLM.ts:84
callbackManager
• Optional callbackManager: CallbackManager
Defined in
packages/core/src/llm/LLM.ts:93
maxRetries
• maxRetries: number
Defined in
packages/core/src/llm/LLM.ts:85
maxTokens
• Optional maxTokens: number
Defined in
packages/core/src/llm/LLM.ts:77
model
• model: string
Defined in
packages/core/src/llm/LLM.ts:74
session
• session: OpenAISession
Defined in
packages/core/src/llm/LLM.ts:87
temperature
• temperature: number
Defined in
packages/core/src/llm/LLM.ts:75
timeout
• Optional timeout: number
Defined in
packages/core/src/llm/LLM.ts:86
topP
• topP: number
Defined in
packages/core/src/llm/LLM.ts:76
Accessors
metadata
• get metadata(): Object
Returns
Object
| Name | Type |
|---|---|
contextWindow | number |
maxTokens | undefined | number |
model | string |
temperature | number |
tokenizer | CL100K_BASE |
topP | number |
Overrides
BaseLLM.metadata
Defined in
packages/core/src/llm/LLM.ts:150
Methods
chat
▸ chat(params): Promise<AsyncIterable<ChatResponseChunk>>
Parameters
| Name | Type |
|---|---|
params | LLMChatParamsStreaming |
Returns
Promise<AsyncIterable<ChatResponseChunk>>
Overrides
BaseLLM.chat
Defined in
packages/core/src/llm/LLM.ts:197
▸ chat(params): Promise<ChatResponse>
Parameters
| Name | Type |
|---|---|
params | LLMChatParamsNonStreaming |
Returns
Promise<ChatResponse>
Overrides
BaseLLM.chat
Defined in
packages/core/src/llm/LLM.ts:200
complete
▸ complete(params): Promise<AsyncIterable<CompletionResponse>>
Parameters
| Name | Type |
|---|---|
params | LLMCompletionParamsStreaming |
Returns
Promise<AsyncIterable<CompletionResponse>>
Inherited from
BaseLLM.complete
Defined in
packages/core/src/llm/base.ts:18
▸ complete(params): Promise<CompletionResponse>
Parameters
| Name | Type |
|---|---|
params | LLMCompletionParamsNonStreaming |
Returns
Promise<CompletionResponse>
Inherited from
BaseLLM.complete
Defined in
packages/core/src/llm/base.ts:21
mapMessageType
▸ mapMessageType(messageType): "function" | "user" | "assistant" | "system"
Parameters
| Name | Type |
|---|---|
messageType | MessageType |
Returns
"function" | "user" | "assistant" | "system"
Defined in
packages/core/src/llm/LLM.ts:180
streamChat
▸ streamChat(«destructured»): AsyncIterable<ChatResponseChunk>
Parameters
| Name | Type |
|---|---|
«destructured» | LLMChatParamsStreaming |
Returns
AsyncIterable<ChatResponseChunk>
Defined in
packages/core/src/llm/LLM.ts:235
tokens
▸ tokens(messages): number
Parameters
| Name | Type |
|---|---|
messages | ChatMessage[] |
Returns
number
Overrides
BaseLLM.tokens