Class: Replicate
llms/replicate.Replicate
LLM class that provides a simpler interface to subclass than BaseLLM.
Requires only implementing a simpler _call method instead of _generate.
Hierarchy
↳
Replicate
Implements
ReplicateInput
Constructors
constructor
• new Replicate(fields)
Parameters
| Name | Type |
|---|---|
fields | ReplicateInput & BaseLLMParams |
Overrides
Defined in
langchain/src/llms/replicate.ts:22
Properties
apiKey
• apiKey: string
Implementation of
ReplicateInput.apiKey
Defined in
langchain/src/llms/replicate.ts:20
cache
• Optional cache: BaseCache<Generation[]>
Inherited from
Defined in
langchain/src/llms/base.ts:31
callbackManager
• callbackManager: CallbackManager
Inherited from
Defined in
langchain/src/base_language/index.ts:34
caller
• Protected caller: AsyncCaller
The async caller should be used by subclasses to make any async calls, which will thus benefit from the concurrency and retry logic.
Inherited from
Defined in
langchain/src/base_language/index.ts:40
input
• input: undefined | { [key: string]: string | number | boolean; }
Implementation of
ReplicateInput.input
Defined in
langchain/src/llms/replicate.ts:18
model
• model: `${string}/${string}:${string}`
Implementation of
ReplicateInput.model
Defined in
langchain/src/llms/replicate.ts:16
name
• name: string
The name of the LLM class
Inherited from
Defined in
langchain/src/llms/base.ts:29
verbose
• verbose: boolean
Whether to print out response text.
Inherited from
Defined in
langchain/src/base_language/index.ts:32
Methods
_call
▸ _call(prompt, _stop?): Promise<string>
Run the LLM on the given prompt and input.
Parameters
| Name | Type |
|---|---|
prompt | string |
_stop? | string[] |
Returns
Promise<string>
Overrides
Defined in
langchain/src/llms/replicate.ts:43
_generate
▸ _generate(prompts, stop?): Promise<LLMResult>
Run the LLM on the given prompts and input.
Parameters
| Name | Type |
|---|---|
prompts | string[] |
stop? | string[] |
Returns
Promise<LLMResult>
Inherited from
Defined in
langchain/src/llms/base.ts:197
_identifyingParams
▸ _identifyingParams(): Record<string, any>
Get the identifying parameters of the LLM.
Returns
Record<string, any>
Inherited from
Defined in
langchain/src/llms/base.ts:140
_llmType
▸ _llmType(): string
Return the string type key uniquely identifying this class of LLM.
Returns
string
Overrides
Defined in
langchain/src/llms/replicate.ts:39
_modelType
▸ _modelType(): string
Returns
string
Inherited from
Defined in
langchain/src/llms/base.ts:160
call
▸ call(prompt, stop?): Promise<string>
Convenience wrapper for generate that takes in a single string prompt and returns a single string output.
Parameters
| Name | Type |
|---|---|
prompt | string |
stop? | string[] |
Returns
Promise<string>
Inherited from
Defined in
langchain/src/llms/base.ts:131
generate
▸ generate(prompts, stop?): Promise<LLMResult>
Run the LLM on the given propmts an input, handling caching.
Parameters
| Name | Type |
|---|---|
prompts | string[] |
stop? | string[] |
Returns
Promise<LLMResult>
Inherited from
Defined in
langchain/src/llms/base.ts:84
generatePrompt
▸ generatePrompt(promptValues, stop?): Promise<LLMResult>
Parameters
| Name | Type |
|---|---|
promptValues | BasePromptValue[] |
stop? | string[] |
Returns
Promise<LLMResult>
Inherited from
Defined in
langchain/src/llms/base.ts:44
getNumTokens
▸ getNumTokens(text): Promise<number>
Parameters
| Name | Type |
|---|---|
text | string |
Returns
Promise<number>
Inherited from
Defined in
langchain/src/base_language/index.ts:62
serialize
▸ serialize(): SerializedLLM
Return a json-like object representing this LLM.
Returns
Inherited from
Defined in
langchain/src/llms/base.ts:152
deserialize
▸ Static deserialize(data): Promise<BaseLLM>
Load an LLM from a json-like object describing it.
Parameters
| Name | Type |
|---|---|
data | SerializedLLM |
Returns
Promise<BaseLLM>
Inherited from
Defined in
langchain/src/llms/base.ts:167
imports
▸ Static imports(): Promise<{ Replicate: typeof default }>
Returns
Promise<{ Replicate: typeof default }>
Defined in
langchain/src/llms/replicate.ts:66