Interface HFInput

Interface defining the parameters for configuring the Hugging Face model for text generation.

Hierarchy

  • HFInput

Implemented by

Properties

model apiKey? endpointUrl? frequencyPenalty? maxTokens? temperature? topK? topP?

Properties

model

model: string

Model to use

Optional apiKey

apiKey?: string

API key to use.

Optional endpointUrl

endpointUrl?: string

Custom inference endpoint URL to use

Optional frequencyPenalty

frequencyPenalty?: number

Penalizes repeated tokens according to frequency

Optional maxTokens

maxTokens?: number

Maximum number of tokens to generate in the completion.

Optional temperature

temperature?: number

Sampling temperature to use

Optional topK

topK?: number

Integer to define the top tokens considered within the sample operation to create new text.

Optional topP

topP?: number

Total probability mass of tokens to consider at each step

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc