Skip to main content

Interface: TokenTextSplitterParams

text_splitter.TokenTextSplitterParams

Hierarchy​

  • TextSplitterParams

    ↳ TokenTextSplitterParams

Implemented by​

Properties​

allowedSpecial​

• allowedSpecial: string[] | "all"

Defined in​

langchain/src/text_splitter.ts:223

chunkOverlap​

• chunkOverlap: number

Inherited from​

TextSplitterParams.chunkOverlap

Defined in​

langchain/src/text_splitter.ts:7

chunkSize​

• chunkSize: number

Inherited from​

TextSplitterParams.chunkSize

Defined in​

langchain/src/text_splitter.ts:5

disallowedSpecial​

• disallowedSpecial: string[] | "all"

Defined in​

langchain/src/text_splitter.ts:224

encodingName​

• encodingName: TiktokenEncoding

Defined in​

langchain/src/text_splitter.ts:222