@atjsh/llmlingua-2
    Preparing search index...

    Interface CompressPromptOptions

    Options for compressing prompts.

    interface CompressPromptOptions {
        chunkEndTokens?: string[];
        dropConsecutive?: boolean;
        forceReserveDigit?: boolean;
        forceTokens?: string[];
        rate: number;
        targetToken?: number;
        tokenToWord?: "mean" | "first";
    }
    Index

    Properties

    chunkEndTokens? dropConsecutive? forceReserveDigit? forceTokens? rate targetToken? tokenToWord?

    Properties

    chunkEndTokens?: string[]

    List of tokens that indicate the end of a chunk. The context will be split into chunks at these tokens.

    [".", "\n"]

    dropConsecutive?: boolean

    If true, drop consecutive tokens that are forced. This is useful to avoid keeping too many forced tokens in a row.

    false

    forceReserveDigit?: boolean

    If true, reserve a digit for forced tokens.

    false

    forceTokens?: string[]

    List of tokens that must be kept in the compressed prompt. These tokens will not be removed regardless of their probability.

    []

    rate: number

    Float value between 0 and 1 indicating the rate of compression. 0.1 means 10% of the original tokens will be kept

    targetToken?: number

    Target number of tokens to keep after compression. If set, this will override the rate option.

    -1 (no target)

    tokenToWord?: "mean" | "first"

    How to convert token probabilities to word probabilities. "mean" will average the probabilities of tokens in a word, "first" will take the probability of the first token in a word.

    "mean"

    Settings

    Member Visibility

    On This Page

    Properties