Interface FactoryReturn

Return type for the LLMLingua-2 factory functions. Use promptCompressor to compress prompts.

interface FactoryReturn {
    config: AutoConfig;
    model: AutoModelForTokenClassification;
    promptCompressor: PromptCompressor;
    tokenizer: AutoTokenizer;
}

Properties

config: AutoConfig

The configuration used for the model.

model: AutoModelForTokenClassification

The model used for token classification.

promptCompressor: PromptCompressor

Instance of LLMLingua-2 PromptCompressor.

tokenizer: AutoTokenizer

The tokenizer used for tokenization.