Interface FactoryReturn

Return type for the LLMLingua-2 factory functions. Use promptCompressor to compress prompts.

interface FactoryReturn {
    config: PretrainedConfig;
    model: PreTrainedModel;
    promptCompressor: PromptCompressor;
    tokenizer: PreTrainedTokenizer;
}

Properties

config: PretrainedConfig

The configuration used for the model.

model: PreTrainedModel

The model used for token classification.

promptCompressor: PromptCompressor

Instance of LLMLingua-2 PromptCompressor.

tokenizer: PreTrainedTokenizer

The tokenizer used for tokenization.