Skip to content

llmcompressor.transformers.utils.preprocessing_functions

Dataset preprocessing functions for text generation tasks.

This module provides a registry of preprocessing functions for various datasets used in fine-tuning workflows. Includes chat templates, instruction formatting, and dataset-specific transformations for popular training datasets.