Skip to content

llmcompressor.core.model_layer

Model layer utility classes for LLM compression workflows.

Provides dataclass containers for managing model layers and their associated parameters during compression operations. Facilitates tracking and manipulation of specific model components and their parameters.

Classes:

ModelParameterizedLayer dataclass 

ModelParameterizedLayer(
    layer_name: str, layer: Any, param_name: str, param: Any
)

A dataclass for holding a parameter and its layer

Parameters:

  • layer_name

    (str) –

    the name of the layer

  • layer

    (Any) –

    the layer object

  • param_name

    (str) –

    the name of the parameter

  • param

    (Any) –

    the parameter object