llmcompressor.modifiers.smoothquant.utils
Functions:
-
get_layer_mappings_from_architecture
–:param architecture: str: The architecture of the model
get_layer_mappings_from_architecture
Parameters:
-
architecture
str
) –str: The architecture of the model
Returns:
-
List[LayerMap]
–list: The layer mappings for the given architecture
Source code in llmcompressor/modifiers/smoothquant/utils.py
handle_mapping_resolution_errors
Decorator to catch any errors that occur when resolving mappings and provide a helpful error message to the user pointing them to the README