bitorch_engine.utils.convert.get_mpq_config

bitorch_engine.utils.convert.get_mpq_config(mpq_strategy: str | None = None)[source]

This function returns the parameters for a given strategy string. Default is “2-8-32”.

Currently, known options are “2-8-32”, “2-32-32”, “2-128-32”, “4-128-256”, “8-128-256” (weight bits, group size, double quantized group size). :param mpq_strategy: the strategy string :return: args needed to be set for the MPQ layer