Modelpublic

nm-testing/convert_modelopt_nvfp4-e2e

sourceHugging Faceapache-2.0updated 12h agoView on Hugging Face

0likes2.6kdownloads

hf_quant_config.json14 linesDownload Raw Back to root

1{2    "producer": {3        "name": "modelopt",4        "version": "0.35.0"5    },6    "quantization": {7        "quant_algo": "NVFP4",8        "kv_cache_quant_algo": "FP8",9        "group_size": 16,10        "exclude_modules": [11            "lm_head"12        ]13    }14}