NVIDIA Mixtral 8x7B quantized model

[itayhubara]

I can't reproduce the steps that led NVIDIA from the reference model to the FP8 model. They simply give the model weights in the container. More specifically, how can I know that they didn't finetune the model (retrain the weights) to achieve the target accuracy.