nemotron3-nano-nvfp4-w4a16 / generation_config.json
cybermotaz's picture
NVFP4 W4A16 quantized by Mutaz Al Awamleh | ELK-AI | 14.5x faster
7755b96 verified
{
"_from_model_config": true,
"bos_token_id": 1,
"do_sample": true,
"eos_token_id": [
2,
11
],
"pad_token_id": 0,
"transformers_version": "4.48.0"
}