Apertus-8B-Instruct-2509-FP8_dynamic / generation_config.json
starbix's picture
Upload FP8 quantized Apertus-8B-Instruct-2509
d1cc002 verified
{
"_from_model_config": true,
"bos_token_id": 1,
"eos_token_id": [
2,
68,
72
],
"transformers_version": "4.56.2"
}