Uploaded model
- Developed by: BKM1804
- License: apache-2.0
- Finetuned from model : unsloth/Qwen2-0.5B-Instruct
This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 9
Model tree for BKM1804/Qwen2-0.5B-Instruct-238eef0f-6d85-4b49-b057-e5bb0ed45a7f-dpo-tuned-merged
Base model
unsloth/Qwen2-0.5B-Instruct