Hugging Face's logo

5456es
/
implicit_reward_Llama-3.2-3B-Instruct_prune_0.7-sigmoid

Safetensors
llama
dpo
preference-learning
implicit
pruned
Model card Files
xet
Community
implicit_reward_Llama-3.2-3B-Instruct_prune_0.7-sigmoid

Commit History

Upload model-00002-of-00002.safetensors with huggingface_hub
4da87e8
verified

5456es commited on

Upload rng_state_4.pth with huggingface_hub
335957e
verified

5456es commited on

Upload rng_state_5.pth with huggingface_hub
8d5fb12
verified

5456es commited on

Upload latest with huggingface_hub
b3193e6
verified

5456es commited on

Upload training_args.bin with huggingface_hub
600e95e
verified

5456es commited on

Upload config.json with huggingface_hub
e8363fb
verified

5456es commited on

Upload trainer_state.json with huggingface_hub
3aabd62
verified

5456es commited on

initial commit
b3d0c49
verified

5456es commited on