library_name: transformers
pipeline_tag: image-text-to-text
PaCo-Reward-7B: A Pairwise Consistency Evaluator from the PaCo-RL Framework
This repository contains PaCo-Reward-7B, a key component of the PaCo-RL framework, as presented in the paper: PaCo-RL: Advancing Reinforcement Learning for Consistent Image Generation with Pairwise Reward Modeling
The PaCo-RL framework is designed for consistent image generation through reinforcement learning, aiming to preserve identities, styles, and logical coherence across multiple images for applications like storytelling and character design. PaCo-Reward-7B specifically acts as a pairwise consistency evaluator. It is trained on a large-scale dataset constructed via automated sub-figure pairing and evaluates consistency through a generative, autoregressive scoring mechanism, enhanced by task-aware instructions and Chain-of-Thought (CoT) reasoning.
- Project Page: https://x-gengroup.github.io/HomePage_PaCo-RL/
- Code Repository: https://github.com/X-GenGroup/PaCo-RL
🌟 Overview
PaCo-RL is a comprehensive framework for consistent image generation through reinforcement learning, addressing challenges in preserving identities, styles, and logical coherence across multiple images for storytelling and character design applications.
Key Components
- PaCo-Reward: A pairwise consistency evaluator with task-aware instruction and CoT reasoning.
- PaCo-GRPO: Efficient RL optimization with resolution-decoupled training and log-tamed multi-reward aggregation
🎁 Model Zoo
This model is part of a larger collection of models within the PaCo-RL framework. More related models can be found in the PaCo-RL Hugging Face collection.
| Model | Type | HuggingFace |
|---|---|---|
| PaCo-Reward-7B | Reward Model | 🤗 Link |
| PaCo-Reward-7B-Lora | Reward Model (LoRA) | 🤗 Link |
| PaCo-FLUX.1-dev | T2I Model (LoRA) | 🤗 Link |
| PaCo-FLUX.1-Kontext-dev | Image Editing Model (LoRA) | 🤗 Link |
| PaCo-QwenImage-Edit | Image Editing Model (LoRA) | 🤗 Link |
⭐ Citation
If you find our work helpful or inspiring, please feel free to cite it:
@misc{ping2025pacorladvancingreinforcementlearning,
title={PaCo-RL: Advancing Reinforcement Learning for Consistent Image Generation with Pairwise Reward Modeling},
author={Bowen Ping and Chengyou Jia and Minnan Luo and Changliang Xia and Xin Shen and Zhuohang Dang and Hangwei Qian},
year={2025},
eprint={2512.04784},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2512.04784},
}