README.md

---
license: apache-2.0
pipeline_tag: image-to-video
library_name: diffusers
---

# One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer

This project aims to provide a unified framework for high-fidelity character animation and image pose transfer for references with arbitrary layouts, addressing limitations in existing diffusion models regarding spatially misaligned reference-pose pairs.

- 📚 [Paper](https://huggingface.co/papers/2511.22940)
- 🌐 [Project Page](https://ssj9596.github.io/one-to-all-animation-project/)
- 💻 [GitHub Repository](https://github.com/ssj9596/One-to-All-Animation)


## 🎭 Showcase

Our model can adapt a single reference image to various motion patterns, demonstrating flexible motion control capabilities.

#### 14B Model

<table align="center">
  <tr>
    <th style="text-align: center;">Reference</th>
    <th style="text-align: center;">Motion 1</th>
    <th style="text-align: center;">Motion 2</th>
    <th style="text-align: center;">Motion 3</th>
  </tr>
  <tr>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/1.png" width="100"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion1.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion2.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion3.gif" height="250"/></td>
  </tr>
  <tr>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/2.png" width="100""/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion1.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion2.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion3.gif" height="250"/></td>
  </tr>
</table>

<br>

#### 1.3B Model
The 1.3 B model also delivers strong performance (from 1.3b_2 ckpt).

<table align="center">
  <tr>
    <th style="text-align: center;">Reference</th>
    <th style="text-align: center;">Motion 1</th>
    <th style="text-align: center;">Motion 2</th>
    <th style="text-align: center;">Motion 3</th>
  </tr>
  <tr>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/3.png" width="100"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion1_1.3b.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion2_1.3b.gif" height="250"/></td>
    <td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion3_1.3b.gif" height="250"/></td>
  </tr>
</table>

Also support longer video & out-of-domain cases 
<table align="center">
  <tr>
    <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video1.gif" height="200"/></td>
    <td>&nbsp;&nbsp;&nbsp;&nbsp;</td>
    <td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video2.gif" height="200"/> </td>
  </tr>
</table>

<br>


## Usage

For detailed installation instructions, quick inference examples, and training scripts, please refer to the [GitHub repository](https://github.com/ssj9596/One-to-All-Animation).

## Citation
If you find our work helpful or inspiring, please feel free to cite it.
```bibtex
@article{shi2025one,
  title={One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer},
  author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning},
  journal={arXiv preprint arXiv:2511.22940},
  year={2025}
}
```