File size: 4,482 Bytes
487c0d9 b3fa64d 487c0d9 c334504 cbae1d5 c334504 cbae1d5 c334504 cbae1d5 c334504 6db9a0c 902ac12 6db9a0c 902ac12 6db9a0c 487c0d9 c334504 487c0d9 c334504 99dc379 487c0d9 c334504 487c0d9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 |
---
license: apache-2.0
pipeline_tag: image-to-video
library_name: diffusers
---
# One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer
This project aims to provide a unified framework for high-fidelity character animation and image pose transfer for references with arbitrary layouts, addressing limitations in existing diffusion models regarding spatially misaligned reference-pose pairs.
- 📚 [Paper](https://huggingface.co/papers/2511.22940)
- 🌐 [Project Page](https://ssj9596.github.io/one-to-all-animation-project/)
- 💻 [GitHub Repository](https://github.com/ssj9596/One-to-All-Animation)
## 🎭 Showcase
Our model can adapt a single reference image to various motion patterns, demonstrating flexible motion control capabilities.
#### 14B Model
<table align="center">
<tr>
<th style="text-align: center;">Reference</th>
<th style="text-align: center;">Motion 1</th>
<th style="text-align: center;">Motion 2</th>
<th style="text-align: center;">Motion 3</th>
</tr>
<tr>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/1.png" width="100"/></td>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion1.gif" height="250"/></td>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion2.gif" height="250"/></td>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_1_motion3.gif" height="250"/></td>
</tr>
<tr>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/2.png" width="100""/></td>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion1.gif" height="250"/></td>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion2.gif" height="250"/></td>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/14b_examples/ref_2_motion3.gif" height="250"/></td>
</tr>
</table>
<br>
#### 1.3B Model
The 1.3 B model also delivers strong performance (from 1.3b_2 ckpt).
<table align="center">
<tr>
<th style="text-align: center;">Reference</th>
<th style="text-align: center;">Motion 1</th>
<th style="text-align: center;">Motion 2</th>
<th style="text-align: center;">Motion 3</th>
</tr>
<tr>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/examples/new_examples/3.png" width="100"/></td>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion1_1.3b.gif" height="250"/></td>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion2_1.3b.gif" height="250"/></td>
<td align="center" style="padding: 2px;"><img src="https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/ref3_motion3_1.3b.gif" height="250"/></td>
</tr>
</table>
Also support longer video & out-of-domain cases
<table align="center">
<tr>
<td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video1.gif" height="200"/></td>
<td> </td>
<td><img src="./https://github.com/ssj9596/One-to-All-Animation/raw/main/assets/1.3b_examples/combined_video2.gif" height="200"/> </td>
</tr>
</table>
<br>
## Usage
For detailed installation instructions, quick inference examples, and training scripts, please refer to the [GitHub repository](https://github.com/ssj9596/One-to-All-Animation).
## Citation
If you find our work helpful or inspiring, please feel free to cite it.
```bibtex
@article{shi2025one,
title={One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer},
author={Shi, Shijun and Xu, Jing and Li, Zhihang and Peng, Chunli and Yang, Xiaoda and Lu, Lijing and Hu, Kai and Zhang, Jiangning},
journal={arXiv preprint arXiv:2511.22940},
year={2025}
}
``` |