yuningshen commited on
Commit
0264329
·
verified ·
1 Parent(s): 7ca4811

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. README.md +169 -3
  2. confrover_interp_20m_v1_0.pt +3 -0
README.md CHANGED
@@ -1,3 +1,169 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ variant: interp
4
+ size: 20M
5
+ version: v1.0
6
+ model_summary: ConfRover base model trained for conformation interpolation
7
+ model_description: '
8
+
9
+ ConfRover is a deep generative model for protein 3D conformation and motion dynamics.
10
+
11
+ It leverages diffusion probability model to learn the distribution of protein 3D
12
+ conformations and captures the their temporal dependencies between frames through
13
+ temporal causal transformers.
14
+
15
+ Models are trained using molecular dynamics (MD) trajectories data and can generate
16
+ protein conformation ensembles and motion trajectories conditioned on the input
17
+ protein amino acid sequence.
18
+
19
+
20
+ This variant was continued trained from the base model with additional conformation
21
+ interpolation task.'
22
+ recommend: For interpolation tasks
23
+ model_id: ConfRover-interp-20M-v1.0
24
+ name: ConfRover
25
+ repo: https://github.com/ByteDance-Seed/ConfRover
26
+ paper: https://arxiv.org/abs/2505.17478
27
+ demo: https://ByteDance-Seed.github.io/ConfRover
28
+ get_started_code: "\n```python\nfrom confrover import ConfRover\n\nmodel = ConfRover.from_pretrained(<model_name>)\n\
29
+ \nmodel.to(\"cuda\")\n\nmodel.generate(\n case_id=<case_name>,\n seqres=<amino_acid_sequence>,\n\
30
+ \ output_dir=</path/to/save/output>,\n task_mode=<\"forward\"|\"iid\"|\"interp\"\
31
+ >,\n n_replicates=<int>, # number of replicated trajectories (forward and interp)\
32
+ \ or total number of conformation samples (iid)\n n_frames=<int>, # number of\
33
+ \ frames in the trajectory, including the conditioning frames.\n stride_in_10ps=256,\
34
+ \ # time interval between frames in the unit of 10 ps.\n conditions=..., # information\
35
+ \ for conditioning frames for forward simulation and interp. See `ConfRover.generate`\
36
+ \ for more details.\n)\n```\n"
37
+ model_specs: '
38
+
39
+ ConfRover contains encoder, temporal module, and diffusion decoder.
40
+
41
+ - The encoder maps the input amino acid sequence (through a folding model) and coordinates
42
+ of context frames to a latent representation.
43
+
44
+ - The temporal module models the temporal dependencies between frames using an interleaving
45
+ of causal transformers (across the temporal dimension) and pairformers (to update
46
+ structures).
47
+
48
+ - The diffusion model learns the probability distribution of protein conformations
49
+ and generates samples conditioned on the input sequence and conditioning representation.
50
+
51
+ '
52
+ bias_risks_limitations: '
53
+
54
+ ConfRover is trained on limited MD trajectories data and may not generalize well
55
+ to out-of-distribution data.
56
+
57
+ The quality of generated conformations is also limited by the quality of the input
58
+ data and the computational resources.
59
+
60
+ Currently, ConfRover only supports protein conformation generation and models the
61
+ coordinates of heavy atoms.
62
+
63
+ '
64
+ citation_bibtex: "\n```text\n@article{confrover2025,\n title={Simultaneous Modeling\
65
+ \ of Protein Conformation and Dynamics via Autoregression},\n author={Shen, Yuning\
66
+ \ and Wang, Lihao and Yuan, Huizhuo and Wang, Yan and Yang, Bangji and Gu, Quanquan},\n\
67
+ \ journal={arXiv preprint arXiv:2505.17478},\n year={2025}\n}\n```\n"
68
+ ---
69
+
70
+ # Model Card for `ConfRover-interp-20M-v1.0`
71
+
72
+ <!-- Provide a quick summary of what the model is/does. -->
73
+
74
+ ConfRover base model trained for conformation interpolation
75
+
76
+ ## Model Details
77
+
78
+ ### Model Description
79
+
80
+ <!-- Provide a longer summary of what this model is. -->
81
+
82
+
83
+ ConfRover is a deep generative model for protein 3D conformation and motion dynamics.
84
+ It leverages diffusion probability model to learn the distribution of protein 3D conformations and captures the their temporal dependencies between frames through temporal causal transformers.
85
+ Models are trained using molecular dynamics (MD) trajectories data and can generate protein conformation ensembles and motion trajectories conditioned on the input protein amino acid sequence.
86
+
87
+ This variant was continued trained from the base model with additional conformation interpolation task.
88
+
89
+ **Basic info**
90
+
91
+ | Model ID | ConfRover-interp-20M-v1.0 |
92
+ |:--|:--|
93
+ | **Variant** | interp |
94
+ | **Size** | 20M |
95
+ | **Version** | v1.0 |
96
+ | **Recommend** | For interpolation tasks |
97
+ | **License** | Apache-2.0 |
98
+
99
+
100
+ ### Model Sources
101
+
102
+ <!-- Provide the basic links for the model. -->
103
+
104
+ - **Repository:** https://github.com/ByteDance-Seed/ConfRover
105
+ - **Paper:** https://arxiv.org/abs/2505.17478
106
+ - **Website:** https://ByteDance-Seed.github.io/ConfRover
107
+
108
+
109
+ ## How to Get Started with the Model
110
+
111
+ Use the code below to get started with the model.
112
+
113
+
114
+ ```python
115
+ from confrover import ConfRover
116
+
117
+ model = ConfRover.from_pretrained(<model_name>)
118
+
119
+ model.to("cuda")
120
+
121
+ model.generate(
122
+ case_id=<case_name>,
123
+ seqres=<amino_acid_sequence>,
124
+ output_dir=</path/to/save/output>,
125
+ task_mode=<"forward"|"iid"|"interp">,
126
+ n_replicates=<int>, # number of replicated trajectories (forward and interp) or total number of conformation samples (iid)
127
+ n_frames=<int>, # number of frames in the trajectory, including the conditioning frames.
128
+ stride_in_10ps=256, # time interval between frames in the unit of 10 ps.
129
+ conditions=..., # information for conditioning frames for forward simulation and interp. See `ConfRover.generate` for more details.
130
+ )
131
+ ```
132
+
133
+
134
+
135
+
136
+ ## Technical Specifications
137
+
138
+
139
+
140
+ ConfRover contains encoder, temporal module, and diffusion decoder.
141
+ - The encoder maps the input amino acid sequence (through a folding model) and coordinates of context frames to a latent representation.
142
+ - The temporal module models the temporal dependencies between frames using an interleaving of causal transformers (across the temporal dimension) and pairformers (to update structures).
143
+ - The diffusion model learns the probability distribution of protein conformations and generates samples conditioned on the input sequence and conditioning representation.
144
+
145
+
146
+
147
+ ## Bias, Risks, and Limitations
148
+
149
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
150
+
151
+
152
+ ConfRover is trained on limited MD trajectories data and may not generalize well to out-of-distribution data.
153
+ The quality of generated conformations is also limited by the quality of the input data and the computational resources.
154
+ Currently, ConfRover only supports protein conformation generation and models the coordinates of heavy atoms.
155
+
156
+
157
+
158
+ ## Citation
159
+
160
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
161
+
162
+ ```text
163
+ @article{confrover2025,
164
+ title={Simultaneous Modeling of Protein Conformation and Dynamics via Autoregression},
165
+ author={Shen, Yuning and Wang, Lihao and Yuan, Huizhuo and Wang, Yan and Yang, Bangji and Gu, Quanquan},
166
+ journal={arXiv preprint arXiv:2505.17478},
167
+ year={2025}
168
+ }
169
+ ```
confrover_interp_20m_v1_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19a016b291fbb9f8d6f6a1d1a9fbbc959e2655c8f86610dc34c6e6c2e81fe52e
3
+ size 78548240