About Self-Conditioning #98
v-shaoningli
started this conversation in
General
Replies: 1 comment
-
Wondering the same thing here. Is this design better than the self-conditioning used in bit diffusion? How much is the performance gain? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi all! Thanks for your excellent work RFdiffusion.
Here I have one question about the implementation of$x^{t}$ from $x^{t+1}$ .
Self-Conditioning
, i.e., Algorithm 3 in the supplementary.Compare with the original paper Analog bits: Generating discrete data using diffusion models with self-conditioning, RFdiffusion additionally added
ReverseStep
to generateTo be concrete, I attach the figure in the following:
What RFdiffusion is done:
ReversteStep
to generateInstead, in the original paper:
RFdiffusion has one additional step. Is it more benifitial to predict$x^{pred}$ with $x^{t}$ and $\tilde{x}_0$ compared with $x^{t+\Delta}$ and $\tilde{x}_0$ (because employing
ReversteStep
is a little bit more time-consuming)?Looking forward to your responses. Thanks.
Best,
Shaoning
Beta Was this translation helpful? Give feedback.
All reactions