First-Order Stationarity of Reverse Diffusions

Zhifeng Chen, Chenyang Jiang, Yazhen Wang

YAYIN:25 Eyl 2026 ALAN:stat.ML OKUMA:20

Özet

Recent literature has shown a strong connection between optimization and sampling. We develop the corresponding first-order theory for diffusion models. First, the SDE-based reverse-time flows of overdamped and underdamped Langevin diffusions contract relative Fisher divergences at explicit exponential rates whenever the stationary potential of the forward process is strongly convex---a condition on the noising process one chooses, not on the data. This is a unique advantage of SDE-based reverse diffusion, absent in the reverse process based on ODEs. Second, we incorporate discretization and establish averaged first-order stationarity bounds---the sampling analog of averaged gradient-norm guarantees in nonconvex optimization---for samplers of both overdamped and underdamped diffusion models. As in nonconvex optimization, the convexity-free certificate is local: it guarantees score consistency, not global mode weights.

Özetle: Recent literature has shown a strong connection between optimization and sampling.

Özet

Recent literature has shown a strong connection between optimization and sampling. We develop the corresponding first-order theory for diffusion models. First, the SDE-based reverse-time flows of overdamped and underdamped Langevin diffusions contract relative Fisher divergences at explicit exponential rates whenever the stationary potential of the forward process is strongly convex—a condition on the noising process one chooses, not on the data. This is a unique advantage of SDE-based reverse diffusion, absent in the reverse process based on ODEs. Second, we incorporate discretization and establish averaged first-order stationarity bounds—the sampling analog of averaged gradient-norm guarantees in nonconvex optimization—for samplers of both overdamped and underdamped diffusion models. As in nonconvex optimization, the convexity-free certificate is local: it guarantees score consistency, not global mode weights.

Orijinal Özet (İngilizce)

Recent literature has shown a strong connection between optimization and sampling. We develop the corresponding first-order theory for diffusion models. First, the SDE-based reverse-time flows of overdamped and underdamped Langevin diffusions contract relative Fisher divergences at explicit exponential rates whenever the stationary potential of the forward process is strongly convex—a condition on the noising process one chooses, not on the data. This is a unique advantage of SDE-based reverse diffusion, absent in the reverse process based on ODEs. Second, we incorporate discretization and establish averaged first-order stationarity bounds—the sampling analog of averaged gradient-norm guarantees in nonconvex optimization—for samplers of both overdamped and underdamped diffusion models. As in nonconvex optimization, the convexity-free certificate is local: it guarantees score consistency, not global mode weights.

Kaynak: arXiv:2609.31612 · PDF

BibTeX

@article{chen2026firstorder,
  title   = {First-Order Stationarity of Reverse Diffusions},
  author  = {Zhifeng Chen and Chenyang Jiang and Yazhen Wang},
  journal = {arXiv preprint arXiv:2609.31612},
  year    = {2026},
  url     = {https://arxiv.org/abs/2609.31612}
}

Tartışma

Bu habere emoji ile tepki ver

İptal

Hizli:

Henüz yorum yok. İlk yorumu siz yapın!

Yapıcı ve saygılı yorumlar bekliyoruz. Topluluk kuralları