Loss Functions in Diffusion Models: A Comparative Study

  • Diffusion models have emerged as powerful generative models, inspiring extensive research into their underlying mechanisms. One of the key questions in this area is the loss functions these models shall train with. Multiple formulations have been introduced in the literature over the past several years with some links and some critical differences stemming from various initial considerations. In this paper, we explore the different target objectives and corresponding loss functions in detail. We present a systematic overview of their relationships, unifying them under the framework of the variational lower bound objective. We complement this theoretical analysis with an empirical study providing insights into the conditions under which these objectives diverge in performance and the underlying factors contributing to such deviations. Additionally, we evaluate how the choice of objective impacts the model ability to achieve specific goals, such as generating high-quality samples or accurately estimating likelihoods. This study offers a unified understanding of loss functions in diffusion models, contributing to more efficient and goal-oriented model designs in future research.

Export metadata

Additional Services

Search Google Scholar
Metadaten
Author:Dibyanshu Kumar, Philipp Vaeth, Magda Gregorova
Persistent identifier:https://doi.org/10.48550/arXiv.2507.01516
Parent Title (English):CoRR
Document Type:Conference Proceeding
Language:English
Year of publication:2025
Publishing Institution:Technische Hochschule Würzburg-Schweinfurt
Release Date:2025/07/15
Institutes and faculty:Institute / Center for Artificial Intelligence (CAIRO)
Licence (German):License LogoCreative Commons - CC BY - Namensnennung 4.0 International
Verstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.