tldr.takara.ai
Abstract blue and white swirling patterns on black background

SD3.5-Flash: Distribution-Guided Distillation of Generative Flows

September 25, 2025
6 authors
arXiv:2509.21318
3 upvotes
Yi-Zhe Song, Varun Jampani, Hmrishav Bandyopadhyay, Rahim Entezari, Jim Scott,

Abstract

We present SD3.5-Flash, an efficient few-step distillation framework that brings high-quality image generation to accessible consumer devices. Our approach distills computationally prohibitive rectified flow models through a reformulated distribution matching objective tailored specifically for few-step generation. We introduce two key innovations: "timestep sharing" to reduce gradient noise and "split-timestep fine-tuning" to improve prompt alignment. Combined with comprehensive pipeline optimizations like text encoder restructuring and specialized quantization, our system enables both rapid generation and memory-efficient deployment across different hardware configurations. This democratizes access across the full spectrum of devices, from mobile phones to desktop computers. Through extensive evaluation including large-scale user studies, we demonstrate that SD3.5-Flash consistently outperforms existing few-step methods, making advanced generative AI truly accessible for practical deployment.