Selected Publications (Full List on Google Scholar)

• Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models
  Junyu Chen*, Han Cai*, Junsong Chen, Enze Xie, Shang Yang, Haotian Tang, Muyang Li, Yao Lu, Song Han
  Proceedings of International Conference on Learning Representations (ICLR), 2025. (* indicates equal contribution)
  

• SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers
  Enze Xie*, Junsong Chen*, Junyu Chen, Han Cai, Haotian Tang, Yujun Lin, Zhekai Zhang, Muyang Li, Ligeng Zhu, Yao Lu, Song Han
  Proceedings of International Conference on Learning Representations (ICLR), 2025. (* indicates equal contribution)
  

• COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  Haocheng Xi, Han Cai, Ligeng Zhu, Yao Lu, Kurt Keutzer, Jianfei Chen, Song Han
  Proceedings of International Conference on Learning Representations (ICLR), 2025.
  

• Condition-Aware Neural Network for Controlled Image Generation
  Han Cai, Muyang Li, Zhuoyang Zhang, Qinsheng Zhang, Ming-Yu Liu, Song Han
  Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  

• EfficientViT: Multi-Scale Linear Attention for High-Resolution Dense Prediction
  Han Cai, Junyan Li, Muyan Hu, Chuang Gan, Song Han
  Proceedings of International Conference on Computer Vision (ICCV), 2023.
  

• Network Augmentation for Tiny Deep Learning
  Han Cai, Chuang Gan, Ji Lin, Song Han
  Proceedings of International Conference on Learning Representations (ICLR), 2022.
  

• TinyTL: Reduce Activations, Not Trainable Parameters for Efficient On-Device Learning
  Han Cai, Chuang Gan, Ligeng Zhu, Song Han
  Proceedings of Neural Information Processing Systems (NeurIPS), 2020.
  

• Once for All: Train One Network and Specialize it for Efficient Deployment
  Han Cai, Chuang Gan, Tianzhe Wang, Zhekai Zhang and Song Han
  Proceedings of International Conference on Learning Representations (ICLR), 2020
  

• ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
  Han Cai, Ligeng Zhu, Song Han
  Proceedings of International Conference on Learning Representations (ICLR), 2019
  

• Path-Level Network Transformation for Efficient Architecture Search
  Han Cai, Jiacheng Yang, Weinan Zhang, Song Han, Yong Yu
  Proceedings of International Conference on Machine Learning (ICML), 2018
  

• Efficient Architecture Search by Network Transformation
  Han Cai, Tianyao Chen, Weinan Zhang, Yong Yu, Jun Wang
  Proceedings of AAAI Conference on Artificial Intelligence (AAAI), 2018
  

• Real-Time Bidding by Reinforcement Learning in Display Advertising
  Han Cai, Kan Ren, Weinan Zhang, Kleanthis Malialis, Jun Wang, Yong Yu, Defeng Guo
  Proceedings of International Conference on Web Search and Data Mining (WSDM), 2017