[memo]OminiControl: Minimal and Universal Control for Diffusion Transformer

Zhenxiong Tan, NUS のXinchao wangのグループ

Omnicontrol, novel approach addressing how image conditions are integrated into DiT

Subjects200k, a large-scale dataset of image pairs.

Effective image control

Contribution

They propose omnicontrol, cotrol fr…


This content originally appeared on DEV Community and was authored by Takara Taniguchi

Zhenxiong Tan, NUS のXinchao wangのグループ

Omnicontrol, novel approach addressing how image conditions are integrated into DiT

Subjects200k, a large-scale dataset of image pairs.

Effective image control

Contribution

  • They propose omnicontrol, cotrol framework for DiT models
  • Two key technical innovations
    • unified sequence processing
    • adaptive position encoding
  • flexible attention bias mechanism →conditioning
  • Subjects200k, large scale dataset

Related works

Diffusion models

  • DiT
  • FLUX

Controllable generation

  • Controlnet
  • T2I adapter: lightweight adapter
  • Unicontrol
  • mixture of experts

Methods

Preliminary

Diffusion transformer model is used for FLUX.1, SD3, PixArt.

Minimal architecture

Unified sequence processing

Experiment

Outperformed controlnet

Conclusion

Omniccontrol offers parameter-efficient image conditional control for DiT.

Required parameters are only 0.1 % compared to the traditional one.

感想

ControlnetでやってることをDiTでやってる感じですかね


This content originally appeared on DEV Community and was authored by Takara Taniguchi


Print Share Comment Cite Upload Translate Updates
APA

Takara Taniguchi | Sciencx (2025-06-29T03:06:11+00:00) [memo]OminiControl: Minimal and Universal Control for Diffusion Transformer. Retrieved from https://www.scien.cx/2025/06/29/memoominicontrol-minimal-and-universal-control-for-diffusion-transformer-2/

MLA
" » [memo]OminiControl: Minimal and Universal Control for Diffusion Transformer." Takara Taniguchi | Sciencx - Sunday June 29, 2025, https://www.scien.cx/2025/06/29/memoominicontrol-minimal-and-universal-control-for-diffusion-transformer-2/
HARVARD
Takara Taniguchi | Sciencx Sunday June 29, 2025 » [memo]OminiControl: Minimal and Universal Control for Diffusion Transformer., viewed ,<https://www.scien.cx/2025/06/29/memoominicontrol-minimal-and-universal-control-for-diffusion-transformer-2/>
VANCOUVER
Takara Taniguchi | Sciencx - » [memo]OminiControl: Minimal and Universal Control for Diffusion Transformer. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2025/06/29/memoominicontrol-minimal-and-universal-control-for-diffusion-transformer-2/
CHICAGO
" » [memo]OminiControl: Minimal and Universal Control for Diffusion Transformer." Takara Taniguchi | Sciencx - Accessed . https://www.scien.cx/2025/06/29/memoominicontrol-minimal-and-universal-control-for-diffusion-transformer-2/
IEEE
" » [memo]OminiControl: Minimal and Universal Control for Diffusion Transformer." Takara Taniguchi | Sciencx [Online]. Available: https://www.scien.cx/2025/06/29/memoominicontrol-minimal-and-universal-control-for-diffusion-transformer-2/. [Accessed: ]
rf:citation
» [memo]OminiControl: Minimal and Universal Control for Diffusion Transformer | Takara Taniguchi | Sciencx | https://www.scien.cx/2025/06/29/memoominicontrol-minimal-and-universal-control-for-diffusion-transformer-2/ |

Please log in to upload a file.



There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.

Related Posts