Efficient Vision Transformers: Methods and Applications

Authors

Ze Liu (Microsoft Research Asia)
Han Hu (Microsoft Research Asia)
Yutong Lin (Tsinghua University)

Abstract

This comprehensive study explores methods for developing energy-efficient vision transformers while maintaining high performance in computer vision tasks.

The research evaluates various optimization techniques including architecture modifications, training strategies, and inference optimizations specifically designed for vision transformers.

The authors demonstrate significant reductions in computational costs and energy consumption while preserving model accuracy across different vision tasks.

Sources

Notice something missing or incorrect?
Suggest changes on GitHub