Proc. IEEE International Conference on Acoustics, Speech and Signal Processing, May 26-31, 2013, Vancouver, Canada.

3D Rotational Video Stabilization Using Manifold Optimization

Chao Jia and Brian L. Evans

Department of Electrical and Computer Engineering, Wireless Networking and Communications Group, The University of Texas at Austin, Austin, TX 78712 USA -

Paper Draft - Poster - Software Release - Journal Version - Project Site

Videos: Example 1 vs. [5] - Example 1 vs. [7] - Example 1 vs. Original - Example 2 vs. [5] - Example 2 vs. [7] - Example 2 vs. Original


We present a novel video stabilization method for cell phone cameras. Our video stabilization is based on pure 3D rotation motion model, which can better capture the motion of the camera compared with 2D models. The 3D camera rotation can be reliably captured by gyroscopes equipped in most modern cell phones. In this paper we directly smooth the sequence of camera rotation matrices in the video. Our contributions are
  1. a novel smoothness metric for a sequence of 3D rotation matrices based on geodesic distance on non-linear manifold, and
  2. an efficient global motion smoothing algorithm using manifold optimization.
Our smoothness metric better exploits the manifold structure on sequences of rotation matrices. Experimental results show that our video stabilization method outperforms state of the art methods by generating more stable and visually pleasant videos.

COPYRIGHT NOTICE: All the documents on this server have been submitted by their authors to scholarly journals or conferences as indicated, for the purpose of non-commercial dissemination of scientific work. The manuscripts are put on-line to facilitate this purpose. These manuscripts are copyrighted by the authors or the journals in which they were published. You may copy a manuscript for scholarly, non-commercial purposes, such as research or instruction, provided that you agree to respect these copyrights.

Last updated 12/31/13.