Adaptive Policies for Real-Time Video Transmission: a Markov Decision Process Framework


Chao Chen, Robert W. Heath, Jr., Alan C. Bovik and Gustavo de Veciana


Published in Proceedings of the 18th IEEE International Conference on Image Processing , September 2011.


We study the problem of adaptive video data scheduling over wireless channels. We prove that, under certain assumptions, adaptive video scheduling can be reduced to a Markov decision process over a finite state space. Therefore, the scheduling policy can be optimized via standard stochastic control techniques using a Markov decision formulation. Simulation results show that significant performance improvement can be achieved over heuristic transmission schemes.