Development and challenges of crowdsourcing quality of experience evaluation for multimedia

Abstract

Crowdsourcing quality of experience (QoE) evaluation for multimedia are more cost effective and flexible than traditional in-lab evaluations, and it has gradually caused extensive concern. In this paper, we start from the concept, characteristics and challenges of crowdsourcing QoE evaluation for multimedia, and then summarize the current research progresses including some key technologies in a crowdsourceable QoE evaluation framework. Finally, we point out the open research problems to be solved and the future trends.