Human-marionette interaction puppetry using mechanical arm and L-shaped screen

In this paper, we propose a human-marionette interaction system to enhance the interactivity of marionette show. The proposed system is composed of a mechanical arm, an L-shaped screen, a Kinect, a computer, and audio equipment. Using gesture recognition and voice recognition, this system is designed to recognize the audience's gestures and voice to control the marionette and the audiovisual effects of stage. Our system enables audience to enjoy a personalized human-marionette interaction puppetry and transform their role into performer.