Representation in Space and Time: Control Score and Responsive Interface to a Virtual Performance

Vincenzo Lombardo, CIRMA, Università di Torino and Virtual Reality & Multi Media Park

Abstract

This lecture is about the application of the simulative methodology brought over by the digital culture to the design, portability and fruition of a performance. The simulative methodology is a computer-based approach that organizes and delivers the aural and visual elements of a performance according to the temporal sequence defined by a control score, to provide a realistic experience through a responsive interface to a virtual reality environment (Brooks 1999). The result is a virtual performance. The simulative methodology provides a novel approach to the representation and control of a performance, bringing together the descriptive power of storyboard drawings (that here become more or less realistic 3D objects and scenes), the algorithmic and interaction capabilities of the computing machine, and the attractive mediation of a virtual reality environment (though adequate interface design is necessary to realize a satisfactory simulation).

With more and more sophistication in computer graphics representations (with high mimetic quality) and the simulation power provided by the programming environments, the virtual performances become a powerful tool to design and pre-visualize a complex event. Both static (representation) and dynamic (algorithmic) aspects must obey the lexicon and the rules of a formal language that become the symbols manipulated by the control system. Contemporary shows are complex events with contributions from several sources (each requiring specific competencies) and the existence of a common paradigm for representation and control is a viable possibility for providing a connection over operational attitudes that hardly communicate (consider, e.g., video and programming practices) and that conversely require neat and unambiguous responses.

The whole text [PDF, 252 KB]