Video Granular Synthesis
This video portrait captures the subject as she is singing, and the audio features (pitch and amplitude) change aspects of the temporal shuffling of the grain, including grain size and delay. - A. Forbes, EVL
Authors: Forbes, A.G., Villegas, J.
Publication: In Proceedings of the International Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging (CAe), Istanbul, Turkey, pp. 195-201, Paul Rosin
This paper introduces a technique that enables the creative reshaping of one or more video signals based on granular synthesis techniques, normally applied only to audio signals. We demonstrate that a wide range of novel video processing effects can be generated through conceptualizing a video signal as being composed of a large number of video grains. These grains can be manipulated and maneuvered in a variety of ways, and a new video signal can then be created through the resynthesis of these altered grains; effects include cloning, rotating, and resizing the video grains, as well as repositioning them in space and time. These effects have been used successfully in a series of interactive multimedia performances, leading us to believe that our approach has significant artistic potential.
Categories and Subject Descriptors (according to ACM CCS): I.3.6 [Computer Graphics]: Methodology and Techniques-Graphics data structures and data types; I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism-Animation.
Date: June 20, 2015 - June 22, 2015
Document: View PDF