This paper introduces a technique that enables the creative reshaping of one or more video signals based on granular synthesis techniques, normally applied only to audio signals. We demonstrate that a wide range of novel video processing effects can be generated through conceptualizing a video signal as being composed of a large number of video grains. These grains can be manipulated and maneuvered in a variety of ways, and a new video signal can then be created through the resynthesis of these altered grains; effects include cloning, rotating, and resizing the video grains, as well as repositioning them in space and time. These effects have been used successfully in a series of interactive multimedia performances, leading us to believe that our approach has significant artistic potential.

Categories and Subject Descriptors (according to ACM CCS): I.3.6 [Computer Graphics]: Methodology and Techniques-Graphics data structures and data types; I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism-Animation.

PDF

Forbes, A.G., Villegas, J., Video Granular Synthesis, In Proceedings of the International Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging (CAe), Istanbul, Turkey, pp. 195-201, Paul Rosin, June 20th, 2015.