Generating Cinemagraphs Tushar Turkar © P hotodoto.com Outline Summary Previous work Description of work Results Analysis Summary Cinemagraphs are seamlessly looping media files wherein one or more prominent (or selected ) region in the foreground is dynamically in motion while rest of the scene is static. The Problem : A regular process to generate a cinemagraph comprises of the following steps: Recording - Capture stabilized footage, e.g., with a tripod Editing Software - Import the raw footage and clip it to show the desired content Masking - Create a mask to mobilize / immobilize the areas of interest Composite - Apply the mask and composite it with a static (invert-masked) image from the clip. Looping - Add seamless boundaries around clip on which to loop. While all this can also be done with several algorithms proposed in the research papers mentioned ahead, creating a cinemagraph still remains a cumbersome task for a majority of ...
Summary of Work to Date: Setting off to implement a Cinemagraph generator using the two papers [ 1 ] [ 2 ] as primary references, following is a list of work done: Going through the papers' methods, two main steps have been outlined for generating semi-automatic / automatic cinemagraphs, namely, Warping and Compositing . The former step (also the one that I majorly studied hitherto) requires use of KLT feature tracking. To understand the working of the tracker, I read through topics including Corner Detection , Homography , RANSAC and Optical Flow . I experimented with sample codes provided by OpenCV to understand how they work and how would I use this existing implementation towards the project goal. Optical Flow example (1): The lines denote the direction of motion of pixel under the dot Optical Flow example (2): HSV flow visualization KLT Tracking example: Detects good-tracking-points and tracks them across frames. As a part...