A Microsoft Research project called Hyperlapse was revealed last year that makes all the GoPro videos captured with a helmet camera during activities such as rock climbing or bicycling more watchable. You can’t watch the video of someone climbing a mountain from a first person perspective, when you watch it in 10x speed, it will become too shaky. At high speed-up rates, simple frame sub-sampling coupled with existing video stabilization methods does not work, because the erratic camera shake present in first-person videos is amplified by the speed-up. Microsoft’s project solves this issue.
MSR’s algorithm first reconstructs the 3D input camera path as well as dense, per-frame proxy geometries. Then they optimize a novel camera path for the output video (shown in red) that is smooth and passes near the input cameras while ensuring that the virtual camera looks in directions that can be rendered well from the input. After that, they compute geometric proxies for each input frame. These allow us to render the frames from the novel viewpoints on the optimized path.
They create a novel smoothed, time-lapse video by rendering, stitching, and blending appropriately selected source frames for each output frame. The end result is much more watchable videos than the traditional stabilization techniques. Looks like MSR is now working on a mobile app that allows you to record Hyperlapse videos on your Windows Phone devices. Hyperlapse Mobile internal beta was spotted in Windows Phone Store recently. Hopefully, they will release this app to the general public soon. Find the listing here. To know about difference between Instagram’s Hyperlapse and MSR’s Hyperlapse, read it here.