Goodbye Mr. Shakycam: Microsoft Research shows off "hyperlapse video," amazing smooth timelapse
In some cases, Shakycam-guy can’t help it. If the phone or GoPro is mounted to a bicycle or something, there are genuine limits to optical image stabilization, and not everyone can afford a gyro-stabilized kit.
Microsoft Research has been working on an algorithm which allows for converting first-person videos into what it calls hyperlapse videos, time-lapse without the shakiness. The result is really nice, and we don’t mind saying that this would be a great addition to the Microsoft Mobile line of Windows Phones.
Below is a technical overview of how the original video stream is sampled. Following the technical explanation is a more practical result of before-and-after. It is more than just picking every tenth-frame and patching things together, the methodology is remarkable.
The consumer applications for something like hyperlapse are easy to appreciate. If you want to know more about the methodology, and the advanced math that made it all possible, technical and supplemental papers can be found via the source link.
1. Technical overview
2. Less technical overview
source: Microsoft Research via The Next Web
1. lyndon420 (Posts: 1782; Member since: 11 Jul 2012)
Cortana, and now this? Maybe there is still hope for WP.
9. juandante (Posts: 370; Member since: 23 Apr 2013)
Please note that this is not the original video but a 10x speed up video.
I don't see no interest, baybe when phones will record at 300 fps in Full HD (so 300/10 = 30 smooth fps), but I guess when this will arrive there will be far better technology than this.
Phonearena's title is not correct.
13. TheGenius (Posts: 339; Member since: 06 Mar 2014)
But the video they shot are impressive no matter what.!
MS has been doing a great job lately .. no doubts about that now.
3. pureviewuser (Posts: 205; Member since: 11 Nov 2012)
We'll done MS I'm your client forever!!!!
4. ajonly (Posts: 15; Member since: 25 May 2013)
Great. All the hardwork behind this need to be appreciated too. But the conversion is not exactly the real input video but a 10X speedy version of it. I really doubt how exactly this improvisations comes in handy when the world moves to G-Glass kind-off devices. We prefer to see real time videos and occasionally such 10x or slow motion videos. Hope some further improvements can fix it up.
6. NawalKishor (Posts: 4; Member since: 20 Jul 2014)
I wish this was implemented in iOS 8's time lapse too!
7. neela_akaash (Posts: 173; Member since: 05 Aug 2014)
Oops... Apple is very slow at fulfilling their loyal customer's wishes.....
10. yep_its_ed (unregistered)
Lol at 2:10 on the second video the guy just disappeared!
11. elitewolverine (Posts: 1937; Member since: 28 Oct 2013)
Even at 10x that is awesome. If they can get their cams do to 60fps, then down to 6fps for the rendering, then back to 24fps, it would only be a 4x speed up instead of 10x. Even 4x, for a timelapse video of an adventure is awesome. Especially if you can go back and forth between the raw and hyperlapse.
If MS was smart, they would offer cloud system, so that a user could upload the video, let MS cloud Azure compute the video for the customer and then give them a email when the file is finished.
14. sprockkets (Posts: 1311; Member since: 16 Jan 2012)
Yeah, more stuff from MS that will never see the light of day.
We can only hope.
Oh, don't believe me? Remember a few years ago them touting a 1-3ms delay touchscreen? You know, it could track your finger perfectly on the screen with no lag?
Not on Surface.
Not on Surface 2 Pro.
Not on Surface 3 Pro.
Not on any Nokia device.
Stop bragging and start delivering.
15. SemperFiV12 (Posts: 847; Member since: 09 Nov 2010)
so much for "hope" mr glass half empty :) but I don't disagree with your angst... im just a tad more optimistic.