fcp.co logo transparent
fcp clapperboard

Creating stunning cinemagraphs from the ISS with Final Cut Pro X and Flixel

ISS cinemagrphs fcpx

Armand Dijcks very kindly describes how he made the stunning cinemagraphs from images taken by Dutch astronaut André Kuipers on the International Space Station. Final Cut Pro X's optical flow was the tool to smooth the large resolution timelapses.

We have always been a fan of making cinemagraphs and when we saw these gorgeous ones shot form the ISS, we had to find out more.

Armand takes up the story:

 

 

Please click through on GIF to view bigger sizes

 

I’ve recently been working on a series of 4K cinemagraphs that are, quite literally, out of this world. They were created from images captured by the crew of the International Space Station.

In recent years I’ve been fortunate to be able to do some work for Dutch astronaut André Kuipers, who visited the ISS twice. During his second mission, he and his crew mates captured almost half a million images of planet Earth.

Having worked with this vast image library to create time lapse segments, I thought they would provide a really great subject for cinemagraphs as well. In contrast to a time lapse film, a cinemagraph allows you to take in the view and gaze at it for as long as you like.

To make this happen, I had to overcome a few challenges, but we’ll get to that later. First, let me take you on a virtual trip to the space station and have a look at how these amazing images are captured.

 

 

Photography in space

The ISS is equipped with an array of professional DSLR cameras and lenses large enough to stock a small camera store. Fortunately for the astronauts, a pro-level camera body with a hefty telephoto lens attached weighs nothing in space and can easily be used for hand-held shooting. But that’s about the only advantage for space based photographers.

Being outside the atmosphere, the dynamic range of light conditions is extreme, from the deep black of space to the blinding, unfiltered sunlight. This makes it very tricky to capture time lapse sequences, as the light constantly changes during each 90 minute orbit around the Earth.

 

 

Furthermore the cameras, just like the space station crew, are exposed to radiation - high energy particles that can cause damage to individual pixels in the sensor. Here on Earth, the atmosphere takes care of absorbing this radiation.

After a camera has been in space for a while, its sensor is riddled with hot pixels and dead pixels - pixels that are either permanently “on”, or no longer work at all. The interesting thing is that those hot pixels look almost like stars, so they’re not even that obvious in images of the sky, until you start compiling them into a time lapse. Suddenly, half the stars start moving (the real ones) and the other half stay in place (the hot pixels).

The ISS traverses the planet at a decidedly zippy 17,000 mph (almost 28,000 km/h), which means that you have to use very short shutter speeds in order to keep things sharp. On the night-side of Earth, that can mean a fine balancing act between shutter speeds and ISO settings, to keep the images both relatively sharp and noise free.

The images shot by the astronauts are transferred to Earth more or less right away. Even though the ISS has surprisingly decent bandwidth, the crew of mission 30/31, whose images I’m using, were politely requested by NASA to go easy on the time lapse shooting because of the excessive amounts of data they were producing.

Putting it all together

The work flow for creating the cinemagraphs was relatively straightforward, but there were some specific challenges. One of them is wading through hundreds of thousands of raw images to identify usable time lapse sequences. Not every time lapse sequence makes for a good cinemagraph. Very obvious changes in light or terrain make it hard to find a good loop, and distract from the experience. Another unexpected challenge were the moving solar panel arrays on the space station, that sometimes block part of the view, and are very hard to loop convincingly.

 

 

Once a sequence was selected, my first step was to do some basic raw processing of the original images, mainly adjusting levels, highlights and shadows. I wanted to keep the look as natural as possible. Software like Lightroom automatically recognizes hot or dead pixels and removes most of them, but in some cases, some extra tweaking of the raw setting were required because of extreme amounts of noise.

The processed images then get compiled into a full resolution time lapse in an application called Sequence which can also remove flicker. I then import an exported movie into Final Cut Pro X for resizing, cropping, and some subtle color correction if need be. The original resolution of the images is almost 5K, which results in a very nice and crisp image when reduced to 4K resolution or, in some cases, leaves room for a bit of creative cropping. 

 

 

The most important step however, was to slow down the tempo of the time lapses. You have seen various time lapse compilations that people have created from the ISS footage, and usually it looks as if planet earth is zooming by at warp speed.

The images, often captured at a rate of 1 per second, are played back at 24 or 30 frames per second, making things move 24 or 30 times as fast as in reality. For these cinemagraphs I wanted to give the viewer an experience that’s closer to what you would actually observe from the space station. This meant dramatically slowing down the time lapses to a fraction of their original speed.

The optical flow process is sometimes tricky, because of the extreme amount by which I'm slowing down the footage. If I wanted everything to move in real-time I'd have to slow it down to about 3%, so around 30 times slower than the original. That's not always doable, or the motion might just become too subtle, so I usually use slightly faster speeds. Because of the resolution and the relatively predictable motion, the optical flow algorithm in FCPX usually does a pretty good job. I've only had some real problems in case of cloud patterns. After slowing it down, the footage has a much more zen-like quality, which works very well for cinemagraphs

After cropping and/or rescaling I export the clip again as 4K ProRes, at 30fps. I found that 24fps is not really usable in this case, because you notice a distinct stutter at 4K resolution. The final step is creating a 4K cinemagraph from the clip in Flixel Cinemagraph Pro.

 

 

 

In Cinemagraph Pro I try to find a good loop. This was surprisingly difficult for some footage that contained cloud patterns, so I used a long overlap to blend the beginning and end of the loop. A sequence of the Aurora Australis on the other hand was surprisingly easy to loop. The auroras turn out to form naturally repeating patterns, almost as if they were made for cinemagraphs.

I hope you enjoyed reading about how this somewhat unconventional series of cinemagraphs was created. It’s likely that I’ll add to the series in the future, so keep an eye on my Flixel profile.

 

 


Written by
Top Blogger Thought Leader

I am the Editor-in-Chief of FCP.co and have run the website since its inception ten years ago.

I have also worked as a broadcast and corporate editor for over 30 years, starting on one inch tape, working through many formats, right up to today's NLEs.

Under the name Idustrial Revolution, I have written and sold plugins for Final Cut Pro for 13 years.

I was made a Freeman of Lichfield through The Worshipful Company of Smiths (established 1601). Though I haven't yet tried to herd a flock of sheep through the city centre!

Current Editing

great house giveaway 2020

2020 has been busy, the beginning of the year was finishing off a new property series (cut on FCP) for Channel 4 called The Great House Giveaway. I also designed and built the majority of the graphics as Motion templates. It has been a great success and the shows grabbed more viewers in the 4pm weekday slot than any previous strand. It has been recommissioned by C4 for 60 episodes, including prime-time versions and five themed programmes. 

Tour de france 2020
Although both were postponed to later in the year, I worked again on ITV's coverage of the Tour de France and La Vuelta. 2020 was my 25th year of editing the TdF and my 20th year as lead editor. The Tour was the first broadcast show to adopt FCPX working for multiple editors on shared storage.

 

BBC snooker the crucible

BBC's Snooker has played a big part in my life, I've been editing tournament coverage since 1997. I'm proud to be part of a very creative team that has pioneered many new ideas and workflows that are now industry standard in sports' production. This is currently an Adobe Premiere edit.

amazon kindle BF

Covid cancelled some of the regular corporate events that I edit such as trade shows & events. I was lucky however to edit, from home, on projects for Amazon Kindle, Amazon Black Friday, Mastercard and very proud to have helped local charitable trust Kendall & Wall secure lottery funding.

As for software, my weapon of choice is Final Cut Pro and Motion, but I also have a good knowledge and broadcast credits with Adobe Premiere Pro, MOGRT design and Photoshop.

Plugin Design & Development

I'm the creative force behind Idustrial Revolution, one of the oldest Final Cut Pro plugin developers. It hosts a range of commercial and free plugins on the site. One free plugin was downloaded over a thousand times within 24 hours of release.

I also take on custom work, whether it is adapting an existing plugin for a special use or designing new plugins for clients from scratch. Having a good knowledge of editing allows me to build-in flexibility and more importantly, usability.

FCP.co

Now in its 10th year and 4th redesign, running FCP.co has given me knowledge on how to run a large CMS- you are currently reading my bio from the database! Although it sounds corny, I am pretty well up on social media trends & techniques, especially in the video sector. The recent Covid restrictions has enabled live FCP.co shows online. This involves managing a Zoom Webinar through Restream.io to YouTube and Facebook. 

The Future

I'm always open to new ideas and opportunities, so please get in touch at editor (at) fcp.co. I've judged film competitions, presented workflow techniques to international audiences and come up with ideas for TV shows and software programs!

 

Log in to comment