Demanding VFX at the Center of 'The Midnight Sky'
February 17, 2021

Demanding VFX at the Center of 'The Midnight Sky'

For the feature film The Midnight Sky, demanding out-of-this-world visual effects were needed to bring the story to the screen.  The Midnight Sky follows Augustine (George Clooney), a lonely scientist in the Arctic, as he races to stop Sully (Felicity Jones) and her fellow astronauts from returning home to a mysterious global catastrophe. Clooney directed the adaptation of Lily Brooks-Dalton’s acclaimed novel. 


Framestore

While the film features some big names in front of the camera, behind it is an even more impressive roster. Framestore assembled a sci-fi dream team to join Production VFX Supervisor Matt Kasmir – Academy Award-winning VFX Supervisor Chris Lawrence (Gravity, The Martian), Animation Supervisor Max Solomon (Gravity), VFX Supervisor Shawn Hillier (Star Wars: Episodes II and III) and Graham Page (Interstellar) – to deliver nearly 500 shots across studios in London and Montreal for The Midnight Sky.  

The team was tasked with supporting the story through VFX that seamlessly complimented the cinematography by DOP Martin Ruhe, creating high-level CG facial replacements, building the Aether ship and interior, as well as “sick Earth” and it’s foreboding environment.   Clooney admitted that his role as a stranded astronaut in Alfonso Cuarón’s Gravity (for which Framestore won the Academy Award in Best Visual Effects) helped him to conceive some of the space sequences, telling Vanity Fair, “once you’re in the antigravity kind of world... up isn’t up, and down isn’t down.” To emulate zero-G and help sell a pregnant Sully floating in space (Jones was actually pregnant at the time of shooting), digital face replacements were required for the wide, full-CG shots, totaling 30 shots in the standout Space Walk sequence. 

Incredibly high resolution Anyma scans were combined with cutting-edge proprietary shaders to create convincing high-res digital faces, which were then keyframe animated. “The Anyma capture for the performance gave us an animated mesh of the actor that you can use to drive animation,” explains Page, “but there’s a lot of cleanup work for that to be usable – especially around the eyes and the mouth.” 

Adds Solomon: “The head motion and eyelines were adjusted to work with specific actions and the position of the camera. In some shots it was quite nuanced, enhancing eye darts and blinks, while in others we made broader changes to head angles and eyelines. Considerable sensitivity had to be used though as it was surprising how quickly small adjustments made shots feel broken.” 

The Aether ship, housing the crew returning from their reconnaissance to Jupiter, was designed by Jim Bissell, production designer of E.T. fame, with the support of Framestore’s art director, Jonathan Opgenhaffen. Drawing from the studio’s archive of spaceship parts, Aether evokes the futuristic feel of the film while staying grounded with the tangible technology of today. Using parts of the ISS, existing NASA technology and cutting-edge 3D printed technology, the team was then able to focus on the details and texture of the ship to make it realistic. 

“The buzzword was topological optimization,” explains Opgenhaffen. “The ship’s components had to work practically; it’s beauty stems from its functionality and availability of existing and emerging technologies.”  

The team also created nuanced, ominous imagery to imply the idea that something has caused this global catastrophe. “Sick Earth is a huge character,” notes Lawrence. “It’s purposefully left ambiguous so you ask questions without necessarily receiving answers.” 

Layers of clouds, some curling towards the sky mirroring fingers reaching up to space, are the main aesthetic cue. “It’s not a natural phenomenon, so there’s a bit of speed that is visible from space; we played around with FX passes in comp to create additional movement,” adds Hillier. 


The shoot of Augustine on Earth took place in Iceland, with 70 mph winds and freezing temperatures, although the actual amount of snow posed some problems. “Unfortunately when they went to shoot the plates, a lot of the snow had melted so we had to replace it,” explains Hillier. “We’d worked on snowy landscapes recently for the first season of His Dark Materials, but we really had the opportunity to push our snow shaders further to hold up in all of the close-up shots of the snow moving across the surface of the ground, with the light scattered through it.” 

Pre-production Supervisor Kaya Jabar, then at The Third Floor London, led a virtual camera shoot of the set before designing a virtual LED shoot plan for screens in the observatory. Working closely with Lawrence, Jabar’s team created a suite of tools using Unreal Engine to tie together a virtual camera and an LED screen simulator that was accurate to the exact panels used on the day.  Says Jabar, “I do believe that we were amongst the first people to plan it that way. I just applied the logic that if we can virtually plan a shoot and show you what will replace a greenscreen, then we can do the same with LED screens.” The VFX on The Midnight Sky needed to be as seamlessly integrated, photoreal and realistic as possible. 

“Ultimately, George wanted the drama to be grounded,” adds Lawrence, “The language of the film, especially in those moments you’re with George stuck in isolation, is emphasized by the static locked-off camera and beautiful composition of the scene. It was a nice place to be in; to compliment the filmcraft rather than going all out in showy VFX.”


One of Us
Soho-based VFX studio One of Us was among the talent pool that crafted visual effects for director George Clooney’s melancholy post-apocalyptic sci-fi series 

Portraying​ two parallel journeys of survival, Clooney plays Augustine, the last man on a dying Earth, himself stricken with terminal cancer. In his attempt to contact the spaceship Aether, returning from a mission in search of a habitable world, Augustine must trek from his Arctic base ​through a radioactive ice storm to a weather station. It feels like a piece in tune with our times.  Visual Effects Supervisor Matt Kasmir brought One Of Us on board to deal with some of the more design-intensive aspects of the project. These ranged from the epic to the intimate: from huge vistas of K23, a human-friendly moon of Jupiter, to the holographic family life which serves to comfort the crew of the Aether.  Oliver Cubbage led the One Of US team, and worked closely with Kasmir and Clooney, bringing energy and inspiration to the design, and then precision to the execution. 

Cubbage traveled with Kasmir to the island of La Palma to film the background plates for the K23 environment. The beautiful, alien looking landscape of La Palma provided a perfect backdrop to build upon to realize this new world. Accompanied by some subtle production designed plants and using a stand-in actor, they filmed the plates that would provide the backbone of the K23 dream sequence. Close-up green screen shots were filmed in a studio with Felicity Jones, who played Sully, as she was far enough along in her pregnancy to not be able to travel.  Kasmir commented on the partnership, “I have always loved the creative style One Of Us brings to its work, so I knew I had to get them on board from the beginning. They were huge creative collaborators and Oli and his team produced one of George’s favourite sequences – the living memory holograms. Working with them in post – although remotely of course – was a blast.”  The family holograms were a key element for Clooney, Cubbage explains the creative process, “they required a look which conveyed the melancholy of separation, and so the tech is imperfect – like the crumpled photograph in your wallet. Most of this treatment was created in comp, and was tailored shot by shot, to catch the nuances of performance. VFX is often called upon to create spectacle, so it is an exciting design challenge to find an abstract way to evoke emotion.  We are proud of this collaboration with Clooney, Matt Kasmir, and with the team at Netflix, and delighted to see the success of this visually rich and affecting piece.” 

The Jovian moon of K23 needed to be seen at different scales. We begin tight in on scientist Sully (Felicity Jones) taking samples from a stream. We progress through a ravine, its sides covered with unearthly plants, which then opens out to a field, and beyond that a plain, mountains, and the sky dominated by the parent planet. Everything about this environment had to be coherent and credible, but utterly alien. The challenge here was to choose which laws of nature to obey and which to break. This sequence combined plates shot in La Palma, with Digital Matte Painting and many CG elements. This also required precision in comp, and a great deal of creative input, particularly in the otherworldly palette. 
 
One Of Us also created other holographic tech aboard the Aether and in Augustine’s Arctic base. A dimensional map table, an interactive chart of the solar system, and a game to entertain crew members. All of these elements were simple and elegant, designed to support but not distract from the performances of the actors.