[ Updated with new information about the Rec. 2020 color space, and how ProRes 4444 XQ works. ]
Today, Apple released support for a new member of the ProRes family of codecs: ProRes 4444 XQ. This is a new, very high-quality codec, specifically designed for VFX work.
WHAT IS IT?
According to a white paper released this month from Apple:
Apple ProRes 4444 XQ: The highest-quality version of Apple ProRes for 4:4:4:4 image sources (including alpha channels), with a very high data rate to preserve the detail in high-dynamic-range imagery generated by today’s highest-quality digital image sensors. Apple ProRes 4444 XQ preserves dynamic ranges several times greater than the dynamic range of Rec. 709 imagery—even against the rigors of extreme visual effects processing, in which tone-scale blacks or highlights are stretched significantly. Like standard Apple ProRes 4444, this codec supports up to 12 bits per image channel and up to 16 bits for the alpha channel. Apple ProRes 4444 XQ features a target data rate of approximately 500 Mbps for 4:4:4 sources at 1920 x 1080 and 29.97 fps.
Again, quoting from Apple’s white paper:
Traditionally, digital images have been limited to 8-bit samples. In recent years the number of professional devices and acquisition techniques supporting 10-bit and even 12-bit image samples has increased. 10-bit imagery is now often found in 4:2:2 video sources with professional digital (SDI, HD-SDI or even HDMI) outputs. 4:2:2 video sources rarely exceed 10 bits, but a growing number of 4:4:4 image sources claim 12-bit resolution, though with sensor-derived images the least significant one or two bits may have more noise than signal. 4:4:4 sources include high-end film scanners and film-like digital cameras and can include high-end computer graphics.
Apple ProRes 4444 XQ and Apple ProRes 4444 support image sources up to 12 bits and preserve alpha sample depths up to 16 bits. All Apple ProRes 422 codecs support up to 10-bit image sources, though the best 10-bit quality is obtained with the higher‑bit-rate family members—Apple ProRes 422 and Apple ProRes 422 HQ. (Note: Like Apple ProRes 4444 XQ and Apple ProRes 4444, all Apple ProRes 422 codecs can in fact accept image samples even greater than 10 bits, although such high bit depths are rarely found among 4:2:2 or 4:2:0 video sources.)
Alpha Channels store the transparency information in a clip. Unlike other members of the ProRes family, both Apple ProRes 4444 and ProRes 4444 XQ store alpha data. And, they store it in a mathematically lossless manner.
From Apple’s white paper:
Alpha values are essentially numeric data that specify how to blend, or composite, a foreground image into a background image. For this reason, Apple ProRes 4444 XQ and Apple ProRes 4444 encode alpha values exactly rather than approximately. This kind of exact encoding is called “lossless” (or sometimes “mathematically lossless”) compression. It uses different encoding techniques from those used by the Apple ProRes codec family for RGB or Y’CBCR pixel values, where approximate encoding is acceptable as long as differences from the original are not visible to the viewer and do not affect processing. The Apple ProRes 4444 XQ and Apple ProRes 4444 codecs losslessly encode alpha channel values of any bit depth up to and including 16 bits.
In summary, the Apple ProRes 4444 XQ and Apple ProRes 4444 codecs can be considered “visually lossless” for encoding the Y’CBCR or RGB pixel values intended for viewing, but “mathematically lossless” for encoding the alpha values that specify compositing. As a result, the degree of quality or fidelity is never a question for Apple ProRes 4444 alpha channels because the decoded data always matches the original perfectly.
ProRes 4444 XQ is not a small file. It is designed for the highest possible quality, while still providing reduced file size when compared to an uncompressed source file.
According to Apple, both 1080i/30 and 720p/60 files require a data transfer rate of about 62 MB/sec, and use about 223 GB to store an hour of material. Other frame rates and images sizes will be somewhat different.
You can download the entire white paper from Apple here.
UPDATE: JULY 1, 2014
A reader asked about the relationship between ProRes 4444 XQ and Rec. 2020.
Rec. 2020 is a color space while ProRes is a codec. ProRes is capable of handling a Rec. 2020 signal, since ProRes can accommodate a wide range of color spaces.
Also, wide color gamut (like Rec. 2020) is different from high dynamic range, as Rec. 2020 is designed for reproducing a wider range of colors than Rec. 709. For those people working with higher dynamic range footage, the increased data rate of ProRes 4444 XQ is beneficial for capturing the superior tonal range of HDR material like Log C. This is why ARRI is offering ProRes 4444 XQ recording in high-end configurations of the the ALEXA camera, which was announced yesterday.
UPDATE: JULY 15, 2014
Since I first wrote this article, I’ve learned more about ProRes 4444 XQ. It is principally designed for pro cameras that record High Dynamic Range (HDR) video, because the higher data rate of the format preserves the detail in these recordings. It is currently in use as a camera-codec, for example as part of the ARRI ALEXA. But it has benefits all the way through the video post production pipeline — especially for color grading and visual effects as I describe below.
ProRes 4444 XQ records color data — the red, green, and blue values in an image — with greater accuracy; that is, more decimal places. This precision is necessary when you are shooting a clip that you plan to alter with extreme color adjustments in post.
Here’s a simple analogy to illustrate the benefits of ProRes 4444 XQ. Let’s take a pixel recorded in AVCHD (an 8-bit codec) and compare it to a pixel recorded in ProRes 4444 XQ. Say the “true” source pixel value is 7.499, and you are going to apply an adjustment that effectively amplifies the value by 10x.
With lower bit-rate compression like AVCHD, the original 7.499 pixel value might be represented as 7. After the 10x effect is applied, the value becomes 70.
With high bit-rate compression like ProRes 4444 XQ, the original 7.499 pixel value might be 7.5. After the 10x effect is applied, the value becomes 75, which is much closer to the final value of 74.99 that represents perfect precision. Here is a summary:
ProRes 4444 XQ
|Starting pixel value||
With AVCHD, the difference in starting values between 7 and 7.499 might not be noticeable. But after the effect is applied, the difference between 70 and 74.99 may become significant. With ProRes 4444 XQ, the starting value is so accurate that even after the effect is applied, the error in the final value remains very small.
Because we started with more decimal places in ProRes 4444 XQ, we ended up with more accurate color at the end. This is the benefit that shooting ProRes 4444 XQ provides – more information is recorded at the beginning to allow more flexibility in editing at the end.
21 Responses to What Is ProRes 4444 XQ? [u]
[…] Akhir pekan lalu, Apple menghadirkan pembaruan untuk Final Cut Pro X dan beberapa aplikasi pendukungnya bagi perangkat OS X. Ketiga aplikasi tersebut adalah Final Cut Pro X, Motion dan Compressor. Masing-masing mendapatkan sebuah pembaruan yang sama yaitu mendukung Apple ProRes 4444 XQ. […]
“Apple ProRes 4444 XQ preserves dynamic ranges several times greater than the dynamic range of Rec. 709 imagery”. Would that be Rec 2020?
I don’t know and I’m trying to find out.
I learned more about Rec 2020 and ProRes 4444 XQ and updated the article with new information. Please read the update.
Thanks for the tutorials, Larry. I was working on a composite video with a compound clip of 417 tif images of a satellite and while I could have the animation that came with the clip I could not set motion paths and keyframes. I was puzzled but came across your article (and several others over the last month) about Pro res 4444hq. I ended up out putting the compound clip as a 4444 file then reimported it, set my blend to alpha add and bam! Perfect editable element.
Thanks again for sharing your knowledge.
Where to get this 4444 XQ to use with Adobe AE, Media encoder and PR ??
The easiest, and cheapest, way to get all the ProRes codecs is to buy Compressor from the Mac App Store.
Thanks will do that
OK so after installing Compressor do you have to do anything ells to get the codec to work in AE ?
It depends upon what you mean by “to work.” If you have installed Compressor, which also installed the ProRes codecs, to play a ProRes video in AE all you need to do is import it.
If you want to export a ProRes file, AND you are on a Mac, you’ll just need to specify that during the export process. If you are on Windows, the situation becomes more murky, because I’m not sure the Windows version of AE supports ProRes. For that, you’ll need to contact Adobe directly.
Thanks, I was just wondering about that if one have to follow these steps 1st before you can use the 4444 XQ in Adobe AE. On 5min in the video https://www.youtube.com/watch?v=ZqXxg3lq3mY
Might be obvious, but, If in the middle of a project, should one apply the same rule as new FCPX versions and wait to upgrade to ProRes 4444 XQ?
Found the answer in Larry’s review of 6/29/14 re: PR 444 XQ: “The standard rules apply: don’t upgrade if you are in the middle of a project, unless your current project is not working.” Larry has answers! Thanks.
Apple ProRes 4444 XQ support is included in the 10.1.2 update. There’s nothing you need to do to “convert” to it. It is another codec, like ProRes 422 LT or ProRes 4444.
For existing projects, the 10.1.2 update is fairly painless. HOWEVER, it is generally a good idea to hold off on updates if you are close to finishing a project. If you near the beginning of a project designed to take many months, I would recommend the update.
A further thought. ProRes 4444 XQ is a codec. You don’t upgrade to it, you use it, or don’t use it. It lives harmlessly on your system, accessible but out of the way until you need it.
Unlike upgrading an application, which can affect past projects, adding a new codec does nothing. There are dozens of codecs installed and dormant on your system – PAL DV, MPEG-2, XDCAM HD 422 – that are available if you need them and out of the way if you don’t.
That being said, I would not suggest changing ANY existing project to render in ProRes 4444 XQ, nor would I recommend transcoding into this format. First, there will be no quality improvement. Second, it will take time and storage which you don’t need to spend.
ProRes 4444 XQ is built for the future, not for converting existing projects.
My reason for wanting to go the ProRes 4444 XQ route is to archive my RAW (stills) timelapse footage.
I now heard and seen there is a big colour shift when rendering out to ProRes 4444 XQ – I can send a screen shot from clips colour before redering and one after rendering into 4444 XQ
Where can I send screenshots, before and after to ??
[…] Color Tool is this one from the ever excellent Oliver Peters. Also of note is the recent release of Pro Res 4444 XQ, which ARRI have announced that the Alexa XT/XR will encode […]
Would footage captured at Prores 422 HQ on Blackmagic Cinema Cameras benefit from exporting the final master as ProRes 4444 XQ? This master is for JPEG2000 to MXF wrapper encoding for DCP creation.
Not really. From what I have been told, 4444 XQ is designed as a high-end camera format, not a transcoding format.
I agree with Larry. However, if you shoot 4k raw with a proper high end camera system (I have Sony’s FS700RH+Convergent Odyssey 7Q with Canon CN7x17 lens), you’ll definitely want to store your data as 4444 XQ, not raw. Just use DaVinci Resolve to do the initial color correction for the HDR data, and then transfer it to 4444 XQ. It’s a beast 🙂
[…] new ProRes 4444 XQ codec is worth learning more about. Here’s an article I wrote that explains this in more […]