Sony a77 1080p video appears similar or identical to 720p capture digitally upsampled
I use an array of cameras for video work, primarly Panasonic GH2s,
but also an Olympus EPL1, a 5D Mark II, a Sony a77, and the
occasional Vixia camcorder. For some reason, the videos from the a77
were never usable cropped, while those from the GH2 were always
okay. I decided to do a little experiment.
High level summary: The results were consistent with the
a77 shooting video at 720p, likely further cropping by 1.2x, and then
upsampling to 1080p.
Experiment
I mounted a Zeiss 85mm f/1.4 lens on the camera. I set it on a
tripod, and focused it manually (with focus zoom) on a cardboard
box. I took a photo at 1/200s, f/2.8, ISO200
(RAW, JPEG). I
took a video at 1080/24p (original video). I
extracted the middle frame from the video
with mplayer. I took both images,
and cropped out a label from the
middle of the box. At that point:
- I scaled the still (gimp, sinc interpolation) to 160 pixels wide
(same as crop from video). This is what the video should look like.
- I scaled the still to be 107 pixels wide, and then back to 160
pixels, to simulate capture at 720p followed by digital upscaling to 1080p.
- I repeated the experiment simulating cropping to 90 pixels
wide. This is close to what would happen if the whole sensor captured
at 720p, cropped 1.2x for stabilization, and then upsampled to 1080p
(numbers very much eyeballed here)
Results
| Actual a77 video (100% crop) |
What it should look like |
Simulated 720p on sensor |
Simulated 720p on video portion of sensor |
 |
 |
 |
 |
The images resampled in gimp darken slightly, since gimp does not
manage gamma when up/downsampling with sinc interpolation. Just to see
the level of detail hitting the sensor, a 100% crop from the original
JPEG:
Other points of note:
- The GH2 (my primary video cameras) definitely do not have this
behavior. The videos are crisp. I use the Olympus and the Canon less
frequently, but I have no reason to believe they share this behavior
(although I may have just missed it).
- Video compression should not account for this (unless Sony has a
bug). The video is maximum bit rate, minimum frame rate video of a
still target. Compression should have virtually no relics. In
addition, Panasonic does not suffer from this problem.
- Other reasons why the a77 is unusable as a video camera:
- No audio levels. Only AGC. It is impossible to capture good audio
without a separate audio recorder.
- No optical image stabilization. Only digital stabilization (which
works well, but could be better applied in post-processing)
- Many UX controls are disabled in video mode. To me, the most
frustrating is lack of focus zoom. To focus, I have to turn the mode
knob to manual, focus zoom, focus, turn the mode knob back to video.
- Of course, it has an additional 1.2x crop factor. This has been
more annoying than I first thought. I figured it wouldn't matter;
it'd just behave more like a u4/3 camera in video mode. In fact,
if e.g. I'm shooting stills of my baby, and want to switch to
video, I can't do it quickly. I need to first switch lenses from
my 85mm to my 50mm. My carefully chosen lens selection for stills
becomes somewhat inadequate for video work.
- Forum discussions suggested this may be a property of worse
downsampling in the a77 than gimp will do with sinc. For comparison,
I'm posting versions of the image downsampled with linear subsampling. This is
a very good approximation of pixel binning when going from 24MP to 2MP
(the only differences is in how edge pixels are handled). In addition,
I have a version identical to row
skipping. Both are much better than the a77 video. As a sidenote,
going from 24MP to 2MP, binning would be almost identical to
sinc.
- Discussions on forum posts suggest one-off experiment error. I
did this experiment more than once with identical results. The cloth
was a backdrop draped over a desk with hard objects on it. There was
no object motion. The camera was on a lightweight (and therefore
shakey) tripod, but there was no shake either at the point I extracted
the video frame (middle of filming), nor at the point I took the still
shot (2 second timer).
- Discussions on forums suggested this may be a property of
resolution loss due to Bayer filter. To confirm whether this may be
the case, I will need to post a comparision to other cameras (soon to
come).
- Discussions on Sony forums had a few slightly aggressive negative
comments about myself as a person ("Sony hater" and the
like; which is a bit surprising given the equipment I buy). I removed
references to past issues with Sony, which indeed, really did not
belong here.
- Note that this is not smoking gun evidence for Sony
shooting at 720p and digitally upsampling. My gut is that this is the
most likely explanation, but Sony could be doing something else
wrong. The effect on the camera user is the same -- advertised 1080p,
actual 720p.
Copyright © 2013. Piotr Mitros. All Rights Reserved. Written Feb
25, 2013. Last modified Feb 28, 2013.