CORDIS Archive

View the original page arrowbar Legal Noticebar Print the page
This page has been archived. It will no longer be updated.

MPEG2, Video Mixers and Moles

It takes a lot of bandwidth to transmit a TV picture. For instance, a PAL TV signal sampled at 13.5 MSamples/sec requires a data link with a capacity of 140 Mbits/sec. Although data capacity is becoming more and more abundant, and costing less and less, there are still good reasons for processing the signal so that it requires less bandwidth.

MPEG2 compresses by removing redundancy, both within individual TV frames and between successive frames. Individual frames are split into blocks, each of which is then processed with a DCT (Discrete Cosine Transform). This, in effect, converts each block into a set of coefficients that define its spatial frequency components. Additional compression is achieved by discarding coefficients with a small value (i.e. whose contribution to the overall picture is small).

Further compression is available by exploiting the fact that the change in picture content between one frame and the next is usually quite small. Therefore, compression can be achieved by transmitting only the changes that occur between one frame and the next. In fact, the algorithm predicts what subsequent frames will contain, and then transmits error signals that indicate how the 'real' picture deviates from the predicted picture.

To gain an idea of the efficiency of MPEG2 compression, consider the following. Recommendation CCIR 601 specifies a scheme for digitizing component-quality (i.e. luminance and colour information transmitted separately) television signals at 216 Mbits/sec. An HDTV signal digitized in this way would require about 1 Gbits/sec. After compression, the respective bit rates are 10 Mbits/sec and 40 Mbits/sec. Still further reduction in bit rate is possible if picture quality can be sacrificed; but even a 5 Mbits/sec compressed PAL signal compares well with a VHS videocassette.

ATLANTIC

At present, MPEG2 is used in the transmission chain; once the programme has left the television centre, MPEG2 can used as the transport format. However, there are many reasons for developing a TV picture mixer that can operate on compressed video signals directly. This technology is being developed by the ACTS project, ATLANTIC.

The nature of MPEG is that the signals cannot be mixed easily. With ordinary (non-compressed) video signals, it is a straightforward matter to cut between one picture source and another, accurate to the resolution of individual frames. With a compressed picture, however, the signal that makes up a particular frame will probably have components of previous frames, and the operation becomes non-trivial.

Three existing approaches to mixing MPEG2 video signals all have their shortcomings. The first, Naive Cascading, fully decompresses the signal, mixes it with other sources and then re-compresses it. The disadvantage is that in real-life broadcasting, the signal would probably be mixed several times, and each process degrades the picture quality.

The second method, Restricted MPEG2, uses a limited subset of MPEG2 encoding, and this allows something approaching frame-accurate editing to be achieved. The penalty is that it is incompatible with the mainstream MPEG2 encoding, and is therefore only really suitable for closed systems. The third method, Bitstream Splicing, makes the cut between one picture source and another at precisely the right moment, carefully avoiding the creation of processing artefacts. This has the disadvantage that frame-accurate editing is not possible, neither are gradual cross-fades between pictures.

Moles

A recent paper entitled Seamless Concatenation - a 21st Century Dream (presented at the recent Montreux 20th International Television Symposium) describes some of ATLANTIC's work. The approach used in the ATLANTIC project recognizes that mixing can only take place with uncompressed pictures. The trick is to preserve the so-called side information, which relates to the motion vectors and coding mode decisions contained within the compressed signal. The decoder has to extract the side information from the compressed signal as part of its normal processing and, having used it, would ordinarily discard it.

The ATLANTIC approach is to preserve the side information, and to pass it on to the re-encoding process. In this way, the encoding process does not have to spend precious processing power re-creating the side information, and picture fidelity is preserved. Meanwhile, the de-compressed video signal is passed on to a video switch and processed in the usual way.

The side information used in this way is called a mole, because is 'burrows' through the studio equipment automatically emerging at the re-encoder. The distortion inherent in this process is very small; mathematically, the distortion is calculated to be of the order of 0.0002dB, whereas multiple naive cascading has a distortion of typically 5dB.

Further challenges

The development of a true MPEG2 Editor poses several design challenges, which ATLANTIC is addressing. These include: audio/video synchronization, handling of programme related data and audio editing, design of a low-cost 'journalist workstation' using off-the-shelf MPEG equipment, and a scheme for controlling the whole system.
By Adrian Rawlings, Euronet Associates Ltd, 25.08.1997