The main objective of TAPESTRIES is to stimulate growth in new broadband services by developing an understanding of the key psychological factors that contribute to customer satisfaction with new entertainment and informational services. This knowledge will be of benefit to the optimisation of such services according to both engineering and market criteria.
Visual models as a means of managing distortions which occur in certain television scenes, in the most subjectively acceptable way possible.
A distortion metering algorithm for MPEG-2 based systems.
Evaluation of adequacy for purpose of new MPEG-2 delivered broadcast services.
Understanding of psychological phenomena associated with new display technologies.
Understanding of psychological phenomena associated with new entertainment media.
Methods for subjective 'adequacy of purpose' and 'quality for the purpose', including software to help with sequence characterisation.
TAPESTRIES is contributing to the methodology to be used in the MPEG-4 verification model tests in July 1997. It is also influencing the standardisation activities of ITU-T SG12 and ITU-R SG11.
The emergence of the MPEG-2 standard is leading to new opportunities for broadcasters to offer diversified programming. At the same time, the flexibility of the MPEG-2 coding process gives rise to choices of the degree of impairment versus the number and range of services contained within a bit-stream. The determination of 'adequate for the purpose' bit-rates for broadcasting thematic MPEG-2 coded channels is a matter of considerable commercial interest to broadcasters. Preliminary results are due in spring 1997.
Visual models are being developed as a means of managing distortions which occur in certain television scenes. A practical subjective quality evaluation tool will be developed based on the visual model. It is hoped this might make possible the optimisation of coding parameters in near real-time: such a tool would be of considerable value to broadcasters for monitoring and optimising the quality of service.
The work to assess human factors associated with stereoscopic displays and immersion in virtual environments is of considerable importance; the use of stereoscopic displays in the work place for such operations as remote handling in dangerous environments and performing medical procedures is already happening today. Potentially the largest area of expansion is in the entertainment industry for providing a range of experiential services. The focus during 1997 will initially be on assessing the relationship between dependent variables (amount of depth, naturalness of depth, quality of depth and presence) while varying independent variables such as stereo, motion and accommodation in order to assess the influence of these depth cues on the dependent experiential measures. The question of how the human being recognises something to be surreal and is therefore no longer prepared to suspend disbelief is a key issue for the virtual reality industry
It is also anticipated that a Super High Definition (2048 x 2048 x 60 Hz) display will be used to study the effects of selective resolution enhancement on particular types of overhead transparency material used in distance learning. The outcome of the study is likely to lead to efficient practical delivery systems for remote education using either (i) a new high-capacity optical fibre network (ii) ISDN and (iii) the Internet.
Main contributions to the programme objectives:
New automated and subjective quality assessment tools for the evaluation of MPEG-2, MPEG-4, and stereoscopic television services.
Contribution to the programme
The project contributed to international standardisation on quality assessment methods and providing a quality assessment service to other ACTS projects.
The methods employed in TAPESTRIES are largely those of the psychologist, based around a number of carefully designed experiments. The results need to be skilfully interpreted in the light of statistical analyses. For example, Single Stimulus Continuous Quality Evaluation has been introduced into Rec. ITU-R BT.500. It is only after novel ideas have been experimented with and refined, that new methods for the assessment of application-specific multimedia will emerge.
Based on the analysis of psychological criteria related to specific applications of new entertainment media and display technologies, a framework will be developed for determining acceptability criteria. Methodologies will be developed for the subjective evaluation of a number of multimedia services against these criteria. This includes measures of 'presence' in immersive 3-D and virtual reality applications. Another important application area currently under study is that of distance learning. A new method has been formulated which involves subjects recording the correlation between audio and video using the SSCQE method. It is hoped by this means to develop a continuous measurement related to the ease of understanding of multimedia material in distance learning.
Visual modelling activities aimed at developing a perceptual distortion meter for MPEG-2 video include not only traditional theoretical studies based on the state-of -the-art, but also exploration of innovative and potentially more pragmatic approaches.
Summary of Trial
TAPESTRIES includes a subjective evaluation service to other ACTS projects and European broadcasters to determine the subjective quality and failure characteristics of a range of audio-visual services. During 1996, TAPESTRIES participated in a test carried out by CINENET to compare two systems for displaying high quality images: cinema projection and HDTV projection. The task asked of TAPESTRIES was the subjective test design, preparation and management, and the processing of the results.
TAPESTRIES also prepared, realised and processed the results of a QUOVADIS subjective test aimed at the analysis of the behaviour of the image quality of digital TV (DVB) under transmission error conditions on three different types of network: terrestrial, satellite and cable. In both cases, the tests were carried out using the SSCQE method.
Several further collaborations are planned with other ACTS projects during 1997.
Various application-specific uses of audio-visual communication are emerging within the broadcast and telecommunications industries. The key focus is now on ensuring that the service possibilities are developed to the same level as the transmission possibilities already have been, so that the environment will be set for growth in the commercial use of IBC networks.
Asking the question "what level of quality will the viewer find acceptable for this application?" is of direct relevance to emerging multimedia applications. It is likely that the answers will vary between applications, and could well influence the economics and design of coding schemes. A correct understanding of the appropriate level of quality required, or "suitability for the purpose", is a key factor in determining appropriate usage of Integrated Broadband Communications networks. In the future, entertainment services are likely to be presented directly to the individual user in a manner which gives a more involving experience than looking at a simple picture display screen. A significant application area currently under study is that of distance education.
The virtual reality-type head-mounted display, the telepresence viewer or high definition multimedia screen, are all examples of ways in which entertainment and information will be imparted to the viewer. All these experiential immersive media will have psychological consequences for those who use them, both at work and at play.
These are matters of folklore today and urgently need to be understood and quantified. What causes the headaches experienced by the operator of a stereoscopic remote handling system? What health and safety guidelines are required for professional use of telepresence equipment? How do people behave when they are re-adjusting to the real world after prolonged immersion in a virtual environment? Just as regulators of television today are concerned about the disturbing effects upon viewers of subliminal suggestion or flashing images, what guidelines will they need for the future services?
One of the important requirements for images to be adequate for their purpose is perceived realism; that is, the degree to which a viewer accepts the image as a representation of a real world. This perceived realism will be related to image quality. The main dependent variables to be investigated are perceived realism and its relation to image quality, stereoscopic perception and its temporal course of development.
Meanwhile, the potential for multimedia applications brings an opportunity for the delivery of images which are adequate for their purpose, but are not necessarily of full-screen entertainment quality. This includes, for example, MPEG-4 proposals.
In summary, the key issues are:
Development of an understanding of the key psychological factors contributing to customer acceptance of new entertainment and informational services.
Exploration of the psychological phenomena and regulatory implications associated with new entertainment media and display technologies, including stereoscopic and virtual reality environments.
Investigation of psychological phenomena associated with creating and sustaining a sense of 'involvement' when using immersive media.
Development of methods for assessing subjective responses of 'adequacy of purpose' and 'quality for the purpose'.
Funding SchemeCSC - Cost-sharing contracts