CORDIS

There have been tremendous advances in color science. The absorption of photons by three types of photoreceptors is known at the molecular genetic level. Human cone fundamentals are tabled to several decimal places and color opponency is understood at the neural and computational level. Yet, all this knowledge is based on extremely restrictive assumptions with a colored light in the dark (Color 1.0) or flat, matte surfaces in a uniformly colored context (Color 2.0). But which mechanisms mediate perception of colors in the real world– when looking at a field of flowers or searching for a certain product in the supermarket?

Arguably, the most important function of color is the processing of information about objects in scenes. It is the tight link to objects through which color helps us see things quicker and remember them better. This proposal, Color 3.0, is based on an active observer dealing with three-dimensional objects in natural environments. It deals with the dimensions relevant for the main purpose of color perception – intensity, hue and saturation. The goal is to fundamentally rethink color science around real world objects and natural tasks.

We will gain a deep understanding of the circuitry underlying color perception in real and virtual worlds, a Deep Neural Network model of color processing that can be traced through the brain, a new colorimetry based on natural object colors rather than flat, matte patches of light, and last but not least a better measure for luminous intensity that can deal with objects of different color. This could lead to a revision of how we study the early visual system, better color reproduction and better lighting systems. Our use of real-time raytracing in VR could cause a paradigm shift in vision science, away from a passively viewing observer pushing buttons, towards an active observer situated in a virtual world and performing a natural task.