Naming the world: Semantic associations and form-meaning mappings in the mental lexicon across sign languages

Descripción del proyecto

Comprender el funcionamiento del léxico mental en las lenguas de signos

Las lenguas de signos utilizan símbolos visuales para representar objetos y acciones. A diferencia de las palabras habladas, los signos se codifican en unidades simultáneas de forma. No se sabe del todo el modo en que los signantes almacenan estas palabras tan ricas en símbolos en su léxico mental. No obstante, comprenderlo es esencial para crear mejores recursos para las lenguas de signos. En el proyecto SemaSign, financiado por el Consejo Europeo de Investigación, se emplearán métodos informáticos para hallar correspondencias entre la forma y el significado en las lenguas de signos. Su equipo creará redes semánticas para lenguas de signos de Alemania, Guinea-Bissau y Kenia y analizará las respuestas de asociación de palabras para ayudar a identificar grupos de signos inusualmente próximos en forma y significado. También investigará cómo surgen los léxicos y cómo evolucionan en sus primeras etapas, prestando especial atención al caso de Guinea-Bissau, donde la lengua de signos tiene quince años de antigüedad.

Objetivo

Words in sign languages are rich in visual meaning. They contain shapes, movements, relations in space, etc. that depict objects and actions as symbolic metaphors; e.g. the action of pulling words out of the head in one language means ‘to ponder’. Yet, signs are also encoded into units of form that are articulated in simultaneous constructions, unlike sequences of consonants and vowels in spoken words. How, then, do signers store richly symbolic words that occur in highly simultaneous forms in their mental lexicons? At present, insight into these mental mappings remains highly occluded, not only at the level of behavioral and neural phenomena, but in terms of linguistic analysis as well. What, indeed, is morphology in sign languages when even the smallest units of form—like hooked fingers or a location at the throat—can carry meaning? What is the nature of these units? Do they vary across sign languages or are the iconic roots of form-meaning mappings so powerful that the same ones re-occur across unrelated sign languages? Answering these questions is urgently needed to create better sign language resources for teaching and learning, and to advance language technologies.

The SemaSign project proposes a ground-breaking approach to these questions by locating form-meaning correspondences in sign languages through computational means while creating new empirically-robust datasets to reveal how signs are organized in the mental lexicon. Semantic networks are created for sign languages from Germany, Kenya, and Guinea Bissau on the basis of word association responses in which a signer sees a sign from their language and responds with the first three signs that come to mind. This will establish an objective measure of semantic relatedness, enabling computational means to locate clusters of signs unusually close in both form and meaning. As the language in Guinea Bissau was formed only 15 years ago, we will also discover how lexicons emerge and grow at a very early stage