Wide Incremental learning with Discrimination nEtworks

Objective

Although homo sapiens has been endowed with language for over 50,000 years, the invention of alphabet-like scripts 3,000 years ago dominates Western linguistic thinking. Training in literacy starts in early childhood, and because of this, words and letter-like sound units can naturally seem to be the building blocks of language. The Chinese writing system highlights the cultural-specificity of this approach: characters are juxtaposed without intervening spaces, and their interpretation is highly context-dependent. Words are not singled out. And although more frequent characters contain parts indicating pronunciation, it is syllables that are referred to, not letter-like sound units.

The research proposed here seeks to break the hold that the alphabet-centric approach has on our understanding of language by exploring the idea that instead of being phone and word-based, languages use low-level properties of the acoustic signal to directly reduce uncertainty about the messages encoded in the speech signal. My work with wide learning networks (two-layer networks with many thousands of units, using the simplest possible error-driven learning rule) provides remarkable support for this suggestion: For reading and speech comprehension, their performance closely matches both the strengths and the weaknesses of human processing. Especially at a time when machine learning and artificial intelligence are moving beyond human capacity, it is a methodological imperative to study and work with algorithms reflecting both the advantages and disadvantages of human learning.

I am requesting funding to take this radically novel research program to the next level by further developing our account of auditory comprehension, by modeling more typologically diverse languages, by extending this approach to speech production, and by developing a discrimination-based language theory.

Fields of science

• natural sciencescomputer and information sciencesdata sciencenatural language processing
• social sciencessociologysocial issuessocial inequalities
• natural sciencescomputer and information sciencesartificial intelligencemachine learningdeep learning
• natural sciencesmathematics
• social sciencespsychologypsycholinguistics

Keywords

• wide learning
• speech comprehension
• speech production
• computational modeling
• naive discrimination learning

Programme(s)

• H2020-EU.1.1. - EXCELLENT SCIENCE - European Research Council (ERC) Main Programme

Topic(s)

• ERC-2016-ADG - ERC Advanced Grant

Call for proposal

ERC-2016-ADG

Funding Scheme

Host institution

Beneficiaries (1)