Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

When a Profile is worth more than a Thousand of Hashtags: Automatic Inference of Personality Traits based on Images Shared in Social Networks

Objective

The social media, as a major platform for communication and information exchange, provides a rich repository of the opinions and sentiments of 2.3 billion users about a vast spectrum of topics. Such knowledge is playing an important role to understand and predict human decision making, while becoming essential for digital marketing, brand monitoring, and customer understanding, among others. Although social marketing budget is doubling each year, reaching 9 billion dollars in 2015 in US alone, the analysis of trends, topics and brands in social networks is based solely on textual posts. Despite the fact that 65% of users are visual learners, the knowledge embedded in the 1.8 billion photos uploaded daily in public profiles is ignored.
Based on this gap in coverage, we propose a platform which applies the most modern machine learning techniques, based on Deep Learning, to understand near 1 million images publicly shared per day, for the inference of relevant insights from social profiles. In essence, this visual knowledge is extracted using our current know-how on image understanding, in the form of a working, validated prototype which generates a description of (i) soft-biometric characteristics of people appearing in shared pictures; (ii) their type of clothes, logos, objects and scenes; and, (iii) when available, its geolocalisation and accompanying texts. Working during this project in a proper combination of these sources of knowledge will enable the final product to estimate more accurately the social user's demands and cultural-driven interests, eventually reaching some degree of personality trait description.
Discovering the hidden customers of a given brand, based on the pictures shared in their public profiles, will revolutionize the next generation of analytical tools for social networks monitoring, making the process of images understanding an essential source of information in future marketing, anthropology, sociology, and political studies

Fields of science (EuroSciVoc)

Programme(s)

Topic(s)

Funding Scheme

SME-1 - SME instrument phase 1

See all projects funded under this funding scheme

Call for proposal

(opens in new window) H2020-SMEInst-2016-2017

See all projects funded under this call

Coordinator

VISUAL TAGGING SERVICES
Net EU contribution
€ 50 000,00
Address
LG PARC DE LA RECERCA DE LA UAB EDIF EUREKA CERDANYOLA DEL VALLES
08193 BARCELONA
Spain
SME
Yes
Region
Este Cataluña Barcelona
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Links
Total cost
€ 71 429,00