The Automatic Sentiment Analysis in the Wild (SEWA) is a EC H2020 funded project. The main aim of SEWA is to deploy and capitalise on existing state-of-the-art methodologies, models and algorithms for machine analysis of facial, vocal and verbal behaviour, and then adjust and combine them to realise naturalistic human-centric human-computer interaction (HCI) and computer-mediated face-to-face interaction (FF-HCI).
This will involve development of computer vision, speech processing and machine learning tools for automated understanding of human interactive behaviour in naturalistic contexts. The envisioned technology will be based on findings in cognitive sciences and it will represent a set of audio and visual spatiotemporal methods for automatic analysis of human spontaneous (as opposed to posed and exaggerated) patterns of behavioural cues including continuous and discrete analysis of sentiment, liking and empathy.
SEWA will draw on expertise from several disciplines as illustrated in the table below:
Expertise | ICL | UP | RealEyes | PlayGen |
---|---|---|---|---|
Image processing | ||||
Speech recognition | ||||
Audio processing | ||||
Online learning | ||||
Unsupervised learning | ||||
User studies | ||||
Multimodal learning | ||||
Multimodal recommendation | ||||
Social signals and social games | ||||
Audio-visual database design | ||||
Ethical studies |
SEWA partners Realeyes have been selected as one of the startups to join European Union Delegation to the USA at the upcoming SXSW 2018
Imperial College Department of Computing are hosting a public event on 26 January 2018 on the subject 'Ethics in Artificial Intelligence (AI)'
Funding from the European Commision Horizon 2020 Programme.